-- Logs begin at Mon 2022-05-16 19:22:06 UTC, end at Mon 2022-05-16 20:43:52 UTC. -- May 16 20:09:36.978633 dv-cinder-830901-7-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 16 20:09:36.988276 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 16 20:09:36.992343 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 20:09:36 2022] *** May 16 20:09:36.992609 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 20:09:36.992758 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 20:09:36.992882 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: nodename: dv-cinder-830901-7-iscsi May 16 20:09:36.992882 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: machine: x86_64 May 16 20:09:36.992882 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: clock source: unix May 16 20:09:36.992882 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: pcre jit disabled May 16 20:09:36.992882 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: detected number of CPU cores: 4 May 16 20:09:36.992882 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: current working directory: / May 16 20:09:36.992882 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: detected binary path: /usr/bin/uwsgi-core May 16 20:09:36.992882 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: your processes number limit is 47680 May 16 20:09:36.992882 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: your memory page size is 4096 bytes May 16 20:09:36.993402 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: detected max file descriptor number: 2048 May 16 20:09:36.993402 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: lock engine: pthread robust mutexes May 16 20:09:36.993402 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: thunder lock: enabled May 16 20:09:36.993402 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 16 20:09:36.993402 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 20:09:37.042174 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: Python main interpreter initialized at 0x55a46b04c9c0 May 16 20:09:37.042174 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: python threads support enabled May 16 20:09:37.042174 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: your server socket listen backlog is limited to 100 connections May 16 20:09:37.042174 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: your mercy for graceful operations on workers is 90 seconds May 16 20:09:37.042951 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: mapped 403077 bytes (393 KB) for 2 cores May 16 20:09:37.042951 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: *** Operational MODE: preforking *** May 16 20:09:37.042951 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: *** uWSGI is running in multiple interpreter mode *** May 16 20:09:37.042951 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: spawned uWSGI master process (pid: 79922) May 16 20:09:37.043219 dv-cinder-830901-7-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 16 20:09:37.044409 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: spawned uWSGI worker 1 (pid: 79934, cores: 1) May 16 20:09:37.044754 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: spawned uWSGI worker 2 (pid: 79935, cores: 1) May 16 20:09:37.045021 dv-cinder-830901-7-iscsi devstack@keystone.service[79922]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 20:09:43.546452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 20:09:43.546452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: from cryptography.utils import int_from_bytes May 16 20:09:43.547919 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 20:09:43.547919 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: from cryptography.utils import int_from_bytes May 16 20:09:43.599670 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 20:09:43.599945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 20:09:43.600081 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] command line args: [] {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 20:09:43.600464 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 20:09:43.600464 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ================================================================================ {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 20:09:43.600876 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] admin_token = **** {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.601149 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] config_dir = [] {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.601408 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.601555 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] config_source = [] {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.601684 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] debug = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.601959 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.604480 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.604480 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.604480 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.604480 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.604480 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] list_limit = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.604480 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] log_config_append = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.604480 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.604480 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] log_dir = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.604480 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] log_file = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.605448 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.605448 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.605448 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.605448 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.605448 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.605448 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.605448 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.606163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.606163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.606163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.606163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.609491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.609491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.609491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.609491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.609491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.609491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] publish_errors = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.609491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.609491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.609491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.612531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.612531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.612531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] standard_threads = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.612531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.612531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.612531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.612531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] use_journal = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.612531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] use_json = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.612531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] use_stderr = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.614877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] use_syslog = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.614877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:43.614877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.614877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.614877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.614877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.614877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.614877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.614877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.618129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.618129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.618129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.618129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.618129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.618129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.618129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.618129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.618129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.620042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.620042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.620042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.620042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.620042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.620042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.620042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.620042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.620042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.621900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.621900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.621900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.621900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.621900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.621900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.621900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.621900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.621900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.623763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.623763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.623763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.623763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.623763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.623763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.623763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.623763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.623763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.625659 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.625659 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.625659 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.625659 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.625659 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.625659 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.625659 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.625659 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.625659 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.627356 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.627356 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.627356 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.627356 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.627356 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.627356 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.627356 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.627356 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.627356 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.629224 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.629224 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.629224 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.629224 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.629224 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.629224 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.629224 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.629224 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.629224 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.632144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.632144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.632144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.632144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.632144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.632144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.632144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.632144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.632144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.634000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.634000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.634000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.634000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.634000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.634000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.634000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.634000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.634000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.635841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.635841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.635841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.635841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.635841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.635841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.635841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.635841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.635841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.637713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.637713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.637713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.637713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.637713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.637713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.637713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.637713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] auth.external = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.637713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.639580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.639580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.639580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] auth.password = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.639580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] auth.token = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.639580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.639580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.639580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.639580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.639580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.641806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.641806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.641806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] credential.caching = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.641806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.641806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.641806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.641806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.641806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.641806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.643577 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.643577 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.643577 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.643577 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.643577 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.643577 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.643577 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.643577 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.643577 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.645443 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] federation.caching = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.645443 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.645443 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.645443 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.645443 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.645443 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.645443 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.645443 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.645443 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.648334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.648334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.648334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.648334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] identity.caching = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.648334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.648334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.648334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.648334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.648334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.653994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.653994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.653994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.653994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.653994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.653994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.653994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.653994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.653994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.656752 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.656752 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.656752 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.656752 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.656752 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.656752 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.656752 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.656752 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.656752 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.658841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.658841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.658841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.658841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.658841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.658841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.658841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.658841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.658841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.660646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.660646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.660646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.660646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.660646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.660646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.660646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.660646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.660646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.663970 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.663970 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.663970 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.663970 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.663970 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.663970 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.663970 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.663970 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.663970 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.665941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.user = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.665941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.665941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.665941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.665941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.665941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.665941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.665941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.665941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.667783 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.667783 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.667783 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.667783 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.667783 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.667783 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.667783 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.667783 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.667783 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.669636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.669636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.669636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.669636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.669636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.669636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.669636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.669636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.669636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.671502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.671502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.671502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.671502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.671502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.671502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.671502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.671502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.671502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.673343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.673343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] resource.caching = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.673343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.673343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.673343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.673343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.673343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.673343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.673343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.675143 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.675143 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.675143 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] role.caching = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.675143 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] role.driver = sql {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.675143 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.675143 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.675143 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.675143 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.675143 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.677059 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.677059 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.677059 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.677059 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.677059 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.677059 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.677059 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.677059 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.677059 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.679966 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.679966 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.679966 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.679966 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.679966 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.679966 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.679966 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.679966 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.679966 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.681838 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.681838 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.681838 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.681838 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.681838 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.681838 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.681838 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.681838 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.681838 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.683625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.683625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] token.caching = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.683625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.683625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.683625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.683625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.683625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.683625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.683625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.685461 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.685461 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.685461 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.685461 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.685461 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.685461 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.685461 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.685461 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.685461 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.687226 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.687226 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] database.connection = **** {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.687226 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.687226 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.687226 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.687226 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.687226 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.687226 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.687226 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.689093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.689093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.689093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.689093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.689093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.689093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.689093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.689093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.689093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.691255 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.691255 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:43.691255 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 20:09:43.723336 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:43.723674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:43.724030 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:43.738345 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:43.784440 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:43.784825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:43.856284 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:43.911963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:43.912379 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:43.984200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:43.984629 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:43.984629 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:43.985024 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:43.985024 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:43.985443 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:44.010500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:44.010868 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:44.011106 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:44.011106 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:44.011498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:44.011713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:44.011713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:44.024579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:44.040723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:44.041116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:44.041339 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:44.041339 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:44.041802 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:44.041802 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:44.042231 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:44.061806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.062254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 20:09:44.062502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.062502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 20:09:44.062934 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.063178 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.063397 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.063633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.075840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.076266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.076501 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.076729 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.085253 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:44.088881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:44.089176 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.089486 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.089875 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.090309 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.090573 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.090847 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.091139 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.091409 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.091696 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.091963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.121770 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.123411 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:44.123834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.129792 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:44.130085 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.130354 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.139574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:44.139866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.145280 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:44.145574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.145987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.146274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.146604 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.146880 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.147147 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.147606 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.168051 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.168412 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.172940 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:44.176604 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.176900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.182603 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:44.186211 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:44.189969 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.190270 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.190548 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.190825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.191096 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.191369 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.212137 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:44.212560 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.212834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.213088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.221103 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.222873 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.223143 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.226772 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:44.227123 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.227402 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.227810 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.228099 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.243477 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:44.243918 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.244399 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.244918 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.245389 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.245791 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.246208 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.266039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:44.269470 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:44.273827 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.275482 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.277211 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:44.277494 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.277909 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.285675 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.288388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:44.291605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.292044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.292342 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.292617 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.302315 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:44.303139 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.303496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.312262 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:44.312572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.312830 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.313103 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.313372 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.313659 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.313926 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.314197 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.314470 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.314735 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.314999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.315278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.315537 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.315798 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:44.356493 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55a46b04c9c0 pid: 79934 (default app) May 16 20:09:44.360198 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c432b7a-f37a-494c-bdc2-47cb09468290 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:09:44.360496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c432b7a-f37a-494c-bdc2-47cb09468290 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:09:44.360781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c432b7a-f37a-494c-bdc2-47cb09468290 None None] PATH_INFO: `/v3` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:09:44.367414 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1/1] 10.222.0.71 () {50 vars in 791 bytes} [Mon May 16 20:09:44 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:09:45.089539 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 20:09:45.089539 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: from cryptography.utils import int_from_bytes May 16 20:09:45.090536 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 20:09:45.090536 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: from cryptography.utils import int_from_bytes May 16 20:09:45.175597 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 20:09:45.176019 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 20:09:45.176309 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] command line args: [] {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 20:09:45.176796 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 20:09:45.177114 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ================================================================================ {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 20:09:45.178571 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] admin_token = **** {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.179161 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] config_dir = [] {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.179466 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.179756 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] config_source = [] {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.180043 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] debug = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.180414 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.180806 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.181089 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.181523 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.181924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.182301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] list_limit = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.182589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] log_config_append = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.182869 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.183157 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] log_dir = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.183442 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] log_file = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.183825 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.184256 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.184654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.185048 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.185334 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.185630 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.186036 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.186439 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.186815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.187186 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.187558 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.187934 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.188365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.188772 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.189423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.190258 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.190546 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] publish_errors = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.190922 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.191293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.191585 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.191996 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.192414 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.192796 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] standard_threads = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.193213 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.193619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.193897 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.194182 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] use_journal = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.194472 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] use_json = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.194757 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] use_stderr = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.195047 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] use_syslog = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.195445 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 20:09:45.195870 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.196304 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.196741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.197135 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.197548 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.197950 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.198363 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.198762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.199171 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.199600 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.200018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.200441 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.200855 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.201251 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.208203 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.208203 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.208203 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.208203 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.208203 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.208203 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.208203 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.208203 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.208203 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.210359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.210359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.210359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.210359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.210359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.210359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.210359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.210359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.210359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.213345 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.213345 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.213345 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.213345 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.213345 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.213345 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.213345 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.213345 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.213345 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.215066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.215066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.215066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.215066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.215066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.215066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.215066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.215066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.215066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.216849 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.216849 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.216849 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.216849 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.216849 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.216849 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.216849 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.218185 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.218185 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.218185 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.218185 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.218751 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.218922 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.219367 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.219789 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.220245 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.220623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.220872 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.221209 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.221544 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.221834 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.222142 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.222577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.222870 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.223157 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.223379 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.223599 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.223930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.224266 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.225103 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.225347 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.225617 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.225860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.226137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.226443 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.226675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.226923 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.227204 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.227479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.227720 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.227941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.228241 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.228463 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.235654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.235654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.235654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.235654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.235654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.235654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.235654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.235654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.235654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.238657 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.238657 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.238657 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] auth.external = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.238657 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.238657 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.238657 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.238657 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] auth.password = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.238657 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] auth.token = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.238657 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.241230 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.241230 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.241230 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.241230 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.241230 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.241230 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.241230 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] credential.caching = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.241230 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.241230 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.243260 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.243260 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.243260 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.243260 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.243260 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.243260 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.243260 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.243260 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.243260 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.245052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.245052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.245052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.245052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.245052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] federation.caching = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.246002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.246002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.246412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.246728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.247208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.247675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.248229 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.248607 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.249081 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.249534 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.250037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.250545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] identity.caching = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.250955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.251432 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.251866 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.252308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.252784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.253226 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.253673 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.254112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.254449 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.254989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.255319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.256104 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.256602 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.256831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.257159 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.257691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.258298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.258647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.259105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.259557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.259964 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.260458 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.260976 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.261347 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.261999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.262272 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.262752 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.263175 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.263662 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.264128 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.264623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.265095 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.265813 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.266251 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.266706 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.267118 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.267642 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.268085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.268416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.268689 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.269115 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.269562 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.270030 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.270457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.270908 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.271405 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.271885 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.272365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.272850 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.273237 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.273646 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.user = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.274107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.274596 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.275024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.275502 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.275961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.276380 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.276836 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.277273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.277726 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.278172 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.278624 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.279068 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.279540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.279837 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.280320 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.280792 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.281241 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.281640 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.282079 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.282518 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.282965 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.283405 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.283850 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.284350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.284820 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.285267 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.285724 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.286162 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.286623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.287836 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.288490 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.288490 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.289185 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.289651 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.290096 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.290564 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.291027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] resource.caching = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.291491 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.291972 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.292456 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.292921 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.293388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.293838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.294317 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.294782 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.295228 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.295675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] role.caching = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.296143 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] role.driver = sql {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.296609 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.297091 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.297564 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.298004 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.298470 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.298931 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.299406 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.299872 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.300389 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.300836 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.301313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.301799 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.302262 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.303956 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.304793 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.305236 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.305706 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.306184 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.306673 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.307151 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.307524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.307814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.308123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.308620 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.309062 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.309504 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.309924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.310374 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.310784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.311022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.311246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.311516 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.311833 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.312071 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] token.caching = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.312415 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.312783 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.313037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.313387 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.313820 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.314232 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.314561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.315008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.315461 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.315742 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.316104 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.316559 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.316816 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.317160 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.317476 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.317844 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.318905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.319140 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] database.connection = **** {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.319464 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.319802 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.320200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.320424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.320642 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.320859 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.321111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.321489 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.321807 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.322252 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.322702 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.323078 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.323344 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.323658 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.323992 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.324279 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.324575 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.324795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 20:09:45.325014 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 20:09:45.373421 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.373786 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.374049 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.392785 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.422471 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.422836 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.494884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.567457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.567890 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.654715 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.654715 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.655557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.655557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.656010 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.656288 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.686552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.687095 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.687342 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.687694 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.688076 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.688482 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.688882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.706025 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.712187 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.712602 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.713010 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.713444 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.713774 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.714145 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.714526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79935) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 20:09:45.735971 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.736442 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 20:09:45.737000 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.737347 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 20:09:45.737837 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.738289 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.738755 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.739224 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.762044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.762565 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.763079 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.763485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.781751 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:45.789728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:45.790234 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.790720 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.791195 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.791685 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.792383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.792848 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.793336 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.793851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.794340 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.794836 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.850218 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.853491 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:45.853977 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.864525 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:45.865013 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.866015 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.880489 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:45.881561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.891006 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:45.891473 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.891950 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.892460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.892921 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.893398 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.893886 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.894372 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.934066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.934479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.943992 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:45.951586 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.952129 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.962582 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:45.969965 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:45.978044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.978554 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.979047 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.979540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.980027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:45.980558 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.020534 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:46.021207 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.022234 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.022714 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.039005 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.042113 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.042491 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.045594 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:46.045918 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.046162 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.046423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.046661 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.061187 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:46.061547 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.061741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.062179 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.062418 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.062678 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.062908 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.083407 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:46.087317 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:46.090948 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.092637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.094326 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:46.094679 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.094995 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.103123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.104840 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:46.108217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.108564 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.108807 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.109089 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.119086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:46.119497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.119743 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.127815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79935) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 20:09:46.128287 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.128561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.128798 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.129030 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.129265 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.129499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.129742 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.129984 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.130217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.130446 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.130827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.131062 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.131307 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79935) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 20:09:46.170813 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: WSGI app 0 (mountpoint='') ready in 9 seconds on interpreter 0x55a46b04c9c0 pid: 79935 (default app) May 16 20:09:53.168070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb81b7e-139f-425a-ac63-8d99e2b30dbf None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:09:53.168641 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb81b7e-139f-425a-ac63-8d99e2b30dbf None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:09:53.168641 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb81b7e-139f-425a-ac63-8d99e2b30dbf None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:09:53.169994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 2/2] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:09:53.178204 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d573c55-2f23-4831-bd46-d34ca3749dd0 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:09:53.178772 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d573c55-2f23-4831-bd46-d34ca3749dd0 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:09:53.178772 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d573c55-2f23-4831-bd46-d34ca3749dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:09:53.212983 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG oslo_db.sqlalchemy.engines [None req-8d573c55-2f23-4831-bd46-d34ca3749dd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79935) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 20:09:53.402233 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG passlib.handlers.bcrypt [None req-8d573c55-2f23-4831-bd46-d34ca3749dd0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79935) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 16 20:09:53.402645 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG passlib.handlers.bcrypt [None req-8d573c55-2f23-4831-bd46-d34ca3749dd0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79935) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 16 20:09:53.459350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-8d573c55-2f23-4831-bd46-d34ca3749dd0 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:09:53.460931 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8d573c55-2f23-4831-bd46-d34ca3749dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:09:53.611263 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1/3] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:09:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 16 20:09:53.797169 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb81b7e-139f-425a-ac63-8d99e2b30dbf None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:09:53.834179 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG oslo_db.sqlalchemy.engines [None req-6bb81b7e-139f-425a-ac63-8d99e2b30dbf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79934) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 20:09:53.972807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb81b7e-139f-425a-ac63-8d99e2b30dbf None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:09:53.977963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4b78a-f464-411b-998c-34824fc6892c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:09:53.978635 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4b78a-f464-411b-998c-34824fc6892c admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:09:53.978918 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4b78a-f464-411b-998c-34824fc6892c admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:09:53.979190 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4b78a-f464-411b-998c-34824fc6892c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:09:53.988178 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4b78a-f464-411b-998c-34824fc6892c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:09:54.043994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d3f4b78a-f464-411b-998c-34824fc6892c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 16 20:09:54.044361 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4b78a-f464-411b-998c-34824fc6892c admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:09:54.056733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 3/4] 10.222.0.71 () {58 vars in 1324 bytes} [Mon May 16 20:09:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:09:54.066588 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d573c55-2f23-4831-bd46-d34ca3749dd0 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:09:54.093140 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d573c55-2f23-4831-bd46-d34ca3749dd0 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:09:54.101465 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803adfe-a17c-4ccb-b97e-4575dc403bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:09:54.103525 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803adfe-a17c-4ccb-b97e-4575dc403bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:09:54.104031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803adfe-a17c-4ccb-b97e-4575dc403bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:09:54.104570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803adfe-a17c-4ccb-b97e-4575dc403bc9 admin admin] PATH_INFO: `/v3/projects/8a002d9ef0e2477e8031bd7bef5cfc65` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:09:54.107723 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803adfe-a17c-4ccb-b97e-4575dc403bc9 admin admin] RBAC: Authorizing `identity:get_project(project_id=8a002d9ef0e2477e8031bd7bef5cfc65)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:09:54.166439 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9803adfe-a17c-4ccb-b97e-4575dc403bc9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 16 20:09:54.166873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803adfe-a17c-4ccb-b97e-4575dc403bc9 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:09:54.171784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 2/5] 10.222.0.71 () {56 vars in 1207 bytes} [Mon May 16 20:09:54 2022] GET /identity/v3/projects/8a002d9ef0e2477e8031bd7bef5cfc65 => generated 344 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:09:56.586611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d400519-2ce8-4834-9224-731cbe3432db None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:09:56.587176 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d400519-2ce8-4834-9224-731cbe3432db None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:09:56.587176 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d400519-2ce8-4834-9224-731cbe3432db None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:09:56.591522 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 4/6] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:09:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:09:56.599716 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b605ae-c6a2-46de-a892-a4fece7fe6ff None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:09:56.600313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b605ae-c6a2-46de-a892-a4fece7fe6ff None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:09:56.600729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b605ae-c6a2-46de-a892-a4fece7fe6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:09:56.643657 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-67b605ae-c6a2-46de-a892-a4fece7fe6ff None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:09:56.645293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-67b605ae-c6a2-46de-a892-a4fece7fe6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:09:56.654621 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 3/7] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:09:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 16 20:09:56.679228 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d400519-2ce8-4834-9224-731cbe3432db None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:09:56.700856 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d400519-2ce8-4834-9224-731cbe3432db None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:09:56.707891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185efca4-b605-4dca-9e7f-578a9e21b42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:09:56.709666 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185efca4-b605-4dca-9e7f-578a9e21b42c admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:09:56.710168 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185efca4-b605-4dca-9e7f-578a9e21b42c admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:09:56.710657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185efca4-b605-4dca-9e7f-578a9e21b42c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:09:56.726645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185efca4-b605-4dca-9e7f-578a9e21b42c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:09:56.730099 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185efca4-b605-4dca-9e7f-578a9e21b42c admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:09:56.742954 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 5/8] 10.222.0.71 () {58 vars in 1324 bytes} [Mon May 16 20:09:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:09:56.749570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b605ae-c6a2-46de-a892-a4fece7fe6ff None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:09:56.760521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b605ae-c6a2-46de-a892-a4fece7fe6ff None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:09:56.765905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1f5ef-e4fb-49dd-bb89-ef10bd50f43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:09:56.766956 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1f5ef-e4fb-49dd-bb89-ef10bd50f43c admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:09:56.767325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1f5ef-e4fb-49dd-bb89-ef10bd50f43c admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:09:56.767686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1f5ef-e4fb-49dd-bb89-ef10bd50f43c admin admin] PATH_INFO: `/v3/users/287e51b57d25435ca49c14e1a5f9c328` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:09:56.769636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1f5ef-e4fb-49dd-bb89-ef10bd50f43c admin admin] RBAC: Authorizing `identity:get_user(user_id=287e51b57d25435ca49c14e1a5f9c328)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:09:56.772366 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1f5ef-e4fb-49dd-bb89-ef10bd50f43c admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:09:56.774380 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 4/9] 10.222.0.71 () {56 vars in 1198 bytes} [Mon May 16 20:09:56 2022] GET /identity/v3/users/287e51b57d25435ca49c14e1a5f9c328 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:00.076801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a33fb-681d-46a4-be7c-8546d1e0409d None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:00.077610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a33fb-681d-46a4-be7c-8546d1e0409d None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:00.077610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a33fb-681d-46a4-be7c-8546d1e0409d None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:00.078689 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 6/10] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:00.084609 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb247f47-2fe7-4cd7-bb8c-e7a46c710f0a None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:00.085394 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb247f47-2fe7-4cd7-bb8c-e7a46c710f0a None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:00.085394 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb247f47-2fe7-4cd7-bb8c-e7a46c710f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:00.103257 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-fb247f47-2fe7-4cd7-bb8c-e7a46c710f0a None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:00.104501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-fb247f47-2fe7-4cd7-bb8c-e7a46c710f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:00.199022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 5/11] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:10:00.223041 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a33fb-681d-46a4-be7c-8546d1e0409d None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:00.409345 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a33fb-681d-46a4-be7c-8546d1e0409d None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:00.446008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc205028-0de8-4c0b-8a94-c4f8219d6da1 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:00.446621 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc205028-0de8-4c0b-8a94-c4f8219d6da1 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:00.447163 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc205028-0de8-4c0b-8a94-c4f8219d6da1 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:00.449985 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 6/12] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:00.455681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5e1c4-a467-4b9f-806f-524794dbed62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:00.457062 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5e1c4-a467-4b9f-806f-524794dbed62 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:00.457062 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5e1c4-a467-4b9f-806f-524794dbed62 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:00.457229 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5e1c4-a467-4b9f-806f-524794dbed62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:00.460391 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35401b-7b27-45e8-9b96-37cbad1f4eaf None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:00.460874 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35401b-7b27-45e8-9b96-37cbad1f4eaf None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:00.461380 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35401b-7b27-45e8-9b96-37cbad1f4eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:00.470390 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5e1c4-a467-4b9f-806f-524794dbed62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:00.482004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-11b5e1c4-a467-4b9f-806f-524794dbed62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:10:00.482004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:00.482004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:00.482004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:00.482004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:00.482004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:00.482004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:00.482004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:00.482004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:00.482004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:00.482004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:00.482004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:00.482004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:00.482004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:00.482004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:00.482004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:00.483023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:00.483023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:00.483023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:00.483023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:00.483023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:00.483023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:00.483023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:00.483023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:00.483023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:00.483023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:00.483023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:00.483023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:10:00.483023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:00.483023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:00.483023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:00.483023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:00.483778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:00.483778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:00.483778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:00.483778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:00.483778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:00.483778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:00.483778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:00.483778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:00.483778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:00.483778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:00.483778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:10:00.483778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:10:00.483778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 7/13] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:10:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:10:00.490443 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-2c35401b-7b27-45e8-9b96-37cbad1f4eaf None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:00.491102 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5e1c4-a467-4b9f-806f-524794dbed62 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:00.492852 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-2c35401b-7b27-45e8-9b96-37cbad1f4eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:00.590076 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 7/14] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:10:00.619443 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5e1c4-a467-4b9f-806f-524794dbed62 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:00.630765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35401b-7b27-45e8-9b96-37cbad1f4eaf None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:00.663663 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1069625-4d59-4b57-ae93-c3d09acf06f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:00.664397 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1069625-4d59-4b57-ae93-c3d09acf06f5 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:00.664757 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1069625-4d59-4b57-ae93-c3d09acf06f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:00.665090 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1069625-4d59-4b57-ae93-c3d09acf06f5 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:00.665962 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1069625-4d59-4b57-ae93-c3d09acf06f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:00.666407 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1069625-4d59-4b57-ae93-c3d09acf06f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:00.667994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1069625-4d59-4b57-ae93-c3d09acf06f5 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:00.687450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 8/15] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:00.693844 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1069625-4d59-4b57-ae93-c3d09acf06f5 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:00.757216 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35401b-7b27-45e8-9b96-37cbad1f4eaf None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:00.796412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc613e-113a-48f1-88ef-c1074f3d99ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:00.797074 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc613e-113a-48f1-88ef-c1074f3d99ac None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:00.797357 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc613e-113a-48f1-88ef-c1074f3d99ac None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:00.797668 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc613e-113a-48f1-88ef-c1074f3d99ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:00.800582 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1069625-4d59-4b57-ae93-c3d09acf06f5 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:00.841107 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6dbe2-8478-4e1c-8f35-83673b396d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:00.842031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6dbe2-8478-4e1c-8f35-83673b396d5c None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:00.842327 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6dbe2-8478-4e1c-8f35-83673b396d5c None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:00.842580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6dbe2-8478-4e1c-8f35-83673b396d5c None admin] PATH_INFO: `/v3/users/287e51b57d25435ca49c14e1a5f9c328` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:00.844404 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6dbe2-8478-4e1c-8f35-83673b396d5c None admin] RBAC: Authorizing `identity:get_user(user_id=287e51b57d25435ca49c14e1a5f9c328)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:00.845895 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6dbe2-8478-4e1c-8f35-83673b396d5c None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:00.847618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 9/16] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:00 2022] GET /identity/v3/users/287e51b57d25435ca49c14e1a5f9c328 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:00.854065 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6dbe2-8478-4e1c-8f35-83673b396d5c None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:00.878442 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc613e-113a-48f1-88ef-c1074f3d99ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:00.879962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc613e-113a-48f1-88ef-c1074f3d99ac None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:00.973627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6dbe2-8478-4e1c-8f35-83673b396d5c None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:01.006516 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 8/17] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:10:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 20:10:01.014741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc613e-113a-48f1-88ef-c1074f3d99ac None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:01.024076 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687a3c7-81a9-4878-a88d-a85eff13d04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:01.024934 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687a3c7-81a9-4878-a88d-a85eff13d04d None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:01.025220 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687a3c7-81a9-4878-a88d-a85eff13d04d None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:01.025499 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687a3c7-81a9-4878-a88d-a85eff13d04d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:01.026870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687a3c7-81a9-4878-a88d-a85eff13d04d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:01.028369 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687a3c7-81a9-4878-a88d-a85eff13d04d None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:01.030057 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 10/18] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:10:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:01.035876 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687a3c7-81a9-4878-a88d-a85eff13d04d None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:01.134496 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc613e-113a-48f1-88ef-c1074f3d99ac None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:01.178042 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4074239-854e-4973-9825-a9392630cdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:01.179812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4074239-854e-4973-9825-a9392630cdd3 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:01.180228 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4074239-854e-4973-9825-a9392630cdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:01.180558 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4074239-854e-4973-9825-a9392630cdd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:01.198208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4074239-854e-4973-9825-a9392630cdd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:01.200876 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4074239-854e-4973-9825-a9392630cdd3 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:01.233419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-b4074239-854e-4973-9825-a9392630cdd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:10:01.233419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:01.233419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:01.233419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:01.233419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:01.233419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:01.233419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:01.233419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:01.233419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:01.233419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:01.233419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:01.233419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:01.233419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:10:01.233419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:10:01.233419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:10:01.234969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:10:01.234969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:01.234969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:01.234969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:01.234969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:01.234969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:01.234969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:01.234969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:01.234969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:10:01.234969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:01.234969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:01.234969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:01.234969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:01.234969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:01.234969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:01.234969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:01.234969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:01.236196 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:10:01.236196 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:10:01.236196 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:10:01.236196 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:10:01.236196 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 9/19] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:10:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:01.245847 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4074239-854e-4973-9825-a9392630cdd3 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:01.303603 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687a3c7-81a9-4878-a88d-a85eff13d04d None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:01.348617 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be9c35-696d-4c06-bc33-feed61f83f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:01.350695 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be9c35-696d-4c06-bc33-feed61f83f26 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:01.350695 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be9c35-696d-4c06-bc33-feed61f83f26 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:01.350695 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be9c35-696d-4c06-bc33-feed61f83f26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:01.351660 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be9c35-696d-4c06-bc33-feed61f83f26 None admin] RBAC: Adding query filter params (role.id=6576d9225a0946de877f527e3d15db05, scope.domain.id=default, user.id=287e51b57d25435ca49c14e1a5f9c328) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:01.352065 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be9c35-696d-4c06-bc33-feed61f83f26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:01.354001 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be9c35-696d-4c06-bc33-feed61f83f26 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:01.364701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 11/20] 10.222.0.71 () {56 vars in 1322 bytes} [Mon May 16 20:10:01 2022] GET /identity/v3/role_assignments?user.id=287e51b57d25435ca49c14e1a5f9c328&scope.domain.id=default&role.id=6576d9225a0946de877f527e3d15db05 => generated 233 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:01.390141 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4074239-854e-4973-9825-a9392630cdd3 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:01.455977 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27914a71-83d5-43bf-8d2e-fe22c33d15cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:01.456945 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27914a71-83d5-43bf-8d2e-fe22c33d15cc None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:01.457441 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27914a71-83d5-43bf-8d2e-fe22c33d15cc None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:01.457925 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27914a71-83d5-43bf-8d2e-fe22c33d15cc None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:01.459437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27914a71-83d5-43bf-8d2e-fe22c33d15cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:01.459959 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27914a71-83d5-43bf-8d2e-fe22c33d15cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:01.461587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27914a71-83d5-43bf-8d2e-fe22c33d15cc None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:01.497802 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 10/21] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:04.948795 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fd38a-b583-4da1-8b56-8291567cc2f5 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:04.949941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fd38a-b583-4da1-8b56-8291567cc2f5 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:04.950436 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fd38a-b583-4da1-8b56-8291567cc2f5 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:04.952605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 12/22] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:04.959486 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef9122-3e72-4669-871f-fadf12d54712 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:04.960735 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef9122-3e72-4669-871f-fadf12d54712 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:04.961231 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef9122-3e72-4669-871f-fadf12d54712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:04.981224 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-1fef9122-3e72-4669-871f-fadf12d54712 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:04.982800 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-1fef9122-3e72-4669-871f-fadf12d54712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:05.063935 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 11/23] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:10:05.100922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fd38a-b583-4da1-8b56-8291567cc2f5 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:05.223151 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fd38a-b583-4da1-8b56-8291567cc2f5 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:05.263318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebb623-630d-4350-86e8-cfd6f175e375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:05.264128 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebb623-630d-4350-86e8-cfd6f175e375 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:05.264514 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebb623-630d-4350-86e8-cfd6f175e375 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:05.264791 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebb623-630d-4350-86e8-cfd6f175e375 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:05.288067 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebb623-630d-4350-86e8-cfd6f175e375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:05.289841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebb623-630d-4350-86e8-cfd6f175e375 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:05.310608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-5bebb623-630d-4350-86e8-cfd6f175e375 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:10:05.310608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:05.310608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:05.310608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:05.310608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:05.310608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:05.310608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:05.310608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:05.310608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:05.310608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:05.310608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:05.310608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:05.310608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:10:05.310608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:10:05.310608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:10:05.311503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:10:05.311503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:05.311503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:05.311503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:05.311503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:05.311503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:05.311503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:05.311503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:05.311503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:10:05.311503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:05.311503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:05.311503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:05.311503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:05.311503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:05.311503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:05.311503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:05.311503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:05.312333 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:10:05.312333 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:10:05.312333 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:10:05.312333 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:10:05.314800 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 13/24] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:10:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:05.321961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef9122-3e72-4669-871f-fadf12d54712 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:05.432334 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef9122-3e72-4669-871f-fadf12d54712 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:05.471878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e5e2c-7b84-45af-b7f9-ff72f496491f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:05.474473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839fb60-ce8a-4662-b942-dfe25b2d623a None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:05.474990 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839fb60-ce8a-4662-b942-dfe25b2d623a None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:05.475460 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839fb60-ce8a-4662-b942-dfe25b2d623a None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:05.477129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 14/25] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:10:05.477761 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e5e2c-7b84-45af-b7f9-ff72f496491f None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:05.478224 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e5e2c-7b84-45af-b7f9-ff72f496491f None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:05.478678 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e5e2c-7b84-45af-b7f9-ff72f496491f None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:05.479678 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e5e2c-7b84-45af-b7f9-ff72f496491f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:05.480198 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e5e2c-7b84-45af-b7f9-ff72f496491f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:05.481866 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e5e2c-7b84-45af-b7f9-ff72f496491f None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:05.483490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2ce54-c4fa-4bd4-bfd7-e07fa0a609fa None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:05.483956 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2ce54-c4fa-4bd4-bfd7-e07fa0a609fa None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:05.484444 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2ce54-c4fa-4bd4-bfd7-e07fa0a609fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:05.509669 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG passlib.handlers.bcrypt [None req-ccf2ce54-c4fa-4bd4-bfd7-e07fa0a609fa None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79934) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 16 20:10:05.516105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 12/26] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:05.520375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG passlib.handlers.bcrypt [None req-ccf2ce54-c4fa-4bd4-bfd7-e07fa0a609fa None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79934) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 16 20:10:05.522813 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e5e2c-7b84-45af-b7f9-ff72f496491f None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:05.610368 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-ccf2ce54-c4fa-4bd4-bfd7-e07fa0a609fa None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:05.613647 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-ccf2ce54-c4fa-4bd4-bfd7-e07fa0a609fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:05.761310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e5e2c-7b84-45af-b7f9-ff72f496491f None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:05.802129 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b34182-89fc-4451-8bab-e15999674f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:05.803042 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b34182-89fc-4451-8bab-e15999674f64 None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:05.803493 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b34182-89fc-4451-8bab-e15999674f64 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:05.803900 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b34182-89fc-4451-8bab-e15999674f64 None admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:05.804795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b34182-89fc-4451-8bab-e15999674f64 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:05.806437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b34182-89fc-4451-8bab-e15999674f64 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:05.950473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 15/27] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:10:05.953280 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573f565-b6f9-4362-b45a-0cabdf57b89d None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:05.953780 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573f565-b6f9-4362-b45a-0cabdf57b89d None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:05.954256 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573f565-b6f9-4362-b45a-0cabdf57b89d None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:05.957288 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 16/28] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:05.964339 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269417a-25c7-4506-8948-be004c4b4201 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:05.964802 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269417a-25c7-4506-8948-be004c4b4201 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:05.965276 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269417a-25c7-4506-8948-be004c4b4201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:05.997241 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-b269417a-25c7-4506-8948-be004c4b4201 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:05.998491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-b269417a-25c7-4506-8948-be004c4b4201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:06.014055 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 13/29] 10.222.0.71 () {60 vars in 1141 bytes} [Mon May 16 20:10:05 2022] POST /identity/v3/projects => generated 301 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:10:06.022567 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898b86a-b36a-48d9-b468-dd6bb7103829 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:06.023647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898b86a-b36a-48d9-b468-dd6bb7103829 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:06.024464 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898b86a-b36a-48d9-b468-dd6bb7103829 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:06.032823 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 14/30] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:06 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:06.034889 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898b86a-b36a-48d9-b468-dd6bb7103829 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:06.108828 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 17/31] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:10:06.110411 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708a88a-1c3a-4815-9b52-6f4b07ed1606 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:06.110727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708a88a-1c3a-4815-9b52-6f4b07ed1606 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:06.111161 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708a88a-1c3a-4815-9b52-6f4b07ed1606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:06.141862 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-b708a88a-1c3a-4815-9b52-6f4b07ed1606 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:06.143114 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-b708a88a-1c3a-4815-9b52-6f4b07ed1606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:06.253884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898b86a-b36a-48d9-b468-dd6bb7103829 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:06.324718 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d01682-8afb-4f37-b3cb-ed381a5ac46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:06.326303 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d01682-8afb-4f37-b3cb-ed381a5ac46d None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:06.326931 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d01682-8afb-4f37-b3cb-ed381a5ac46d None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:06.327552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d01682-8afb-4f37-b3cb-ed381a5ac46d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:06.351871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d01682-8afb-4f37-b3cb-ed381a5ac46d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:06.352881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 18/32] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:06.354347 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708a88a-1c3a-4815-9b52-6f4b07ed1606 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:06.370190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-04d01682-8afb-4f37-b3cb-ed381a5ac46d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:10:06.370190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:06.370190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:06.370190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:06.370190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:06.370190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:06.370190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:06.370190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:06.370190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:06.370190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:06.370190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:06.370190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:06.370190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:06.370190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:06.370190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:06.370190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:06.371845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:06.371845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:06.371845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:06.371845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:06.371845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:06.371845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:06.371845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:06.371845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:06.371845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:06.371845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:06.371845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:06.371845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:10:06.371845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:06.371845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:06.371845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:06.371845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:06.373388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:06.373388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:06.373388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:06.373388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:06.373388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:06.373388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:06.373388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:06.373388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:06.373388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:06.373388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:06.373388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:10:06.373388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:10:06.377909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 15/33] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:10:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:06.386751 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d01682-8afb-4f37-b3cb-ed381a5ac46d None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:06.558295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d01682-8afb-4f37-b3cb-ed381a5ac46d None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:06.565906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708a88a-1c3a-4815-9b52-6f4b07ed1606 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:06.603310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b60d7f-1978-4a62-95be-1f542edaacf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:06.604259 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b60d7f-1978-4a62-95be-1f542edaacf0 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:06.604721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b60d7f-1978-4a62-95be-1f542edaacf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:06.605164 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b60d7f-1978-4a62-95be-1f542edaacf0 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:06.606205 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b60d7f-1978-4a62-95be-1f542edaacf0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:06.606748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b60d7f-1978-4a62-95be-1f542edaacf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:06.609249 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b60d7f-1978-4a62-95be-1f542edaacf0 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:06.626771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 16/34] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:06.628029 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b60d7f-1978-4a62-95be-1f542edaacf0 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:06.632920 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7452558-54c5-4f24-ab99-9380452d9c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:06.634430 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7452558-54c5-4f24-ab99-9380452d9c00 None admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:06.635126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7452558-54c5-4f24-ab99-9380452d9c00 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:06.635847 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7452558-54c5-4f24-ab99-9380452d9c00 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:06.637394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7452558-54c5-4f24-ab99-9380452d9c00 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:06.640955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7452558-54c5-4f24-ab99-9380452d9c00 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:06.805929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 19/35] 10.222.0.71 () {60 vars in 1131 bytes} [Mon May 16 20:10:06 2022] POST /identity/v3/roles => generated 225 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:10:06.806757 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7452558-54c5-4f24-ab99-9380452d9c00 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:06.820392 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b60d7f-1978-4a62-95be-1f542edaacf0 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:06.904429 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffb0b5-f0bc-4dcf-9615-97f1a3416dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:06.906144 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffb0b5-f0bc-4dcf-9615-97f1a3416dbf None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:06.906975 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffb0b5-f0bc-4dcf-9615-97f1a3416dbf None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:06.907761 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffb0b5-f0bc-4dcf-9615-97f1a3416dbf None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:06.910436 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abffb0b5-f0bc-4dcf-9615-97f1a3416dbf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:06.913907 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abffb0b5-f0bc-4dcf-9615-97f1a3416dbf None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:06.945371 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 17/36] 10.222.0.71 () {60 vars in 1131 bytes} [Mon May 16 20:10:06 2022] POST /identity/v3/roles => generated 219 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:10:06.969484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd12d3c-ebd6-440d-ad3b-2b664f13c9fe None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:06.969877 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd12d3c-ebd6-440d-ad3b-2b664f13c9fe None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:06.970107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd12d3c-ebd6-440d-ad3b-2b664f13c9fe None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:06.971504 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 18/37] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:10:06.977575 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8275de-49b7-4105-afdf-521dc20a1de7 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:06.977862 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8275de-49b7-4105-afdf-521dc20a1de7 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:06.978154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8275de-49b7-4105-afdf-521dc20a1de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:06.997781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-ab8275de-49b7-4105-afdf-521dc20a1de7 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:06.999503 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-ab8275de-49b7-4105-afdf-521dc20a1de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:07.030260 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7452558-54c5-4f24-ab99-9380452d9c00 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:07.078720 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b90041-adb3-461b-a9c5-59e9cad45f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:07.080782 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b90041-adb3-461b-a9c5-59e9cad45f87 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:07.081143 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b90041-adb3-461b-a9c5-59e9cad45f87 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:07.081415 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b90041-adb3-461b-a9c5-59e9cad45f87 None admin] PATH_INFO: `/v3/users/287e51b57d25435ca49c14e1a5f9c328` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:07.087537 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b90041-adb3-461b-a9c5-59e9cad45f87 None admin] RBAC: Authorizing `identity:get_user(user_id=287e51b57d25435ca49c14e1a5f9c328)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:07.090531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b90041-adb3-461b-a9c5-59e9cad45f87 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:07.101386 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 20/38] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:06 2022] GET /identity/v3/users/287e51b57d25435ca49c14e1a5f9c328 => generated 247 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:07.102924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b90041-adb3-461b-a9c5-59e9cad45f87 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:07.117141 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 19/39] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:07.159228 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8275de-49b7-4105-afdf-521dc20a1de7 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:07.262668 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b90041-adb3-461b-a9c5-59e9cad45f87 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:07.303590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9b153-da26-4620-a757-40f6acd904c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:07.304823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9b153-da26-4620-a757-40f6acd904c8 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:07.305341 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9b153-da26-4620-a757-40f6acd904c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:07.305832 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9b153-da26-4620-a757-40f6acd904c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:07.307586 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9b153-da26-4620-a757-40f6acd904c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:07.309435 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9b153-da26-4620-a757-40f6acd904c8 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:07.311494 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 21/40] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:10:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:07.320235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9b153-da26-4620-a757-40f6acd904c8 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:07.330692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8275de-49b7-4105-afdf-521dc20a1de7 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:07.371175 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d579001-0244-4e33-9d44-35fc9e497754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:07.372068 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d579001-0244-4e33-9d44-35fc9e497754 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:07.372393 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d579001-0244-4e33-9d44-35fc9e497754 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:07.372735 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d579001-0244-4e33-9d44-35fc9e497754 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:07.374046 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d579001-0244-4e33-9d44-35fc9e497754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:07.375868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d579001-0244-4e33-9d44-35fc9e497754 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:07.377989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 20/41] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:10:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:07.386002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d579001-0244-4e33-9d44-35fc9e497754 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:07.448407 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9b153-da26-4620-a757-40f6acd904c8 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:07.502056 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74628b03-8818-42d3-bd4f-df82f98acd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:07.503082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74628b03-8818-42d3-bd4f-df82f98acd90 None admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:07.503555 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74628b03-8818-42d3-bd4f-df82f98acd90 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:07.504055 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74628b03-8818-42d3-bd4f-df82f98acd90 None admin] PATH_INFO: `/v3/domains/default/users/287e51b57d25435ca49c14e1a5f9c328/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:07.507505 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74628b03-8818-42d3-bd4f-df82f98acd90 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=287e51b57d25435ca49c14e1a5f9c328, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:07.510364 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74628b03-8818-42d3-bd4f-df82f98acd90 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:07.523914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d579001-0244-4e33-9d44-35fc9e497754 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:07.531459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 22/42] 10.222.0.71 () {58 vars in 1361 bytes} [Mon May 16 20:10:07 2022] PUT /identity/v3/domains/default/users/287e51b57d25435ca49c14e1a5f9c328/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:10:07.533978 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c7623-1196-497d-879d-f1d0d4397b22 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:07.534484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c7623-1196-497d-879d-f1d0d4397b22 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:07.534941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c7623-1196-497d-879d-f1d0d4397b22 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:07.537893 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 23/43] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:07.544020 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1d1c5-9693-4118-8913-ec40d32c5ce2 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:07.544381 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1d1c5-9693-4118-8913-ec40d32c5ce2 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:07.544662 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1d1c5-9693-4118-8913-ec40d32c5ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:07.566292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-0ce1d1c5-9693-4118-8913-ec40d32c5ce2 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:07.569403 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-0ce1d1c5-9693-4118-8913-ec40d32c5ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:07.576212 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f530947-3988-4c08-911f-4adc76849463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:07.576912 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f530947-3988-4c08-911f-4adc76849463 None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:07.577194 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f530947-3988-4c08-911f-4adc76849463 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:07.577480 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f530947-3988-4c08-911f-4adc76849463 None admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:07.578225 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f530947-3988-4c08-911f-4adc76849463 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:07.579743 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f530947-3988-4c08-911f-4adc76849463 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:07.611354 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 21/44] 10.222.0.71 () {60 vars in 1141 bytes} [Mon May 16 20:10:07 2022] POST /identity/v3/projects => generated 312 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:10:07.705307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 24/45] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:10:07.746853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f530947-3988-4c08-911f-4adc76849463 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:07.918113 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f530947-3988-4c08-911f-4adc76849463 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:07.957729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c502b-d6f1-468c-b7ce-d0add3fe6ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:07.958856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c502b-d6f1-468c-b7ce-d0add3fe6ae8 None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:07.959139 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c502b-d6f1-468c-b7ce-d0add3fe6ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:07.959415 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c502b-d6f1-468c-b7ce-d0add3fe6ae8 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:07.960380 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c502b-d6f1-468c-b7ce-d0add3fe6ae8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:07.961936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c502b-d6f1-468c-b7ce-d0add3fe6ae8 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:07.978119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 22/46] 10.222.0.71 () {60 vars in 1131 bytes} [Mon May 16 20:10:07 2022] POST /identity/v3/roles => generated 223 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:10:10.001371 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40b5d3-b43d-454e-9325-bf8119f03d60 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:10.001945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40b5d3-b43d-454e-9325-bf8119f03d60 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:10.001945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40b5d3-b43d-454e-9325-bf8119f03d60 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:10.003312 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 25/47] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:10.010047 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb4417-1c02-480d-a231-d581ebc0137e None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:10.010555 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb4417-1c02-480d-a231-d581ebc0137e None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:10.010636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb4417-1c02-480d-a231-d581ebc0137e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:10.028310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-59eb4417-1c02-480d-a231-d581ebc0137e None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:10.029535 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-59eb4417-1c02-480d-a231-d581ebc0137e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:10.104535 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 23/48] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:10.129361 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40b5d3-b43d-454e-9325-bf8119f03d60 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:10.268767 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d414e7-34e3-44be-ba91-3da81ab428d5 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:10.269007 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d414e7-34e3-44be-ba91-3da81ab428d5 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:10.269278 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d414e7-34e3-44be-ba91-3da81ab428d5 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:10.270896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 24/49] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:10.278245 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fdfb5-eb2f-426b-abb2-c919efbf8824 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:10.278543 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fdfb5-eb2f-426b-abb2-c919efbf8824 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:10.278910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fdfb5-eb2f-426b-abb2-c919efbf8824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:10.281244 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40b5d3-b43d-454e-9325-bf8119f03d60 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:10.298361 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-345fdfb5-eb2f-426b-abb2-c919efbf8824 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:10.299605 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-345fdfb5-eb2f-426b-abb2-c919efbf8824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:10.321188 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e178c70-8112-4673-b09b-22279872d6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:10.321992 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e178c70-8112-4673-b09b-22279872d6ce None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:10.322279 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e178c70-8112-4673-b09b-22279872d6ce None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:10.322555 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e178c70-8112-4673-b09b-22279872d6ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:10.333605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e178c70-8112-4673-b09b-22279872d6ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:10.341572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-5e178c70-8112-4673-b09b-22279872d6ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:10:10.341572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:10.341572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:10.341572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:10.341572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:10.341572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:10.341572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:10.341572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:10.341572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:10.341572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:10.341572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:10.341572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:10.341572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:10.341572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:10.341572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:10.341572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:10.342517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:10.342517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:10.342517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:10.342517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:10.342517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:10.342517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:10.342517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:10.342517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:10.342517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:10.342517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:10.342517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:10.342517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:10:10.342517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:10.342517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:10.342517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:10.342517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:10.343254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:10.343254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:10.343254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:10.343254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:10.343254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:10.343254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:10.343254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:10.343254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:10.343254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:10.343254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:10.343254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:10:10.343254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:10:10.343254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 26/50] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:10:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:10.349476 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e178c70-8112-4673-b09b-22279872d6ce None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:10.394142 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 25/51] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:10:10.418788 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fdfb5-eb2f-426b-abb2-c919efbf8824 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:10.467646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e178c70-8112-4673-b09b-22279872d6ce None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:10.502893 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d66ec7-fc1a-4127-9fc5-9ae8281d9a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:10.503576 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d66ec7-fc1a-4127-9fc5-9ae8281d9a97 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:10.503866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d66ec7-fc1a-4127-9fc5-9ae8281d9a97 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:10.504173 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d66ec7-fc1a-4127-9fc5-9ae8281d9a97 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:10.505503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d66ec7-fc1a-4127-9fc5-9ae8281d9a97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:10.506023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d66ec7-fc1a-4127-9fc5-9ae8281d9a97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:10.507476 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d66ec7-fc1a-4127-9fc5-9ae8281d9a97 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:10.516982 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 27/52] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:10.523651 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d66ec7-fc1a-4127-9fc5-9ae8281d9a97 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:10.539393 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fdfb5-eb2f-426b-abb2-c919efbf8824 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:10.576062 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423bbe5-37d5-4784-a283-7e085f38c7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:10.577145 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423bbe5-37d5-4784-a283-7e085f38c7fe None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:10.577543 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423bbe5-37d5-4784-a283-7e085f38c7fe None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:10.577933 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423bbe5-37d5-4784-a283-7e085f38c7fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:10.579327 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423bbe5-37d5-4784-a283-7e085f38c7fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:10.581331 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423bbe5-37d5-4784-a283-7e085f38c7fe None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:10.584025 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 26/53] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:10:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:10.589715 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423bbe5-37d5-4784-a283-7e085f38c7fe None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:10.639024 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d66ec7-fc1a-4127-9fc5-9ae8281d9a97 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:10.681012 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e3a27-d3c3-45b4-a0e0-700dad75c557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:10.681904 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e3a27-d3c3-45b4-a0e0-700dad75c557 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:10.682185 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e3a27-d3c3-45b4-a0e0-700dad75c557 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:10.682460 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e3a27-d3c3-45b4-a0e0-700dad75c557 None admin] PATH_INFO: `/v3/users/287e51b57d25435ca49c14e1a5f9c328` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:10.684359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e3a27-d3c3-45b4-a0e0-700dad75c557 None admin] RBAC: Authorizing `identity:get_user(user_id=287e51b57d25435ca49c14e1a5f9c328)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:10.687145 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e3a27-d3c3-45b4-a0e0-700dad75c557 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:10.695900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 28/54] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:10 2022] GET /identity/v3/users/287e51b57d25435ca49c14e1a5f9c328 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:10.697727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e3a27-d3c3-45b4-a0e0-700dad75c557 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:10.706197 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423bbe5-37d5-4784-a283-7e085f38c7fe None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:10.747809 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adabe41-7c3c-4a6d-9518-3a93260dba23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:10.748949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adabe41-7c3c-4a6d-9518-3a93260dba23 None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:10.749449 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adabe41-7c3c-4a6d-9518-3a93260dba23 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:10.749912 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adabe41-7c3c-4a6d-9518-3a93260dba23 None admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:10.751089 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adabe41-7c3c-4a6d-9518-3a93260dba23 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:10.753596 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adabe41-7c3c-4a6d-9518-3a93260dba23 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:10.796011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 27/55] 10.222.0.71 () {60 vars in 1140 bytes} [Mon May 16 20:10:10 2022] POST /identity/v3/projects => generated 298 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:10:10.845792 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e3a27-d3c3-45b4-a0e0-700dad75c557 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:10.901875 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7435f-2153-4d2c-a08e-fac641d81b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:10.903296 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7435f-2153-4d2c-a08e-fac641d81b1c None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:10.903796 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7435f-2153-4d2c-a08e-fac641d81b1c None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:10.904337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7435f-2153-4d2c-a08e-fac641d81b1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:10.906516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7435f-2153-4d2c-a08e-fac641d81b1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:10.908896 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7435f-2153-4d2c-a08e-fac641d81b1c None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:10.911623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 29/56] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:10:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:10.918008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adabe41-7c3c-4a6d-9518-3a93260dba23 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:11.078011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adabe41-7c3c-4a6d-9518-3a93260dba23 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:11.117159 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37bf0f-2421-4308-bf10-f1c7f43a9015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:11.117835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37bf0f-2421-4308-bf10-f1c7f43a9015 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:11.118117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37bf0f-2421-4308-bf10-f1c7f43a9015 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:11.118393 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37bf0f-2421-4308-bf10-f1c7f43a9015 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:11.119266 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37bf0f-2421-4308-bf10-f1c7f43a9015 None admin] RBAC: Adding query filter params (role.id=6576d9225a0946de877f527e3d15db05, scope.domain.id=default, user.id=287e51b57d25435ca49c14e1a5f9c328) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:11.119580 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37bf0f-2421-4308-bf10-f1c7f43a9015 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:11.121120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37bf0f-2421-4308-bf10-f1c7f43a9015 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:11.129504 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 28/57] 10.222.0.71 () {56 vars in 1322 bytes} [Mon May 16 20:10:10 2022] GET /identity/v3/role_assignments?user.id=287e51b57d25435ca49c14e1a5f9c328&scope.domain.id=default&role.id=6576d9225a0946de877f527e3d15db05 => generated 530 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:13.343862 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f9bf5-bd6e-450c-b966-afea5f3b2714 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:13.344476 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f9bf5-bd6e-450c-b966-afea5f3b2714 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:13.344476 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f9bf5-bd6e-450c-b966-afea5f3b2714 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:13.345975 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 30/58] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:13.352645 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084a1c7-8b2c-4039-bc18-e44075d47258 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:13.353447 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084a1c7-8b2c-4039-bc18-e44075d47258 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:13.353447 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084a1c7-8b2c-4039-bc18-e44075d47258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:13.371588 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-2084a1c7-8b2c-4039-bc18-e44075d47258 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:13.372814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-2084a1c7-8b2c-4039-bc18-e44075d47258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:13.481102 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 29/59] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:13.506138 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f9bf5-bd6e-450c-b966-afea5f3b2714 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:13.610746 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f9bf5-bd6e-450c-b966-afea5f3b2714 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:13.646995 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87491ae-d508-4f59-bddf-5db92ea1adba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:13.647795 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87491ae-d508-4f59-bddf-5db92ea1adba None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:13.648080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87491ae-d508-4f59-bddf-5db92ea1adba None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:13.648392 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87491ae-d508-4f59-bddf-5db92ea1adba None admin] PATH_INFO: `/v3/domains/default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:13.649735 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87491ae-d508-4f59-bddf-5db92ea1adba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:13.651397 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87491ae-d508-4f59-bddf-5db92ea1adba None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:13.653127 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 31/60] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:10:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:13.658995 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084a1c7-8b2c-4039-bc18-e44075d47258 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:13.764557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084a1c7-8b2c-4039-bc18-e44075d47258 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:13.805110 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62622b71-09ed-4a09-9004-45724de34c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:13.805783 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62622b71-09ed-4a09-9004-45724de34c15 None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:13.806060 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62622b71-09ed-4a09-9004-45724de34c15 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:13.806328 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62622b71-09ed-4a09-9004-45724de34c15 None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:13.807063 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62622b71-09ed-4a09-9004-45724de34c15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:13.808637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62622b71-09ed-4a09-9004-45724de34c15 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:13.835582 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 30/61] 10.222.0.71 () {60 vars in 1132 bytes} [Mon May 16 20:10:13 2022] POST /identity/v3/users => generated 275 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:10:18.231444 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64655a3d-3f08-4641-a78e-feb176a4d3ba None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:18.232378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64655a3d-3f08-4641-a78e-feb176a4d3ba None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:18.232858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64655a3d-3f08-4641-a78e-feb176a4d3ba None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:18.234749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 32/62] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:18.241820 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e001e-0cf1-4001-b89a-1abf24757f4c None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:18.242324 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e001e-0cf1-4001-b89a-1abf24757f4c None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:18.242399 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e001e-0cf1-4001-b89a-1abf24757f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:18.272003 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-c87e001e-0cf1-4001-b89a-1abf24757f4c None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:18.274018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c87e001e-0cf1-4001-b89a-1abf24757f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:18.420202 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 31/63] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:10:18.473589 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64655a3d-3f08-4641-a78e-feb176a4d3ba None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:18.527053 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d04ff-5191-48b1-a469-d6a2c5d26e7c None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:18.527823 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d04ff-5191-48b1-a469-d6a2c5d26e7c None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:18.528662 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d04ff-5191-48b1-a469-d6a2c5d26e7c None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:18.531425 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 32/64] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:18.555058 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b99380-85e3-4953-bae2-9b24cb4c3f9f None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:18.555913 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b99380-85e3-4953-bae2-9b24cb4c3f9f None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:18.556619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b99380-85e3-4953-bae2-9b24cb4c3f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:18.607290 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-15b99380-85e3-4953-bae2-9b24cb4c3f9f None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:18.609861 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-15b99380-85e3-4953-bae2-9b24cb4c3f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:18.625983 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64655a3d-3f08-4641-a78e-feb176a4d3ba None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:18.688943 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34bd2a3-a3b2-4ada-b228-807e30516e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:18.690848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bd2a3-a3b2-4ada-b228-807e30516e99 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:18.691661 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bd2a3-a3b2-4ada-b228-807e30516e99 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:18.693169 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bd2a3-a3b2-4ada-b228-807e30516e99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:18.704617 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 33/65] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:10:18.713993 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ada55-0ce0-48b1-9f13-2470764d343a None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:18.714493 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ada55-0ce0-48b1-9f13-2470764d343a None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:18.714825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34bd2a3-a3b2-4ada-b228-807e30516e99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:18.715111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ada55-0ce0-48b1-9f13-2470764d343a None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:18.717308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 34/66] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:18.726210 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac300be6-adf8-416e-9499-9e3b6c31a0b5 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:18.726896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac300be6-adf8-416e-9499-9e3b6c31a0b5 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:18.727418 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac300be6-adf8-416e-9499-9e3b6c31a0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:18.738490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-a34bd2a3-a3b2-4ada-b228-807e30516e99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:10:18.738490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:18.738490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:18.738490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:18.738490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:18.738490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:18.738490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:18.738490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:18.738490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:18.738490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:18.738490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:18.738490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:18.738490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:18.738490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:18.738490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:18.738490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:18.739929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:18.739929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:18.739929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:18.739929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:18.739929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:18.739929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:18.739929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:18.739929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:18.739929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:18.739929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:18.739929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:18.739929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:10:18.739929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:18.739929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:18.739929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:18.739929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:18.741193 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:18.741193 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:18.741193 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:18.741193 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:18.741193 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:18.741193 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:18.741193 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:18.741193 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:18.741193 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:18.741193 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:18.741193 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:10:18.741193 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:10:18.741977 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 33/67] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:18.743974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e95d2a-e7d1-4039-ab8d-994bcf77dedf None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:18.744810 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e95d2a-e7d1-4039-ab8d-994bcf77dedf None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:18.745530 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e95d2a-e7d1-4039-ab8d-994bcf77dedf None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:18.748748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 34/68] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:18.750661 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e95d2a-e7d1-4039-ab8d-994bcf77dedf None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:18.751010 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-ac300be6-adf8-416e-9499-9e3b6c31a0b5 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:18.752297 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-ac300be6-adf8-416e-9499-9e3b6c31a0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:18.837938 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 35/69] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:18.838809 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac300be6-adf8-416e-9499-9e3b6c31a0b5 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:18.898959 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e95d2a-e7d1-4039-ab8d-994bcf77dedf None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:18.948784 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7b58f-f58d-47a2-8caa-5e5820f06e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:18.949594 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7b58f-f58d-47a2-8caa-5e5820f06e30 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:18.949878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7b58f-f58d-47a2-8caa-5e5820f06e30 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:18.950154 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7b58f-f58d-47a2-8caa-5e5820f06e30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:18.963201 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7b58f-f58d-47a2-8caa-5e5820f06e30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:18.971082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-17c7b58f-f58d-47a2-8caa-5e5820f06e30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:10:18.971082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:18.971082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:18.971082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:18.971082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:18.971082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:18.971082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:18.971082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:18.971082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:18.971082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:18.971082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:18.971082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:18.971082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:18.971082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:18.971082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:18.971082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:18.972950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:18.972950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:18.972950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:18.972950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:18.972950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:18.972950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:18.972950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:18.972950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:18.972950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:18.972950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:18.972950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:18.972950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:10:18.972950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:18.972950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:18.972950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:18.972950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:18.975044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:18.975044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:18.975044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:18.975044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:18.975044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:18.975044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:18.975044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:18.975044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:18.975044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:18.975044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:18.975044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:10:18.975044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:10:18.975044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 35/70] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:10:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:18.975044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c6aab-00bf-453f-be3f-daaca9424cd8 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:18.978138 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c6aab-00bf-453f-be3f-daaca9424cd8 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:18.978138 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c6aab-00bf-453f-be3f-daaca9424cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:18.984417 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac300be6-adf8-416e-9499-9e3b6c31a0b5 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:18.992800 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-7f2c6aab-00bf-453f-be3f-daaca9424cd8 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:18.994024 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-7f2c6aab-00bf-453f-be3f-daaca9424cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:19.022939 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b11635-b7ca-4be2-9c05-934d74ad278a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:19.023625 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b11635-b7ca-4be2-9c05-934d74ad278a None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:19.023903 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b11635-b7ca-4be2-9c05-934d74ad278a None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:19.024202 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b11635-b7ca-4be2-9c05-934d74ad278a None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:19.024975 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b11635-b7ca-4be2-9c05-934d74ad278a None admin] RBAC: Adding query filter params (name=member) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:19.025281 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b11635-b7ca-4be2-9c05-934d74ad278a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:19.026705 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b11635-b7ca-4be2-9c05-934d74ad278a None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:19.037004 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 36/71] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:10:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:19.038626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cede1b0-0e53-4a34-9660-77266f660a74 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:19.038912 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cede1b0-0e53-4a34-9660-77266f660a74 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:19.039182 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cede1b0-0e53-4a34-9660-77266f660a74 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:19.040756 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 37/72] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:19.041324 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cede1b0-0e53-4a34-9660-77266f660a74 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:19.085758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 36/73] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:19.087483 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c6aab-00bf-453f-be3f-daaca9424cd8 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:19.201034 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c6aab-00bf-453f-be3f-daaca9424cd8 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:19.210826 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cede1b0-0e53-4a34-9660-77266f660a74 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:19.241494 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efaf15-63d9-401d-a1f1-3cf1b781b6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:19.242190 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efaf15-63d9-401d-a1f1-3cf1b781b6f6 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:19.242471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efaf15-63d9-401d-a1f1-3cf1b781b6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:19.242749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efaf15-63d9-401d-a1f1-3cf1b781b6f6 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:19.243511 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efaf15-63d9-401d-a1f1-3cf1b781b6f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:19.243823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efaf15-63d9-401d-a1f1-3cf1b781b6f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:19.245363 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efaf15-63d9-401d-a1f1-3cf1b781b6f6 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:19.252671 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa6987-b25d-487f-b928-b13109f92a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:19.254273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa6987-b25d-487f-b928-b13109f92a33 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:19.254421 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 37/74] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:19.254668 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa6987-b25d-487f-b928-b13109f92a33 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:19.255720 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa6987-b25d-487f-b928-b13109f92a33 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:19.255986 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efaf15-63d9-401d-a1f1-3cf1b781b6f6 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:19.268846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa6987-b25d-487f-b928-b13109f92a33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:19.278018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-c2aa6987-b25d-487f-b928-b13109f92a33 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:10:19.278018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:19.278018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:19.278018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:19.278018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:19.278018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:19.278018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:19.278018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:19.278018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:19.278018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:19.278018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:19.278018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:19.278018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:19.278018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:19.278018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:19.278018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:19.285416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:19.285416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:19.285416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:19.285416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:19.285416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:19.285416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:19.285416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:19.285416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:19.285416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:19.285416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:19.285416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:19.285416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:10:19.285416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:19.285416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:19.285416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:19.285416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:19.286431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:19.286431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:19.286431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:19.286431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:19.286431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:19.286431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:19.286431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:19.286431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:19.286431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:19.286431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:19.286431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:10:19.286431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:10:19.286431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 38/75] 10.222.0.71 () {56 vars in 1114 bytes} [Mon May 16 20:10:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:19.286431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b10dd-9301-4456-bb3c-1e23ad2e00fc None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:19.287293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b10dd-9301-4456-bb3c-1e23ad2e00fc None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:19.287293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b10dd-9301-4456-bb3c-1e23ad2e00fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:19.304063 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-e38b10dd-9301-4456-bb3c-1e23ad2e00fc None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:19.305329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-e38b10dd-9301-4456-bb3c-1e23ad2e00fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:19.360518 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efaf15-63d9-401d-a1f1-3cf1b781b6f6 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:19.374853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 39/76] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:19.376834 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b10dd-9301-4456-bb3c-1e23ad2e00fc None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:19.400919 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64328b6-95ca-40a2-8823-77b8b458f5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:19.402337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64328b6-95ca-40a2-8823-77b8b458f5ca None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:19.402717 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64328b6-95ca-40a2-8823-77b8b458f5ca None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:19.403182 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64328b6-95ca-40a2-8823-77b8b458f5ca None admin] PATH_INFO: `/v3/users/485b8697788141cb873e8d65a1b6b4cc` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:19.425282 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64328b6-95ca-40a2-8823-77b8b458f5ca None admin] RBAC: Authorizing `identity:get_user(user_id=485b8697788141cb873e8d65a1b6b4cc)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:19.427112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64328b6-95ca-40a2-8823-77b8b458f5ca None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:19.429363 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 38/77] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:19 2022] GET /identity/v3/users/485b8697788141cb873e8d65a1b6b4cc => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:19.430467 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64328b6-95ca-40a2-8823-77b8b458f5ca None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:19.484644 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b10dd-9301-4456-bb3c-1e23ad2e00fc None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:19.524729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aefebe-fdff-426c-bcaf-ce4c7faf43ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:19.525534 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aefebe-fdff-426c-bcaf-ce4c7faf43ac None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:19.525818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aefebe-fdff-426c-bcaf-ce4c7faf43ac None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:19.526088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aefebe-fdff-426c-bcaf-ce4c7faf43ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:19.527358 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aefebe-fdff-426c-bcaf-ce4c7faf43ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:19.528908 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aefebe-fdff-426c-bcaf-ce4c7faf43ac None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:19.530620 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 40/78] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:10:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:19.538720 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aefebe-fdff-426c-bcaf-ce4c7faf43ac None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:19.570354 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64328b6-95ca-40a2-8823-77b8b458f5ca None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:19.612878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f92c1c-795c-4247-befb-e33accad8349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:19.614119 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f92c1c-795c-4247-befb-e33accad8349 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:19.614708 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f92c1c-795c-4247-befb-e33accad8349 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:19.615230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f92c1c-795c-4247-befb-e33accad8349 None admin] PATH_INFO: `/v3/users/287e51b57d25435ca49c14e1a5f9c328` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:19.616754 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f92c1c-795c-4247-befb-e33accad8349 None admin] RBAC: Authorizing `identity:get_user(user_id=287e51b57d25435ca49c14e1a5f9c328)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:19.618258 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f92c1c-795c-4247-befb-e33accad8349 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:19.619979 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 39/79] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:19 2022] GET /identity/v3/users/287e51b57d25435ca49c14e1a5f9c328 => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:19.620842 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f92c1c-795c-4247-befb-e33accad8349 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:19.669848 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aefebe-fdff-426c-bcaf-ce4c7faf43ac None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:19.712358 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab238eba-6979-4168-b211-522f245c7385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:19.713160 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab238eba-6979-4168-b211-522f245c7385 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:19.713500 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab238eba-6979-4168-b211-522f245c7385 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:19.713845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab238eba-6979-4168-b211-522f245c7385 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:19.714805 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab238eba-6979-4168-b211-522f245c7385 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:19.715215 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab238eba-6979-4168-b211-522f245c7385 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:19.716982 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab238eba-6979-4168-b211-522f245c7385 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:19.726542 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 41/80] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:10:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:19.727476 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab238eba-6979-4168-b211-522f245c7385 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:19.788856 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f92c1c-795c-4247-befb-e33accad8349 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:19.829733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e83055-9888-41a6-97f3-7ef4775a9932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:19.830567 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e83055-9888-41a6-97f3-7ef4775a9932 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:19.830862 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e83055-9888-41a6-97f3-7ef4775a9932 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:19.831237 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e83055-9888-41a6-97f3-7ef4775a9932 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:19.838618 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab238eba-6979-4168-b211-522f245c7385 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:19.847670 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e83055-9888-41a6-97f3-7ef4775a9932 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:19.856927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-45e83055-9888-41a6-97f3-7ef4775a9932 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:10:19.856927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:19.856927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:19.856927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:19.856927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:19.856927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:19.856927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:19.856927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:19.856927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:19.856927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:19.856927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:19.856927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:19.856927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:19.856927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:19.856927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:19.856927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:19.858701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:19.858701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:19.858701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:19.858701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:19.858701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:19.858701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:19.858701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:19.858701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:19.858701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:19.858701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:19.858701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:19.858701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:10:19.858701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:19.858701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:19.858701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:19.858701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:19.860305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:19.860305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:19.860305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:19.860305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:19.860305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:19.860305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:19.860305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:19.860305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:19.860305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:19.860305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:19.860305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:10:19.860305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:10:19.860305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 40/81] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:19.860305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e83055-9888-41a6-97f3-7ef4775a9932 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:19.880461 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7148d8d-dcc6-4b9f-b736-7f6eee0868b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:19.881131 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7148d8d-dcc6-4b9f-b736-7f6eee0868b8 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:19.881414 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7148d8d-dcc6-4b9f-b736-7f6eee0868b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:19.881691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7148d8d-dcc6-4b9f-b736-7f6eee0868b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:19.953000 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7148d8d-dcc6-4b9f-b736-7f6eee0868b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:19.954523 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7148d8d-dcc6-4b9f-b736-7f6eee0868b8 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:20.002887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e83055-9888-41a6-97f3-7ef4775a9932 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:20.042976 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606dd4f2-489c-4b39-981d-506614796f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:20.043604 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dd4f2-489c-4b39-981d-506614796f0e None admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:20.043888 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dd4f2-489c-4b39-981d-506614796f0e None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:20.044205 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dd4f2-489c-4b39-981d-506614796f0e None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:20.045052 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606dd4f2-489c-4b39-981d-506614796f0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:20.046752 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606dd4f2-489c-4b39-981d-506614796f0e None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:20.081368 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 42/82] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:10:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:10:20.081368 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7148d8d-dcc6-4b9f-b736-7f6eee0868b8 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:20.087212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 41/83] 10.222.0.71 () {60 vars in 1132 bytes} [Mon May 16 20:10:19 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:10:20.088062 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606dd4f2-489c-4b39-981d-506614796f0e None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:20.219319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606dd4f2-489c-4b39-981d-506614796f0e None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:20.264420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7148d8d-dcc6-4b9f-b736-7f6eee0868b8 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:20.289569 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e865b-4d58-4187-b00f-c2f33f8b0027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:20.293219 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e865b-4d58-4187-b00f-c2f33f8b0027 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:20.293488 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e865b-4d58-4187-b00f-c2f33f8b0027 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:20.293739 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e865b-4d58-4187-b00f-c2f33f8b0027 None admin] PATH_INFO: `/v3/users/485b8697788141cb873e8d65a1b6b4cc` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:20.295736 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e865b-4d58-4187-b00f-c2f33f8b0027 None admin] RBAC: Authorizing `identity:get_user(user_id=485b8697788141cb873e8d65a1b6b4cc)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:20.296937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e865b-4d58-4187-b00f-c2f33f8b0027 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:20.299205 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 42/84] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:20 2022] GET /identity/v3/users/485b8697788141cb873e8d65a1b6b4cc => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:20.303384 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e865b-4d58-4187-b00f-c2f33f8b0027 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:20.329629 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f7058-fbf2-43ef-a420-c1d2e8e656d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:20.330717 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f7058-fbf2-43ef-a420-c1d2e8e656d3 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:20.331181 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f7058-fbf2-43ef-a420-c1d2e8e656d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:20.331596 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f7058-fbf2-43ef-a420-c1d2e8e656d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:20.422696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f7058-fbf2-43ef-a420-c1d2e8e656d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:20.424220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f7058-fbf2-43ef-a420-c1d2e8e656d3 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:20.444828 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e865b-4d58-4187-b00f-c2f33f8b0027 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:20.503232 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a454b0-937a-42b6-95c9-f760a0826014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:20.504398 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a454b0-937a-42b6-95c9-f760a0826014 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:20.505442 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a454b0-937a-42b6-95c9-f760a0826014 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:20.506232 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a454b0-937a-42b6-95c9-f760a0826014 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:20.506803 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a454b0-937a-42b6-95c9-f760a0826014 None admin] RBAC: Adding query filter params (name=member) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:20.507251 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a454b0-937a-42b6-95c9-f760a0826014 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:20.509779 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a454b0-937a-42b6-95c9-f760a0826014 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:20.523983 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 43/85] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:10:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:20.525516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a454b0-937a-42b6-95c9-f760a0826014 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:20.580623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 43/86] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:10:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:10:20.581491 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f7058-fbf2-43ef-a420-c1d2e8e656d3 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:20.682889 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a454b0-937a-42b6-95c9-f760a0826014 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:20.723596 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fb7db-9e43-4447-996d-f91c9c722812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:20.724489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fb7db-9e43-4447-996d-f91c9c722812 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:20.724813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fb7db-9e43-4447-996d-f91c9c722812 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:20.725060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fb7db-9e43-4447-996d-f91c9c722812 None admin] PATH_INFO: `/v3/projects/e66c9a82caa04ffb8ac50780877086d0` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:20.726474 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122fb7db-9e43-4447-996d-f91c9c722812 None admin] RBAC: Authorizing `identity:get_project(project_id=e66c9a82caa04ffb8ac50780877086d0)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:20.727941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122fb7db-9e43-4447-996d-f91c9c722812 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:20.729716 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 44/87] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:20 2022] GET /identity/v3/projects/e66c9a82caa04ffb8ac50780877086d0 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:20.730514 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fb7db-9e43-4447-996d-f91c9c722812 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:20.758930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f7058-fbf2-43ef-a420-c1d2e8e656d3 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:20.799301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb6402-de2f-412d-a4be-587ee578596b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:20.800002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb6402-de2f-412d-a4be-587ee578596b None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:20.800313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb6402-de2f-412d-a4be-587ee578596b None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:20.800588 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb6402-de2f-412d-a4be-587ee578596b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:20.880697 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb6402-de2f-412d-a4be-587ee578596b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:20.882056 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb6402-de2f-412d-a4be-587ee578596b None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:20.943900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fb7db-9e43-4447-996d-f91c9c722812 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:21.023014 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51971a2-e322-44d5-99c3-a9ffaa7ab9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:21.024564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51971a2-e322-44d5-99c3-a9ffaa7ab9a3 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:21.025065 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51971a2-e322-44d5-99c3-a9ffaa7ab9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:21.026294 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51971a2-e322-44d5-99c3-a9ffaa7ab9a3 None admin] PATH_INFO: `/v3/users/485b8697788141cb873e8d65a1b6b4cc` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:21.028765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51971a2-e322-44d5-99c3-a9ffaa7ab9a3 None admin] RBAC: Authorizing `identity:get_user(user_id=485b8697788141cb873e8d65a1b6b4cc)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:21.031465 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51971a2-e322-44d5-99c3-a9ffaa7ab9a3 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:21.034257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 45/88] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:20 2022] GET /identity/v3/users/485b8697788141cb873e8d65a1b6b4cc => generated 275 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:21.035136 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51971a2-e322-44d5-99c3-a9ffaa7ab9a3 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:21.037406 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 44/89] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:10:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:10:21.038862 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb6402-de2f-412d-a4be-587ee578596b None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:21.163762 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51971a2-e322-44d5-99c3-a9ffaa7ab9a3 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:21.201353 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e304af8-4ee2-4dad-a300-98f0760429bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:21.202385 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e304af8-4ee2-4dad-a300-98f0760429bc None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:21.202697 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e304af8-4ee2-4dad-a300-98f0760429bc None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:21.202994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e304af8-4ee2-4dad-a300-98f0760429bc None admin] PATH_INFO: `/v3/projects/e66c9a82caa04ffb8ac50780877086d0` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:21.204420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e304af8-4ee2-4dad-a300-98f0760429bc None admin] RBAC: Authorizing `identity:get_project(project_id=e66c9a82caa04ffb8ac50780877086d0)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:21.205942 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e304af8-4ee2-4dad-a300-98f0760429bc None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:21.208519 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 46/90] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:21 2022] GET /identity/v3/projects/e66c9a82caa04ffb8ac50780877086d0 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:21.209379 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e304af8-4ee2-4dad-a300-98f0760429bc None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:21.216703 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb6402-de2f-412d-a4be-587ee578596b None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:21.284478 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d3cdc-0d3e-4af8-800e-5f4a3f576386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:21.285651 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d3cdc-0d3e-4af8-800e-5f4a3f576386 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:21.286871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d3cdc-0d3e-4af8-800e-5f4a3f576386 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:21.287090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d3cdc-0d3e-4af8-800e-5f4a3f576386 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:21.288958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d3cdc-0d3e-4af8-800e-5f4a3f576386 None admin] RBAC: Adding query filter params (role.id=99462c05ed484212893d40128c99f47c, scope.project.id=e66c9a82caa04ffb8ac50780877086d0, user.id=485b8697788141cb873e8d65a1b6b4cc) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:21.289536 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d3cdc-0d3e-4af8-800e-5f4a3f576386 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:21.292772 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d3cdc-0d3e-4af8-800e-5f4a3f576386 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:21.305845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 45/91] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:10:21 2022] GET /identity/v3/role_assignments?user.id=485b8697788141cb873e8d65a1b6b4cc&scope.project.id=e66c9a82caa04ffb8ac50780877086d0&role.id=99462c05ed484212893d40128c99f47c => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:21.307117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d3cdc-0d3e-4af8-800e-5f4a3f576386 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:21.326520 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e304af8-4ee2-4dad-a300-98f0760429bc None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:21.365333 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b904c5f-01c0-4ee2-850f-8d6b8e4e34f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:21.366011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b904c5f-01c0-4ee2-850f-8d6b8e4e34f8 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:21.366299 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b904c5f-01c0-4ee2-850f-8d6b8e4e34f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:21.366576 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b904c5f-01c0-4ee2-850f-8d6b8e4e34f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:21.445992 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b904c5f-01c0-4ee2-850f-8d6b8e4e34f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:21.447420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b904c5f-01c0-4ee2-850f-8d6b8e4e34f8 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:21.503193 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d3cdc-0d3e-4af8-800e-5f4a3f576386 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:21.557352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f4c84-c909-43f0-8b1e-f1dae5e891c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:21.558217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f4c84-c909-43f0-8b1e-f1dae5e891c2 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:21.558490 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f4c84-c909-43f0-8b1e-f1dae5e891c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:21.558756 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f4c84-c909-43f0-8b1e-f1dae5e891c2 None admin] PATH_INFO: `/v3/projects/e66c9a82caa04ffb8ac50780877086d0` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:21.560022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f4c84-c909-43f0-8b1e-f1dae5e891c2 None admin] RBAC: Authorizing `identity:get_project(project_id=e66c9a82caa04ffb8ac50780877086d0)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:21.561508 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f4c84-c909-43f0-8b1e-f1dae5e891c2 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:21.563248 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 46/92] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:21 2022] GET /identity/v3/projects/e66c9a82caa04ffb8ac50780877086d0 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:21.563939 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 47/93] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:10:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:10:21.564115 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f4c84-c909-43f0-8b1e-f1dae5e891c2 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:21.571242 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b904c5f-01c0-4ee2-850f-8d6b8e4e34f8 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:21.685121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b904c5f-01c0-4ee2-850f-8d6b8e4e34f8 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:21.717844 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f4c84-c909-43f0-8b1e-f1dae5e891c2 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:21.723055 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9ea22-c5fd-4d86-9d46-df529037f7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:21.723814 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9ea22-c5fd-4d86-9d46-df529037f7dd None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:21.724620 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9ea22-c5fd-4d86-9d46-df529037f7dd None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:21.724620 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9ea22-c5fd-4d86-9d46-df529037f7dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:21.725222 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9ea22-c5fd-4d86-9d46-df529037f7dd None admin] RBAC: Adding query filter params (role.id=140f30ce618745eea43e96b91df3bbab, scope.project.id=e66c9a82caa04ffb8ac50780877086d0, user.id=485b8697788141cb873e8d65a1b6b4cc) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:21.725541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9ea22-c5fd-4d86-9d46-df529037f7dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:21.727053 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9ea22-c5fd-4d86-9d46-df529037f7dd None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:21.735927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 48/94] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:10:21 2022] GET /identity/v3/role_assignments?user.id=485b8697788141cb873e8d65a1b6b4cc&scope.project.id=e66c9a82caa04ffb8ac50780877086d0&role.id=140f30ce618745eea43e96b91df3bbab => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:21.741092 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9ea22-c5fd-4d86-9d46-df529037f7dd None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:21.756056 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c18e0-d82c-4981-9ceb-a7df67b53beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:21.756536 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c18e0-d82c-4981-9ceb-a7df67b53beb None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:21.756818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c18e0-d82c-4981-9ceb-a7df67b53beb None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:21.757095 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c18e0-d82c-4981-9ceb-a7df67b53beb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:21.757962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c18e0-d82c-4981-9ceb-a7df67b53beb None admin] RBAC: Adding query filter params (role.id=6576d9225a0946de877f527e3d15db05, scope.project.id=e66c9a82caa04ffb8ac50780877086d0, user.id=287e51b57d25435ca49c14e1a5f9c328) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:21.758266 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c18e0-d82c-4981-9ceb-a7df67b53beb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:21.759776 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c18e0-d82c-4981-9ceb-a7df67b53beb None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:21.766143 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 47/95] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:10:21 2022] GET /identity/v3/role_assignments?user.id=287e51b57d25435ca49c14e1a5f9c328&scope.project.id=e66c9a82caa04ffb8ac50780877086d0&role.id=6576d9225a0946de877f527e3d15db05 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:21.934481 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9ea22-c5fd-4d86-9d46-df529037f7dd None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:21.984226 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed51dc2-243d-4b34-ba44-ba2f12277aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:21.985168 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed51dc2-243d-4b34-ba44-ba2f12277aeb None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:21.985490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed51dc2-243d-4b34-ba44-ba2f12277aeb None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:21.985887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed51dc2-243d-4b34-ba44-ba2f12277aeb None admin] PATH_INFO: `/v3/projects/2464bf71255c4c6ca98665b836a2908c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:21.987148 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed51dc2-243d-4b34-ba44-ba2f12277aeb None admin] RBAC: Authorizing `identity:get_project(project_id=2464bf71255c4c6ca98665b836a2908c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:21.988658 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed51dc2-243d-4b34-ba44-ba2f12277aeb None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:21.991331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 49/96] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:21 2022] GET /identity/v3/projects/2464bf71255c4c6ca98665b836a2908c => generated 312 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:21.997645 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c18e0-d82c-4981-9ceb-a7df67b53beb None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:22.119107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c18e0-d82c-4981-9ceb-a7df67b53beb None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:22.159432 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61634dfb-8e66-420e-9983-9071ee882080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:22.159976 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61634dfb-8e66-420e-9983-9071ee882080 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:22.160289 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61634dfb-8e66-420e-9983-9071ee882080 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:22.160561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61634dfb-8e66-420e-9983-9071ee882080 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:22.161815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61634dfb-8e66-420e-9983-9071ee882080 None admin] RBAC: Adding query filter params (role.id=99462c05ed484212893d40128c99f47c, scope.project.id=2464bf71255c4c6ca98665b836a2908c, user.id=485b8697788141cb873e8d65a1b6b4cc) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:22.161815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61634dfb-8e66-420e-9983-9071ee882080 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:22.163266 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61634dfb-8e66-420e-9983-9071ee882080 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:22.169689 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 48/97] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:10:21 2022] GET /identity/v3/role_assignments?user.id=485b8697788141cb873e8d65a1b6b4cc&scope.project.id=2464bf71255c4c6ca98665b836a2908c&role.id=99462c05ed484212893d40128c99f47c => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:23.235088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e8ba2-9911-43fe-b0be-0c66756beb87 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:23.235850 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e8ba2-9911-43fe-b0be-0c66756beb87 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:23.236090 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e8ba2-9911-43fe-b0be-0c66756beb87 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:23.241385 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 50/98] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:23.246030 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498ba8c-e344-4571-931a-045da6c7bd30 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:23.246641 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498ba8c-e344-4571-931a-045da6c7bd30 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:23.246796 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498ba8c-e344-4571-931a-045da6c7bd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:23.289907 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-d498ba8c-e344-4571-931a-045da6c7bd30 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:23.292189 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-d498ba8c-e344-4571-931a-045da6c7bd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:23.446530 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 49/99] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:23.485643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e8ba2-9911-43fe-b0be-0c66756beb87 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:23.681101 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e8ba2-9911-43fe-b0be-0c66756beb87 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:23.690830 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc57e32-c7b8-49a3-a1cb-cffc759511cb None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:23.691159 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc57e32-c7b8-49a3-a1cb-cffc759511cb None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:23.691380 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc57e32-c7b8-49a3-a1cb-cffc759511cb None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:23.693494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 50/100] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:10:23.706496 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69529c-6c99-402c-a6f1-5671afd8a06e None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:23.706806 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69529c-6c99-402c-a6f1-5671afd8a06e None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:23.707041 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69529c-6c99-402c-a6f1-5671afd8a06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:23.732906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-be69529c-6c99-402c-a6f1-5671afd8a06e None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:23.734100 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-be69529c-6c99-402c-a6f1-5671afd8a06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:23.756916 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de2b70-2d4a-43c2-b155-6a9fdeab4d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:23.757794 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de2b70-2d4a-43c2-b155-6a9fdeab4d23 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:23.758153 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de2b70-2d4a-43c2-b155-6a9fdeab4d23 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:23.758482 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de2b70-2d4a-43c2-b155-6a9fdeab4d23 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:23.775623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de2b70-2d4a-43c2-b155-6a9fdeab4d23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:23.795623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-c3de2b70-2d4a-43c2-b155-6a9fdeab4d23 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:10:23.795623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:23.795623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:23.795623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:23.795623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:23.795623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:23.795623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:23.795623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:23.795623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:23.795623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:23.795623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:23.795623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:23.795623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:23.795623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:23.795623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:23.795623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:23.798120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:23.798120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:23.798120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:23.798120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:23.798120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:23.798120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:23.798120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:23.798120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:23.798120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:23.798120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:23.798120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:23.798120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:10:23.798120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:23.798120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:23.798120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:23.798120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:23.800223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:23.800223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:23.800223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:23.800223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:23.800223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:23.800223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:23.800223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:23.800223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:23.800223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:23.800223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:23.800223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:10:23.800223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:10:23.800223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 51/101] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:23.805968 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de2b70-2d4a-43c2-b155-6a9fdeab4d23 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:23.879769 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 51/102] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 16 20:10:23.950686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69529c-6c99-402c-a6f1-5671afd8a06e None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:23.980775 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de2b70-2d4a-43c2-b155-6a9fdeab4d23 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:24.085830 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b0b42-954b-482f-a0a9-a2138496b5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:24.086533 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b0b42-954b-482f-a0a9-a2138496b5f2 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:24.086824 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b0b42-954b-482f-a0a9-a2138496b5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:24.087108 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b0b42-954b-482f-a0a9-a2138496b5f2 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:24.087892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b0b42-954b-482f-a0a9-a2138496b5f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:24.088231 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b0b42-954b-482f-a0a9-a2138496b5f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:24.089989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b0b42-954b-482f-a0a9-a2138496b5f2 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:24.107741 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 52/103] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:10:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:24.113450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b0b42-954b-482f-a0a9-a2138496b5f2 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:24.159521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69529c-6c99-402c-a6f1-5671afd8a06e None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:24.263092 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b0b42-954b-482f-a0a9-a2138496b5f2 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:24.268955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd215e37-9e55-4e64-8a09-874dc2e29add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:24.269889 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd215e37-9e55-4e64-8a09-874dc2e29add None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:24.270052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd215e37-9e55-4e64-8a09-874dc2e29add None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:24.270463 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd215e37-9e55-4e64-8a09-874dc2e29add None admin] PATH_INFO: `/v3/domains/default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:24.271893 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd215e37-9e55-4e64-8a09-874dc2e29add None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:24.273461 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd215e37-9e55-4e64-8a09-874dc2e29add None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:24.275445 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 52/104] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:10:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:24.281110 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd215e37-9e55-4e64-8a09-874dc2e29add None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:24.307262 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059c96d-a21e-4123-b3eb-1ab6e3e5a644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:24.308199 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059c96d-a21e-4123-b3eb-1ab6e3e5a644 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:24.308493 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059c96d-a21e-4123-b3eb-1ab6e3e5a644 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:24.308771 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059c96d-a21e-4123-b3eb-1ab6e3e5a644 None admin] PATH_INFO: `/v3/users/6c11474ef23a44958140ea5c60a802d2` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:24.340874 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059c96d-a21e-4123-b3eb-1ab6e3e5a644 None admin] RBAC: Authorizing `identity:get_user(user_id=6c11474ef23a44958140ea5c60a802d2)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:24.342345 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059c96d-a21e-4123-b3eb-1ab6e3e5a644 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:24.344211 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 53/105] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:24 2022] GET /identity/v3/users/6c11474ef23a44958140ea5c60a802d2 => generated 289 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:24.350595 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059c96d-a21e-4123-b3eb-1ab6e3e5a644 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:24.508529 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059c96d-a21e-4123-b3eb-1ab6e3e5a644 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:24.543497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd215e37-9e55-4e64-8a09-874dc2e29add None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:24.561887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfa8e3-9f2e-42bc-8500-52b967dca04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:24.563003 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfa8e3-9f2e-42bc-8500-52b967dca04f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:24.563508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfa8e3-9f2e-42bc-8500-52b967dca04f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:24.564003 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfa8e3-9f2e-42bc-8500-52b967dca04f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:24.605229 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf2ed9-d807-4a37-8d36-433ac2f0a889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:24.606289 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf2ed9-d807-4a37-8d36-433ac2f0a889 None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:24.606778 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf2ed9-d807-4a37-8d36-433ac2f0a889 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:24.607279 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf2ed9-d807-4a37-8d36-433ac2f0a889 None admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:24.613396 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf2ed9-d807-4a37-8d36-433ac2f0a889 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:24.617947 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf2ed9-d807-4a37-8d36-433ac2f0a889 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:24.711130 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 53/106] 10.222.0.71 () {60 vars in 1141 bytes} [Mon May 16 20:10:24 2022] POST /identity/v3/projects => generated 302 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:10:24.794000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfa8e3-9f2e-42bc-8500-52b967dca04f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:24.796957 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfa8e3-9f2e-42bc-8500-52b967dca04f None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:24.982423 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 54/107] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:10:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 20:10:24.990078 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf2ed9-d807-4a37-8d36-433ac2f0a889 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:25.077692 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6e4fe-e67c-4e55-a095-c38e4cb53e71 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:25.078022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6e4fe-e67c-4e55-a095-c38e4cb53e71 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:25.078249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6e4fe-e67c-4e55-a095-c38e4cb53e71 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:25.084929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 55/108] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:25.095162 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680d34e-6672-4b71-8f7d-9452fe25316d None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:25.095466 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680d34e-6672-4b71-8f7d-9452fe25316d None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:25.095727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680d34e-6672-4b71-8f7d-9452fe25316d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:25.130823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-f680d34e-6672-4b71-8f7d-9452fe25316d None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:25.132223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f680d34e-6672-4b71-8f7d-9452fe25316d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:25.205470 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf2ed9-d807-4a37-8d36-433ac2f0a889 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:25.232537 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 56/109] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:10:25.271247 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e8188-1c0c-41bc-862a-facbb241d586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:25.272211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e8188-1c0c-41bc-862a-facbb241d586 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:25.272505 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e8188-1c0c-41bc-862a-facbb241d586 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:25.272786 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e8188-1c0c-41bc-862a-facbb241d586 None admin] PATH_INFO: `/v3/projects/e66c9a82caa04ffb8ac50780877086d0` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:25.273235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680d34e-6672-4b71-8f7d-9452fe25316d None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:25.274160 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e8188-1c0c-41bc-862a-facbb241d586 None admin] RBAC: Authorizing `identity:get_project(project_id=e66c9a82caa04ffb8ac50780877086d0)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:25.275652 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e8188-1c0c-41bc-862a-facbb241d586 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:25.277573 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 54/110] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:24 2022] GET /identity/v3/projects/e66c9a82caa04ffb8ac50780877086d0 => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:25.283589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e8188-1c0c-41bc-862a-facbb241d586 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:25.403932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e8188-1c0c-41bc-862a-facbb241d586 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:25.445001 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261c1ca-97e7-4bc4-9d80-b246c9626e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:25.445696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261c1ca-97e7-4bc4-9d80-b246c9626e6f None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:25.445985 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261c1ca-97e7-4bc4-9d80-b246c9626e6f None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:25.446266 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261c1ca-97e7-4bc4-9d80-b246c9626e6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:25.447136 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261c1ca-97e7-4bc4-9d80-b246c9626e6f None admin] RBAC: Adding query filter params (role.id=f7d1ff112a024e3190daa30a7814e054, scope.project.id=e66c9a82caa04ffb8ac50780877086d0, user.id=6c11474ef23a44958140ea5c60a802d2) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:25.447455 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261c1ca-97e7-4bc4-9d80-b246c9626e6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:25.448980 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261c1ca-97e7-4bc4-9d80-b246c9626e6f None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:25.455531 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 55/111] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:10:25 2022] GET /identity/v3/role_assignments?user.id=6c11474ef23a44958140ea5c60a802d2&scope.project.id=e66c9a82caa04ffb8ac50780877086d0&role.id=f7d1ff112a024e3190daa30a7814e054 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:25.490565 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680d34e-6672-4b71-8f7d-9452fe25316d None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:25.536483 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47930c0-2c95-4526-a99d-d32d59c76efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:25.537331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47930c0-2c95-4526-a99d-d32d59c76efb None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:25.537609 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47930c0-2c95-4526-a99d-d32d59c76efb None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:25.537885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47930c0-2c95-4526-a99d-d32d59c76efb None admin] PATH_INFO: `/v3/roles/member` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:25.562273 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47930c0-2c95-4526-a99d-d32d59c76efb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:25.570643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-e47930c0-2c95-4526-a99d-d32d59c76efb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:10:25.570643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:25.570643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:25.570643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:25.570643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:25.570643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:25.570643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:25.570643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:25.570643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:25.570643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:25.570643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:25.570643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:25.570643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:25.570643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:25.570643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:25.570643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:25.572831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:25.572831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:25.572831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:25.572831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:25.572831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:25.572831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:25.572831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:25.572831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:25.572831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:25.572831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:25.572831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:25.572831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:10:25.572831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:25.572831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:25.572831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:25.572831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:25.574751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:25.574751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:25.574751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:25.574751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:25.574751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:25.574751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:25.574751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:25.574751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:25.574751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:25.574751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:25.574751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:10:25.574751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:10:25.574751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 57/112] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:25.581362 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261c1ca-97e7-4bc4-9d80-b246c9626e6f None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:25.718011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261c1ca-97e7-4bc4-9d80-b246c9626e6f None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:25.759472 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389c6ba-b6ca-4882-82f5-dd98ca9a4f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:25.760177 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389c6ba-b6ca-4882-82f5-dd98ca9a4f4f None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:25.760475 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389c6ba-b6ca-4882-82f5-dd98ca9a4f4f None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:25.760921 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389c6ba-b6ca-4882-82f5-dd98ca9a4f4f None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:25.761784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389c6ba-b6ca-4882-82f5-dd98ca9a4f4f None admin] RBAC: Adding query filter params (name=member) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:25.762106 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389c6ba-b6ca-4882-82f5-dd98ca9a4f4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:25.763598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389c6ba-b6ca-4882-82f5-dd98ca9a4f4f None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:25.774806 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 56/113] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:10:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:25.781449 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47930c0-2c95-4526-a99d-d32d59c76efb None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:25.929355 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47930c0-2c95-4526-a99d-d32d59c76efb None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:25.945825 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fe292-0a13-4b73-9663-6db5e9c7908d None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:25.946152 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fe292-0a13-4b73-9663-6db5e9c7908d None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:25.946390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fe292-0a13-4b73-9663-6db5e9c7908d None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:25.947847 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 57/114] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:25.956583 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c54978-a151-4c1c-990f-3be33f85bc11 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:25.956882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c54978-a151-4c1c-990f-3be33f85bc11 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:25.957150 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c54978-a151-4c1c-990f-3be33f85bc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:25.977561 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe00ec-853d-4d0f-8ee6-dc9f9e0ae917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:25.978572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe00ec-853d-4d0f-8ee6-dc9f9e0ae917 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:25.978903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe00ec-853d-4d0f-8ee6-dc9f9e0ae917 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:25.979122 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe00ec-853d-4d0f-8ee6-dc9f9e0ae917 None admin] PATH_INFO: `/v3/users/485b8697788141cb873e8d65a1b6b4cc` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:25.980923 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe00ec-853d-4d0f-8ee6-dc9f9e0ae917 None admin] RBAC: Authorizing `identity:get_user(user_id=485b8697788141cb873e8d65a1b6b4cc)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:25.982521 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe00ec-853d-4d0f-8ee6-dc9f9e0ae917 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:25.984283 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 58/115] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:25 2022] GET /identity/v3/users/485b8697788141cb873e8d65a1b6b4cc => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:25.990534 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-90c54978-a151-4c1c-990f-3be33f85bc11 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:25.991766 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-90c54978-a151-4c1c-990f-3be33f85bc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:25.994972 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe00ec-853d-4d0f-8ee6-dc9f9e0ae917 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:26.160144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe00ec-853d-4d0f-8ee6-dc9f9e0ae917 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:26.187167 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 58/116] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:26.190365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402590d1-6815-4b4e-b6a5-d53bd496ce9e None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:26.190877 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402590d1-6815-4b4e-b6a5-d53bd496ce9e None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:26.191456 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402590d1-6815-4b4e-b6a5-d53bd496ce9e None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:26.210264 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 59/117] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:26 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:26.210264 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340272b-b737-4007-a71d-79524de6af40 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:26.210264 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340272b-b737-4007-a71d-79524de6af40 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:26.210264 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340272b-b737-4007-a71d-79524de6af40 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:26.213645 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 60/118] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:26.215129 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88399824-eea7-463e-869a-4cdff1c00cc4 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:26.215542 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88399824-eea7-463e-869a-4cdff1c00cc4 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:26.215920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88399824-eea7-463e-869a-4cdff1c00cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:26.237475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37a664-89fd-4b7b-bf5d-f246c9c8706d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:26.238362 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37a664-89fd-4b7b-bf5d-f246c9c8706d None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:26.238648 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37a664-89fd-4b7b-bf5d-f246c9c8706d None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:26.239137 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37a664-89fd-4b7b-bf5d-f246c9c8706d None admin] PATH_INFO: `/v3/projects/e66c9a82caa04ffb8ac50780877086d0` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:26.241260 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37a664-89fd-4b7b-bf5d-f246c9c8706d None admin] RBAC: Authorizing `identity:get_project(project_id=e66c9a82caa04ffb8ac50780877086d0)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:26.242773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37a664-89fd-4b7b-bf5d-f246c9c8706d None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:26.245014 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 59/119] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:25 2022] GET /identity/v3/projects/e66c9a82caa04ffb8ac50780877086d0 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:26.245951 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37a664-89fd-4b7b-bf5d-f246c9c8706d None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:26.250286 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-88399824-eea7-463e-869a-4cdff1c00cc4 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:26.252548 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-88399824-eea7-463e-869a-4cdff1c00cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:26.373442 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37a664-89fd-4b7b-bf5d-f246c9c8706d None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:26.382001 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 61/120] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:26.385425 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cd506-448c-4575-a215-3b8f7795fced None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:26.386199 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cd506-448c-4575-a215-3b8f7795fced None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:26.386899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cd506-448c-4575-a215-3b8f7795fced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:26.416306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-e15cd506-448c-4575-a215-3b8f7795fced None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:26.417210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270f884-74e0-40c6-a48f-3f59a2240bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:26.417400 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-e15cd506-448c-4575-a215-3b8f7795fced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:26.419068 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270f884-74e0-40c6-a48f-3f59a2240bbc None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:26.419811 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270f884-74e0-40c6-a48f-3f59a2240bbc None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:26.420625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270f884-74e0-40c6-a48f-3f59a2240bbc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:26.442926 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270f884-74e0-40c6-a48f-3f59a2240bbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:26.462118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-6270f884-74e0-40c6-a48f-3f59a2240bbc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:10:26.462118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:26.462118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:26.462118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:26.462118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:26.462118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:26.462118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:26.462118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:26.462118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:26.462118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:26.462118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:26.462118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:26.462118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:26.462118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:26.462118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:26.462118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:26.464063 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:26.464063 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:26.464063 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:26.464063 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:26.464063 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:26.464063 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:26.464063 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:26.464063 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:26.464063 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:26.464063 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:26.464063 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:26.464063 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:10:26.464063 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:26.464063 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:26.464063 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:26.464063 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:26.465879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:26.465879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:26.465879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:26.465879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:26.465879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:26.465879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:26.465879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:26.465879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:26.465879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:26.465879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:26.465879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:10:26.465879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:10:26.469714 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 60/121] 10.222.0.71 () {56 vars in 1114 bytes} [Mon May 16 20:10:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:26.471717 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270f884-74e0-40c6-a48f-3f59a2240bbc None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:26.508327 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 62/122] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:26.510266 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cd506-448c-4575-a215-3b8f7795fced None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:26.612790 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270f884-74e0-40c6-a48f-3f59a2240bbc None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:26.655931 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cd506-448c-4575-a215-3b8f7795fced None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:26.660554 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2aa3f-5395-4328-8abe-f048722497eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:26.662649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2aa3f-5395-4328-8abe-f048722497eb None admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:26.663268 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2aa3f-5395-4328-8abe-f048722497eb None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:26.663889 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2aa3f-5395-4328-8abe-f048722497eb None admin] PATH_INFO: `/v3/projects/e66c9a82caa04ffb8ac50780877086d0/users/485b8697788141cb873e8d65a1b6b4cc/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:26.667599 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2aa3f-5395-4328-8abe-f048722497eb None admin] RBAC: Authorizing `identity:create_grant(project_id=e66c9a82caa04ffb8ac50780877086d0, user_id=485b8697788141cb873e8d65a1b6b4cc, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:26.669500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2aa3f-5395-4328-8abe-f048722497eb None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:26.691009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 61/123] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:10:26 2022] PUT /identity/v3/projects/e66c9a82caa04ffb8ac50780877086d0/users/485b8697788141cb873e8d65a1b6b4cc/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:10:26.693048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2aa3f-5395-4328-8abe-f048722497eb None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:26.714480 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66159c94-8aaf-417a-bc0d-eb9ec0332a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:26.716241 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66159c94-8aaf-417a-bc0d-eb9ec0332a70 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:26.717036 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66159c94-8aaf-417a-bc0d-eb9ec0332a70 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:26.717472 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66159c94-8aaf-417a-bc0d-eb9ec0332a70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:26.754225 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66159c94-8aaf-417a-bc0d-eb9ec0332a70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:26.771949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-66159c94-8aaf-417a-bc0d-eb9ec0332a70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:10:26.771949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:26.771949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:26.771949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:26.771949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:26.771949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:26.771949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:26.771949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:26.771949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:26.771949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:26.771949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:26.771949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:26.771949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:26.771949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:26.771949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:26.771949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:26.773125 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:26.773125 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:26.773125 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:26.773125 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:26.773125 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:26.773125 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:26.773125 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:26.773125 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:26.773125 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:26.773125 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:26.773125 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:26.773125 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:10:26.773125 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:26.773125 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:26.773125 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:26.773125 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:26.773896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:26.773896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:26.773896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:26.773896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:26.773896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:26.773896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:26.773896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:26.773896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:26.773896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:26.773896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:26.773896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:10:26.773896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:10:26.774621 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 63/124] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:10:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:26.776876 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66159c94-8aaf-417a-bc0d-eb9ec0332a70 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:26.908682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2aa3f-5395-4328-8abe-f048722497eb None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:26.929813 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66159c94-8aaf-417a-bc0d-eb9ec0332a70 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:26.949742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86717e7c-dbd1-44f3-9c7b-20e66b05076c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:26.950675 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86717e7c-dbd1-44f3-9c7b-20e66b05076c None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:26.951106 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86717e7c-dbd1-44f3-9c7b-20e66b05076c None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:26.951527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86717e7c-dbd1-44f3-9c7b-20e66b05076c None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:26.952492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86717e7c-dbd1-44f3-9c7b-20e66b05076c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:26.952946 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86717e7c-dbd1-44f3-9c7b-20e66b05076c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:26.954488 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86717e7c-dbd1-44f3-9c7b-20e66b05076c None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:26.965258 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 62/125] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:10:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:26.966463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86717e7c-dbd1-44f3-9c7b-20e66b05076c None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:26.979761 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6b5d0-4bcb-4bec-b607-600948fb9dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:26.981044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6b5d0-4bcb-4bec-b607-600948fb9dc4 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:26.981044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6b5d0-4bcb-4bec-b607-600948fb9dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:26.981291 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6b5d0-4bcb-4bec-b607-600948fb9dc4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:26.995924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6b5d0-4bcb-4bec-b607-600948fb9dc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:27.003887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-f2e6b5d0-4bcb-4bec-b607-600948fb9dc4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:10:27.003887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:27.003887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:27.003887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:27.003887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:27.003887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:27.003887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:27.003887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:27.003887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:27.003887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:27.003887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:27.003887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:27.003887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:27.003887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:27.003887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:27.003887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:27.005545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:27.005545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:27.005545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:27.005545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:27.005545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:27.005545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:27.005545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:27.005545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:27.005545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:27.005545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:27.005545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:27.005545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:10:27.005545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:27.005545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:27.005545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:27.005545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:27.006383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:27.006383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:27.006383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:27.006383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:27.006383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:27.006383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:27.006383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:27.006383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:27.006383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:27.006383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:27.006383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:10:27.006383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:10:27.006383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 64/126] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:27.007602 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6b5d0-4bcb-4bec-b607-600948fb9dc4 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:27.088634 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86717e7c-dbd1-44f3-9c7b-20e66b05076c None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:27.129264 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4f619-8863-43fb-ba88-92ccce653a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:27.130442 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4f619-8863-43fb-ba88-92ccce653a6d None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:27.130881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4f619-8863-43fb-ba88-92ccce653a6d None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:27.131444 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4f619-8863-43fb-ba88-92ccce653a6d None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:27.132388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4f619-8863-43fb-ba88-92ccce653a6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:27.132891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4f619-8863-43fb-ba88-92ccce653a6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:27.134711 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4f619-8863-43fb-ba88-92ccce653a6d None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:27.144612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 63/127] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:27.145807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4f619-8863-43fb-ba88-92ccce653a6d None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:27.147334 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6b5d0-4bcb-4bec-b607-600948fb9dc4 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:27.192675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cb342-2968-4645-a884-79976b489264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:27.193340 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cb342-2968-4645-a884-79976b489264 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:27.193540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cb342-2968-4645-a884-79976b489264 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:27.193839 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cb342-2968-4645-a884-79976b489264 None admin] PATH_INFO: `/v3/users/485b8697788141cb873e8d65a1b6b4cc` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:27.195166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cb342-2968-4645-a884-79976b489264 None admin] RBAC: Authorizing `identity:get_user(user_id=485b8697788141cb873e8d65a1b6b4cc)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:27.197208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cb342-2968-4645-a884-79976b489264 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:27.198515 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 65/128] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:27 2022] GET /identity/v3/users/485b8697788141cb873e8d65a1b6b4cc => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:27.203542 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cb342-2968-4645-a884-79976b489264 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:27.255370 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4f619-8863-43fb-ba88-92ccce653a6d None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:27.319091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f536dc-90e2-470f-af3c-5050324fb9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:27.320482 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f536dc-90e2-470f-af3c-5050324fb9a5 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:27.322427 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f536dc-90e2-470f-af3c-5050324fb9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:27.323548 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f536dc-90e2-470f-af3c-5050324fb9a5 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:27.327103 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f536dc-90e2-470f-af3c-5050324fb9a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:27.327727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f536dc-90e2-470f-af3c-5050324fb9a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:27.329736 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f536dc-90e2-470f-af3c-5050324fb9a5 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:27.361700 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 64/129] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:10:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:27.363311 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f536dc-90e2-470f-af3c-5050324fb9a5 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:27.438284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cb342-2968-4645-a884-79976b489264 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:27.491226 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f536dc-90e2-470f-af3c-5050324fb9a5 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:27.518954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395a6c6-bf00-4f36-a298-7e1740227c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:27.519853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395a6c6-bf00-4f36-a298-7e1740227c16 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:27.520833 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395a6c6-bf00-4f36-a298-7e1740227c16 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:27.521779 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395a6c6-bf00-4f36-a298-7e1740227c16 None admin] PATH_INFO: `/v3/users/287e51b57d25435ca49c14e1a5f9c328` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:27.522524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395a6c6-bf00-4f36-a298-7e1740227c16 None admin] RBAC: Authorizing `identity:get_user(user_id=287e51b57d25435ca49c14e1a5f9c328)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:27.524105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395a6c6-bf00-4f36-a298-7e1740227c16 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:27.528249 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 66/130] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:27 2022] GET /identity/v3/users/287e51b57d25435ca49c14e1a5f9c328 => generated 247 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:27.529447 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395a6c6-bf00-4f36-a298-7e1740227c16 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:27.541603 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac9d0d-9152-4a10-bbaa-d88b70358b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:27.542501 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac9d0d-9152-4a10-bbaa-d88b70358b30 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:27.542793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac9d0d-9152-4a10-bbaa-d88b70358b30 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:27.543073 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac9d0d-9152-4a10-bbaa-d88b70358b30 None admin] PATH_INFO: `/v3/projects/e66c9a82caa04ffb8ac50780877086d0` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:27.552179 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac9d0d-9152-4a10-bbaa-d88b70358b30 None admin] RBAC: Authorizing `identity:get_project(project_id=e66c9a82caa04ffb8ac50780877086d0)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:27.552179 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac9d0d-9152-4a10-bbaa-d88b70358b30 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:27.552179 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 65/131] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:27 2022] GET /identity/v3/projects/e66c9a82caa04ffb8ac50780877086d0 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:27.552179 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac9d0d-9152-4a10-bbaa-d88b70358b30 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:27.689843 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395a6c6-bf00-4f36-a298-7e1740227c16 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:27.731480 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676c602-0ecf-4fd2-aae5-2d30d9c997a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:27.732400 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676c602-0ecf-4fd2-aae5-2d30d9c997a2 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:27.732674 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676c602-0ecf-4fd2-aae5-2d30d9c997a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:27.732951 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676c602-0ecf-4fd2-aae5-2d30d9c997a2 None admin] PATH_INFO: `/v3/users/485b8697788141cb873e8d65a1b6b4cc` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:27.737748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676c602-0ecf-4fd2-aae5-2d30d9c997a2 None admin] RBAC: Authorizing `identity:get_user(user_id=485b8697788141cb873e8d65a1b6b4cc)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:27.742601 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676c602-0ecf-4fd2-aae5-2d30d9c997a2 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:27.749850 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 67/132] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:27 2022] GET /identity/v3/users/485b8697788141cb873e8d65a1b6b4cc => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:27.751166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676c602-0ecf-4fd2-aae5-2d30d9c997a2 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:27.751726 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac9d0d-9152-4a10-bbaa-d88b70358b30 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:27.847159 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192855e-00a2-4c81-bdc8-ac1e27ffb904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:27.848585 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192855e-00a2-4c81-bdc8-ac1e27ffb904 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:27.848887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192855e-00a2-4c81-bdc8-ac1e27ffb904 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:27.849172 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192855e-00a2-4c81-bdc8-ac1e27ffb904 None admin] PATH_INFO: `/v3/projects/e66c9a82caa04ffb8ac50780877086d0` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:27.850485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192855e-00a2-4c81-bdc8-ac1e27ffb904 None admin] RBAC: Authorizing `identity:get_project(project_id=e66c9a82caa04ffb8ac50780877086d0)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:27.851978 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192855e-00a2-4c81-bdc8-ac1e27ffb904 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:27.860720 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 66/133] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:27 2022] GET /identity/v3/projects/e66c9a82caa04ffb8ac50780877086d0 => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:27.861723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192855e-00a2-4c81-bdc8-ac1e27ffb904 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:27.908594 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676c602-0ecf-4fd2-aae5-2d30d9c997a2 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:27.969088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e584418-151a-4dd9-88b5-c7235f697c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:27.970424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e584418-151a-4dd9-88b5-c7235f697c36 None admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:27.970937 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e584418-151a-4dd9-88b5-c7235f697c36 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:27.971425 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e584418-151a-4dd9-88b5-c7235f697c36 None admin] PATH_INFO: `/v3/projects/e66c9a82caa04ffb8ac50780877086d0/users/485b8697788141cb873e8d65a1b6b4cc/roles/140f30ce618745eea43e96b91df3bbab` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:27.974762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e584418-151a-4dd9-88b5-c7235f697c36 None admin] RBAC: Authorizing `identity:create_grant(project_id=e66c9a82caa04ffb8ac50780877086d0, user_id=485b8697788141cb873e8d65a1b6b4cc, role_id=140f30ce618745eea43e96b91df3bbab)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:27.976682 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e584418-151a-4dd9-88b5-c7235f697c36 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:28.010594 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 68/134] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:10:27 2022] PUT /identity/v3/projects/e66c9a82caa04ffb8ac50780877086d0/users/485b8697788141cb873e8d65a1b6b4cc/roles/140f30ce618745eea43e96b91df3bbab => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:10:28.011790 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e584418-151a-4dd9-88b5-c7235f697c36 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:28.155173 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192855e-00a2-4c81-bdc8-ac1e27ffb904 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:28.253112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2d9ec-9bb6-4982-9839-772073eefb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:28.254023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2d9ec-9bb6-4982-9839-772073eefb44 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:28.254341 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2d9ec-9bb6-4982-9839-772073eefb44 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:28.255487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2d9ec-9bb6-4982-9839-772073eefb44 None admin] PATH_INFO: `/v3/projects/2464bf71255c4c6ca98665b836a2908c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:28.257084 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2d9ec-9bb6-4982-9839-772073eefb44 None admin] RBAC: Authorizing `identity:get_project(project_id=2464bf71255c4c6ca98665b836a2908c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:28.258588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2d9ec-9bb6-4982-9839-772073eefb44 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:28.260541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 67/135] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:27 2022] GET /identity/v3/projects/2464bf71255c4c6ca98665b836a2908c => generated 312 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:28.262969 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611ab5a-3c78-4bd0-b9c8-8342a0f71a13 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:28.263247 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611ab5a-3c78-4bd0-b9c8-8342a0f71a13 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:28.263516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611ab5a-3c78-4bd0-b9c8-8342a0f71a13 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:28.264815 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 68/136] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:28.270249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611ab5a-3c78-4bd0-b9c8-8342a0f71a13 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:28.276537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e584418-151a-4dd9-88b5-c7235f697c36 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:28.326704 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b1d28-44c0-456e-9f33-919f3e859d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:28.327636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b1d28-44c0-456e-9f33-919f3e859d2a None admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:28.327924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b1d28-44c0-456e-9f33-919f3e859d2a None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:28.328240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b1d28-44c0-456e-9f33-919f3e859d2a None admin] PATH_INFO: `/v3/projects/e66c9a82caa04ffb8ac50780877086d0/users/287e51b57d25435ca49c14e1a5f9c328/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:28.332762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b1d28-44c0-456e-9f33-919f3e859d2a None admin] RBAC: Authorizing `identity:create_grant(project_id=e66c9a82caa04ffb8ac50780877086d0, user_id=287e51b57d25435ca49c14e1a5f9c328, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:28.335137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b1d28-44c0-456e-9f33-919f3e859d2a None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:28.361570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 69/137] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:10:28 2022] PUT /identity/v3/projects/e66c9a82caa04ffb8ac50780877086d0/users/287e51b57d25435ca49c14e1a5f9c328/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:10:28.365790 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f1b2b-8fc0-4f83-8114-b0450b7cdacb None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:28.366149 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f1b2b-8fc0-4f83-8114-b0450b7cdacb None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:28.367093 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f1b2b-8fc0-4f83-8114-b0450b7cdacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:28.405932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-a86f1b2b-8fc0-4f83-8114-b0450b7cdacb None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:28.407322 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-a86f1b2b-8fc0-4f83-8114-b0450b7cdacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:28.529859 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611ab5a-3c78-4bd0-b9c8-8342a0f71a13 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:28.584786 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 70/138] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:28.611506 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c380f-bcef-4f96-9e43-d189fbbcf864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:28.613717 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c380f-bcef-4f96-9e43-d189fbbcf864 None admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:28.614610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c380f-bcef-4f96-9e43-d189fbbcf864 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:28.615409 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c380f-bcef-4f96-9e43-d189fbbcf864 None admin] PATH_INFO: `/v3/projects/2464bf71255c4c6ca98665b836a2908c/users/485b8697788141cb873e8d65a1b6b4cc/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:28.622928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c380f-bcef-4f96-9e43-d189fbbcf864 None admin] RBAC: Authorizing `identity:create_grant(project_id=2464bf71255c4c6ca98665b836a2908c, user_id=485b8697788141cb873e8d65a1b6b4cc, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:28.626052 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c380f-bcef-4f96-9e43-d189fbbcf864 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:28.628952 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f1b2b-8fc0-4f83-8114-b0450b7cdacb None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:28.662524 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 69/139] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:10:28 2022] PUT /identity/v3/projects/2464bf71255c4c6ca98665b836a2908c/users/485b8697788141cb873e8d65a1b6b4cc/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:10:28.828058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cad604-0a79-412c-9a34-4af46572e081 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:28.828490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cad604-0a79-412c-9a34-4af46572e081 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:28.828717 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cad604-0a79-412c-9a34-4af46572e081 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:28.830132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 70/140] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:10:28.839413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4a59b-abcb-4bc4-baf7-512d73238b39 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:28.839814 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4a59b-abcb-4bc4-baf7-512d73238b39 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:28.840054 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4a59b-abcb-4bc4-baf7-512d73238b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:28.852667 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f1b2b-8fc0-4f83-8114-b0450b7cdacb None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:28.862165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-03b4a59b-abcb-4bc4-baf7-512d73238b39 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:28.865487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-03b4a59b-abcb-4bc4-baf7-512d73238b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:28.916138 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e19ac-aaad-49d2-9ab4-271319d3f26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:28.917051 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e19ac-aaad-49d2-9ab4-271319d3f26c None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:28.917337 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e19ac-aaad-49d2-9ab4-271319d3f26c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:28.917617 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e19ac-aaad-49d2-9ab4-271319d3f26c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:28.919270 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e19ac-aaad-49d2-9ab4-271319d3f26c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:28.922438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e19ac-aaad-49d2-9ab4-271319d3f26c None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:28.924248 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 71/141] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:10:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:28.945966 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e19ac-aaad-49d2-9ab4-271319d3f26c None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:29.031043 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 71/142] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:29.080047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4a59b-abcb-4bc4-baf7-512d73238b39 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:29.274649 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e19ac-aaad-49d2-9ab4-271319d3f26c None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:29.310205 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4a59b-abcb-4bc4-baf7-512d73238b39 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:29.362369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561fda0-ad3c-4fea-a423-6fa9041faea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:29.368353 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561fda0-ad3c-4fea-a423-6fa9041faea1 None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:29.369019 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561fda0-ad3c-4fea-a423-6fa9041faea1 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:29.369511 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561fda0-ad3c-4fea-a423-6fa9041faea1 None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:29.370891 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561fda0-ad3c-4fea-a423-6fa9041faea1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:29.373818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561fda0-ad3c-4fea-a423-6fa9041faea1 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:29.401302 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20698111-cff7-44e1-90d5-688d3b230741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:29.402348 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20698111-cff7-44e1-90d5-688d3b230741 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:29.402633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20698111-cff7-44e1-90d5-688d3b230741 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:29.402913 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20698111-cff7-44e1-90d5-688d3b230741 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:29.425671 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20698111-cff7-44e1-90d5-688d3b230741 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:29.427905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 72/143] 10.222.0.71 () {60 vars in 1132 bytes} [Mon May 16 20:10:28 2022] POST /identity/v3/users => generated 283 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:10:29.439112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-20698111-cff7-44e1-90d5-688d3b230741 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:10:29.439112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:29.439112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:29.439112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:29.439112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:29.439112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:29.439112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:29.439112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:29.439112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:29.439112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:29.439112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:29.439112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:29.439112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:29.439112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:29.439112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:29.439112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:29.440040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:29.440040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:29.440040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:29.440040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:29.440040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:29.440040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:29.440040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:29.440040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:29.440040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:29.440040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:29.440040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:29.440040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:10:29.440040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:29.440040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:29.440040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:29.440040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:29.440857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:29.440857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:29.440857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:29.440857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:29.440857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:29.440857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:29.440857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:29.440857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:29.440857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:29.440857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:29.440857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:10:29.440857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:10:29.440857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 72/144] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:10:29.450941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561fda0-ad3c-4fea-a423-6fa9041faea1 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:29.670731 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561fda0-ad3c-4fea-a423-6fa9041faea1 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:29.743619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dbedd-8dcb-47e7-8e30-9855010f0bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:29.744338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dbedd-8dcb-47e7-8e30-9855010f0bc3 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:29.744628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dbedd-8dcb-47e7-8e30-9855010f0bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:29.744904 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dbedd-8dcb-47e7-8e30-9855010f0bc3 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:29.745683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dbedd-8dcb-47e7-8e30-9855010f0bc3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:29.745995 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dbedd-8dcb-47e7-8e30-9855010f0bc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:29.747471 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dbedd-8dcb-47e7-8e30-9855010f0bc3 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:29.762022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 73/145] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:10:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:29.771975 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20698111-cff7-44e1-90d5-688d3b230741 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:29.936268 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20698111-cff7-44e1-90d5-688d3b230741 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:30.005105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f710f71-d1ca-4655-ad1c-fea59db2e494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:30.006695 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f710f71-d1ca-4655-ad1c-fea59db2e494 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:30.007207 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f710f71-d1ca-4655-ad1c-fea59db2e494 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:30.007694 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f710f71-d1ca-4655-ad1c-fea59db2e494 None admin] PATH_INFO: `/v3/users/6c11474ef23a44958140ea5c60a802d2` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:30.013277 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f710f71-d1ca-4655-ad1c-fea59db2e494 None admin] RBAC: Authorizing `identity:get_user(user_id=6c11474ef23a44958140ea5c60a802d2)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:30.015551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f710f71-d1ca-4655-ad1c-fea59db2e494 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:30.018870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 73/146] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:29 2022] GET /identity/v3/users/6c11474ef23a44958140ea5c60a802d2 => generated 289 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:30.026012 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dbedd-8dcb-47e7-8e30-9855010f0bc3 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:30.268213 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dbedd-8dcb-47e7-8e30-9855010f0bc3 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:30.348265 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90c738-53b2-44ae-90d2-d304164fd941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:30.349667 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90c738-53b2-44ae-90d2-d304164fd941 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:30.350003 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90c738-53b2-44ae-90d2-d304164fd941 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:30.350282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90c738-53b2-44ae-90d2-d304164fd941 None admin] PATH_INFO: `/v3/projects/e66c9a82caa04ffb8ac50780877086d0` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:30.351579 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90c738-53b2-44ae-90d2-d304164fd941 None admin] RBAC: Authorizing `identity:get_project(project_id=e66c9a82caa04ffb8ac50780877086d0)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:30.353067 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90c738-53b2-44ae-90d2-d304164fd941 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:30.354786 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 74/147] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:30 2022] GET /identity/v3/projects/e66c9a82caa04ffb8ac50780877086d0 => generated 298 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:30.363449 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f710f71-d1ca-4655-ad1c-fea59db2e494 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:30.473975 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f710f71-d1ca-4655-ad1c-fea59db2e494 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:30.497606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee49664-a2fe-4269-9572-4024f9d9b75f None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:30.498012 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee49664-a2fe-4269-9572-4024f9d9b75f None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:30.498459 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee49664-a2fe-4269-9572-4024f9d9b75f None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:30.502764 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 75/148] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:10:30.512787 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e657a8-0040-489d-b3dc-f694cf11b2d6 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:30.513410 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e657a8-0040-489d-b3dc-f694cf11b2d6 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:30.513782 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0dd362-1633-44d4-a460-fefcab2d99c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:30.513976 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e657a8-0040-489d-b3dc-f694cf11b2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:30.514681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dd362-1633-44d4-a460-fefcab2d99c1 None admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:30.514961 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dd362-1633-44d4-a460-fefcab2d99c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:30.515231 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dd362-1633-44d4-a460-fefcab2d99c1 None admin] PATH_INFO: `/v3/projects/e66c9a82caa04ffb8ac50780877086d0/users/6c11474ef23a44958140ea5c60a802d2/roles/f7d1ff112a024e3190daa30a7814e054` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:30.520586 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0dd362-1633-44d4-a460-fefcab2d99c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e66c9a82caa04ffb8ac50780877086d0, user_id=6c11474ef23a44958140ea5c60a802d2, role_id=f7d1ff112a024e3190daa30a7814e054)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:30.522221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0dd362-1633-44d4-a460-fefcab2d99c1 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:30.546567 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 74/149] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:10:30 2022] PUT /identity/v3/projects/e66c9a82caa04ffb8ac50780877086d0/users/6c11474ef23a44958140ea5c60a802d2/roles/f7d1ff112a024e3190daa30a7814e054 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:10:30.555070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-95e657a8-0040-489d-b3dc-f694cf11b2d6 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:30.557018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-95e657a8-0040-489d-b3dc-f694cf11b2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:30.692377 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 76/150] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:30.727417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0dd362-1633-44d4-a460-fefcab2d99c1 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:30.962680 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0dd362-1633-44d4-a460-fefcab2d99c1 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:31.038207 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63f5db-2b1a-4722-beb0-faac27488c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:31.039703 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63f5db-2b1a-4722-beb0-faac27488c53 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:31.040214 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63f5db-2b1a-4722-beb0-faac27488c53 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:31.040666 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63f5db-2b1a-4722-beb0-faac27488c53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:31.073804 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63f5db-2b1a-4722-beb0-faac27488c53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:31.093126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-ce63f5db-2b1a-4722-beb0-faac27488c53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:10:31.093126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:31.093126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:31.093126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:31.093126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:31.093126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:31.093126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:31.093126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:31.093126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:31.093126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:31.093126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:31.093126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:31.093126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:31.093126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:31.093126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:31.093126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:31.095266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:31.095266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:31.095266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:31.095266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:31.095266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:31.095266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:31.095266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:31.095266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:31.095266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:31.095266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:31.095266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:31.095266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:10:31.095266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:31.095266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:31.095266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:31.095266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:31.097210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:31.097210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:31.097210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:31.097210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:31.097210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:31.097210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:31.097210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:31.097210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:31.097210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:31.097210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:31.097210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:10:31.097210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:10:31.097210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 75/151] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:31.106091 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e657a8-0040-489d-b3dc-f694cf11b2d6 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:31.325272 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e657a8-0040-489d-b3dc-f694cf11b2d6 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:31.390797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30328753-c8e1-48de-b5c2-3b0b333197e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:31.391782 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30328753-c8e1-48de-b5c2-3b0b333197e5 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:31.392080 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30328753-c8e1-48de-b5c2-3b0b333197e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:31.392382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30328753-c8e1-48de-b5c2-3b0b333197e5 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:31.393166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30328753-c8e1-48de-b5c2-3b0b333197e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:31.393472 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30328753-c8e1-48de-b5c2-3b0b333197e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:31.395589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30328753-c8e1-48de-b5c2-3b0b333197e5 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:31.405146 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 77/152] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:10:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:31.413198 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63f5db-2b1a-4722-beb0-faac27488c53 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:31.654631 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63f5db-2b1a-4722-beb0-faac27488c53 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:31.699921 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe3234-dc08-49a2-87f0-6ec757b49356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:31.700850 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe3234-dc08-49a2-87f0-6ec757b49356 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:31.701134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe3234-dc08-49a2-87f0-6ec757b49356 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:31.701410 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe3234-dc08-49a2-87f0-6ec757b49356 None admin] PATH_INFO: `/v3/users/485b8697788141cb873e8d65a1b6b4cc` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:31.702671 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe3234-dc08-49a2-87f0-6ec757b49356 None admin] RBAC: Authorizing `identity:get_user(user_id=485b8697788141cb873e8d65a1b6b4cc)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:31.704140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe3234-dc08-49a2-87f0-6ec757b49356 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:31.706151 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 76/153] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:31 2022] GET /identity/v3/users/485b8697788141cb873e8d65a1b6b4cc => generated 275 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:31.712722 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30328753-c8e1-48de-b5c2-3b0b333197e5 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:31.879843 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30328753-c8e1-48de-b5c2-3b0b333197e5 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:31.881804 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6a4c2-e61a-43e9-b9eb-58a82761a803 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:31.882280 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6a4c2-e61a-43e9-b9eb-58a82761a803 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:31.882749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6a4c2-e61a-43e9-b9eb-58a82761a803 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:31.888763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 77/154] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:31.905353 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29483e56-4193-42f2-abe8-0e80eb763411 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:31.905853 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29483e56-4193-42f2-abe8-0e80eb763411 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:31.906280 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29483e56-4193-42f2-abe8-0e80eb763411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:31.924000 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf8259-297d-4275-bd27-cdb9ec90d3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:31.924702 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf8259-297d-4275-bd27-cdb9ec90d3ad None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:31.924989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf8259-297d-4275-bd27-cdb9ec90d3ad None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:31.925263 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf8259-297d-4275-bd27-cdb9ec90d3ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:31.945316 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-29483e56-4193-42f2-abe8-0e80eb763411 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:31.946991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-29483e56-4193-42f2-abe8-0e80eb763411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:32.024742 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf8259-297d-4275-bd27-cdb9ec90d3ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:32.026320 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf8259-297d-4275-bd27-cdb9ec90d3ad None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:32.106803 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 78/155] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:32.138813 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 78/156] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:10:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:10:32.144577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf8259-297d-4275-bd27-cdb9ec90d3ad None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:32.144964 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29483e56-4193-42f2-abe8-0e80eb763411 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:32.261310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf8259-297d-4275-bd27-cdb9ec90d3ad None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:32.308795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003612ee-d01d-4b9e-a8f5-0ca7cefc9bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:32.309603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003612ee-d01d-4b9e-a8f5-0ca7cefc9bce None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:32.310027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003612ee-d01d-4b9e-a8f5-0ca7cefc9bce None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:32.310437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003612ee-d01d-4b9e-a8f5-0ca7cefc9bce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:32.338768 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003612ee-d01d-4b9e-a8f5-0ca7cefc9bce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:32.346932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-003612ee-d01d-4b9e-a8f5-0ca7cefc9bce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:10:32.346932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:32.346932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:32.346932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:32.346932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:32.346932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:32.346932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:32.346932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:32.346932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:32.346932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:32.346932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:32.346932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:32.346932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:32.346932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:32.346932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:32.346932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:32.347845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:32.347845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:32.347845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:32.347845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:32.347845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:32.347845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:32.347845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:32.347845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:32.347845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:32.347845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:32.347845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:32.347845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:10:32.347845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:32.347845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:32.347845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:32.347845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:32.348688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:32.348688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:32.348688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:32.348688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:32.348688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:32.348688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:32.348688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:32.348688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:32.348688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:32.348688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:32.348688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:10:32.348688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:10:32.348688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 79/157] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:10:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:32.355961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003612ee-d01d-4b9e-a8f5-0ca7cefc9bce None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:32.382350 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29483e56-4193-42f2-abe8-0e80eb763411 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:32.447372 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902938de-63ab-4d89-a2ae-09af6003403f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:32.448296 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902938de-63ab-4d89-a2ae-09af6003403f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:32.448579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902938de-63ab-4d89-a2ae-09af6003403f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:32.448853 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902938de-63ab-4d89-a2ae-09af6003403f None admin] PATH_INFO: `/v3/projects/e66c9a82caa04ffb8ac50780877086d0` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:32.452298 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902938de-63ab-4d89-a2ae-09af6003403f None admin] RBAC: Authorizing `identity:get_project(project_id=e66c9a82caa04ffb8ac50780877086d0)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:32.453792 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902938de-63ab-4d89-a2ae-09af6003403f None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:32.459080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 79/158] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:32 2022] GET /identity/v3/projects/e66c9a82caa04ffb8ac50780877086d0 => generated 298 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:32.476347 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902938de-63ab-4d89-a2ae-09af6003403f None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:32.616495 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003612ee-d01d-4b9e-a8f5-0ca7cefc9bce None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:32.635323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902938de-63ab-4d89-a2ae-09af6003403f None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:32.678726 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6241d-4040-400d-8d05-b0be47043115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:32.679388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6241d-4040-400d-8d05-b0be47043115 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:32.679670 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6241d-4040-400d-8d05-b0be47043115 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:32.679971 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6241d-4040-400d-8d05-b0be47043115 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:32.680897 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6241d-4040-400d-8d05-b0be47043115 None admin] RBAC: Adding query filter params (role.id=99462c05ed484212893d40128c99f47c, scope.project.id=e66c9a82caa04ffb8ac50780877086d0, user.id=485b8697788141cb873e8d65a1b6b4cc) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:32.681209 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6241d-4040-400d-8d05-b0be47043115 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:32.682678 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6241d-4040-400d-8d05-b0be47043115 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:32.689225 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 80/159] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:10:32 2022] GET /identity/v3/role_assignments?user.id=485b8697788141cb873e8d65a1b6b4cc&scope.project.id=e66c9a82caa04ffb8ac50780877086d0&role.id=99462c05ed484212893d40128c99f47c => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:32.729479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c032c60-6548-448c-9291-a23063ce3ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:32.730604 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c032c60-6548-448c-9291-a23063ce3ee6 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:32.731094 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c032c60-6548-448c-9291-a23063ce3ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:32.731567 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c032c60-6548-448c-9291-a23063ce3ee6 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:32.732975 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c032c60-6548-448c-9291-a23063ce3ee6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:32.733403 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c032c60-6548-448c-9291-a23063ce3ee6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:32.736145 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c032c60-6548-448c-9291-a23063ce3ee6 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:32.767185 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 80/160] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:32.772773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6241d-4040-400d-8d05-b0be47043115 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:32.894968 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6241d-4040-400d-8d05-b0be47043115 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:32.934383 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321962f-fdbf-4377-8de9-0189b08934f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:32.935628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321962f-fdbf-4377-8de9-0189b08934f3 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:32.936105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321962f-fdbf-4377-8de9-0189b08934f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:32.936638 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321962f-fdbf-4377-8de9-0189b08934f3 None admin] PATH_INFO: `/v3/users/287e51b57d25435ca49c14e1a5f9c328` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:32.938158 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321962f-fdbf-4377-8de9-0189b08934f3 None admin] RBAC: Authorizing `identity:get_user(user_id=287e51b57d25435ca49c14e1a5f9c328)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:32.939830 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321962f-fdbf-4377-8de9-0189b08934f3 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:32.941790 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 81/161] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:32 2022] GET /identity/v3/users/287e51b57d25435ca49c14e1a5f9c328 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:32.948029 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c032c60-6548-448c-9291-a23063ce3ee6 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:33.064528 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c032c60-6548-448c-9291-a23063ce3ee6 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:33.112511 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240aaf55-593f-4f7e-ae0c-f8c6b05d115a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:33.113617 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240aaf55-593f-4f7e-ae0c-f8c6b05d115a None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:33.114208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240aaf55-593f-4f7e-ae0c-f8c6b05d115a None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:33.114715 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240aaf55-593f-4f7e-ae0c-f8c6b05d115a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:33.196738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240aaf55-593f-4f7e-ae0c-f8c6b05d115a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:33.198662 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240aaf55-593f-4f7e-ae0c-f8c6b05d115a None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:33.320569 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 81/162] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:10:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:10:33.326695 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321962f-fdbf-4377-8de9-0189b08934f3 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:33.480005 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321962f-fdbf-4377-8de9-0189b08934f3 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:33.527448 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1296fe3-20a3-4bc4-9c13-349313194607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:33.528358 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1296fe3-20a3-4bc4-9c13-349313194607 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:33.528640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1296fe3-20a3-4bc4-9c13-349313194607 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:33.528913 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1296fe3-20a3-4bc4-9c13-349313194607 None admin] PATH_INFO: `/v3/projects/e66c9a82caa04ffb8ac50780877086d0` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:33.530156 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1296fe3-20a3-4bc4-9c13-349313194607 None admin] RBAC: Authorizing `identity:get_project(project_id=e66c9a82caa04ffb8ac50780877086d0)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:33.531620 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1296fe3-20a3-4bc4-9c13-349313194607 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:33.533658 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 82/163] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:33 2022] GET /identity/v3/projects/e66c9a82caa04ffb8ac50780877086d0 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:33.540023 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240aaf55-593f-4f7e-ae0c-f8c6b05d115a None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:33.656097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240aaf55-593f-4f7e-ae0c-f8c6b05d115a None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:33.695448 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7fbdd-bc88-4cae-b532-e0b20968c9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:33.696131 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7fbdd-bc88-4cae-b532-e0b20968c9db None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:33.696437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7fbdd-bc88-4cae-b532-e0b20968c9db None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:33.696709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7fbdd-bc88-4cae-b532-e0b20968c9db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:33.697574 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7fbdd-bc88-4cae-b532-e0b20968c9db None admin] RBAC: Adding query filter params (role.id=6576d9225a0946de877f527e3d15db05, scope.project.id=e66c9a82caa04ffb8ac50780877086d0, user.id=287e51b57d25435ca49c14e1a5f9c328) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:33.697882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7fbdd-bc88-4cae-b532-e0b20968c9db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:33.699368 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7fbdd-bc88-4cae-b532-e0b20968c9db None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:33.709668 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 82/164] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:10:33 2022] GET /identity/v3/role_assignments?user.id=287e51b57d25435ca49c14e1a5f9c328&scope.project.id=e66c9a82caa04ffb8ac50780877086d0&role.id=6576d9225a0946de877f527e3d15db05 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:33.932980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011578a-809a-4ce9-b112-acf07a996b15 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:33.933361 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011578a-809a-4ce9-b112-acf07a996b15 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:33.933530 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011578a-809a-4ce9-b112-acf07a996b15 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:33.935264 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 83/165] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:33.951692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4800d4-8d13-4320-894c-bc164c7ef8d7 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:33.952365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4800d4-8d13-4320-894c-bc164c7ef8d7 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:33.952365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4800d4-8d13-4320-894c-bc164c7ef8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:33.981575 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-6e4800d4-8d13-4320-894c-bc164c7ef8d7 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:33.982914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-6e4800d4-8d13-4320-894c-bc164c7ef8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:34.132671 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 83/166] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:34.178448 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011578a-809a-4ce9-b112-acf07a996b15 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:34.338540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011578a-809a-4ce9-b112-acf07a996b15 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:34.383027 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c980b73-2a04-4903-bbe5-a0a0f15ea21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:34.384541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c980b73-2a04-4903-bbe5-a0a0f15ea21d None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:34.385040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c980b73-2a04-4903-bbe5-a0a0f15ea21d None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:34.385519 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c980b73-2a04-4903-bbe5-a0a0f15ea21d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:34.409635 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c980b73-2a04-4903-bbe5-a0a0f15ea21d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:34.419607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-8c980b73-2a04-4903-bbe5-a0a0f15ea21d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:10:34.419607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:34.419607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:34.419607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:34.419607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:34.419607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:34.419607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:34.419607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:34.419607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:34.419607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:34.419607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:34.419607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:34.419607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:34.419607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:34.419607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:34.419607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:34.420601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:34.420601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:34.420601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:34.420601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:34.420601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:34.420601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:34.420601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:34.420601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:34.420601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:34.420601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:34.420601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:34.420601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:10:34.420601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:34.420601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:34.420601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:34.420601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:34.421453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:34.421453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:34.421453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:34.421453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:34.421453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:34.421453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:34.421453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:34.421453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:34.421453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:34.421453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:34.421453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:10:34.421453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:10:34.424113 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 84/167] 10.222.0.71 () {56 vars in 1114 bytes} [Mon May 16 20:10:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:34.432407 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4800d4-8d13-4320-894c-bc164c7ef8d7 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:34.667096 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4800d4-8d13-4320-894c-bc164c7ef8d7 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:34.737948 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe39b4-11cf-416b-a0df-37d41e2840c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:34.739606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe39b4-11cf-416b-a0df-37d41e2840c5 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:34.740097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe39b4-11cf-416b-a0df-37d41e2840c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:34.740619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe39b4-11cf-416b-a0df-37d41e2840c5 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:34.742078 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe39b4-11cf-416b-a0df-37d41e2840c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:34.742639 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe39b4-11cf-416b-a0df-37d41e2840c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:34.745313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe39b4-11cf-416b-a0df-37d41e2840c5 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:34.759688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a67f6e-9474-4257-85ef-3413f67b9d12 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:34.760364 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a67f6e-9474-4257-85ef-3413f67b9d12 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:34.760877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a67f6e-9474-4257-85ef-3413f67b9d12 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:34.762841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 85/168] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:34.767531 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 84/169] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:10:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:34.769517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2089472-4260-4b6e-9691-e1d2bc99ceea None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:34.770585 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2089472-4260-4b6e-9691-e1d2bc99ceea None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:34.771351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2089472-4260-4b6e-9691-e1d2bc99ceea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:34.780576 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe39b4-11cf-416b-a0df-37d41e2840c5 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:34.803564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-c2089472-4260-4b6e-9691-e1d2bc99ceea None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:34.805376 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-c2089472-4260-4b6e-9691-e1d2bc99ceea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:35.003195 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe39b4-11cf-416b-a0df-37d41e2840c5 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:35.026280 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 86/170] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:35.093207 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a45494-eb49-4107-9c3c-672316768035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:35.094130 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a45494-eb49-4107-9c3c-672316768035 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:35.094419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a45494-eb49-4107-9c3c-672316768035 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:35.094697 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a45494-eb49-4107-9c3c-672316768035 None admin] PATH_INFO: `/v3/users/485b8697788141cb873e8d65a1b6b4cc` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:35.096482 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a45494-eb49-4107-9c3c-672316768035 None admin] RBAC: Authorizing `identity:get_user(user_id=485b8697788141cb873e8d65a1b6b4cc)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:35.098471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2089472-4260-4b6e-9691-e1d2bc99ceea None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:35.098737 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a45494-eb49-4107-9c3c-672316768035 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:35.101233 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 85/171] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:34 2022] GET /identity/v3/users/485b8697788141cb873e8d65a1b6b4cc => generated 275 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:35.107015 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a45494-eb49-4107-9c3c-672316768035 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:35.269111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a45494-eb49-4107-9c3c-672316768035 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:35.350449 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a89833-dd39-4c07-a298-0695139b22fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:35.351556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a89833-dd39-4c07-a298-0695139b22fa None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:35.351969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a89833-dd39-4c07-a298-0695139b22fa None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:35.352488 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a89833-dd39-4c07-a298-0695139b22fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:35.383843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2089472-4260-4b6e-9691-e1d2bc99ceea None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:35.445569 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21805f9-c53a-4dc1-a030-7f6dc2af8be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:35.446393 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21805f9-c53a-4dc1-a030-7f6dc2af8be9 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:35.446672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21805f9-c53a-4dc1-a030-7f6dc2af8be9 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:35.447689 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21805f9-c53a-4dc1-a030-7f6dc2af8be9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:35.467766 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21805f9-c53a-4dc1-a030-7f6dc2af8be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:35.483879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-d21805f9-c53a-4dc1-a030-7f6dc2af8be9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:10:35.483879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:35.483879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:35.483879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:35.483879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:35.483879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:35.483879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:35.483879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:35.483879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:35.483879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:35.483879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:35.483879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:35.483879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:35.483879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:35.483879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:35.483879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:35.484947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:35.484947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:35.484947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:35.484947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:35.484947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:35.484947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:35.484947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:35.484947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:35.484947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:35.484947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:35.484947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:35.484947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:10:35.484947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:35.484947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:35.484947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:35.484947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:35.485878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:35.485878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:35.485878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:35.485878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:35.485878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:35.485878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:35.485878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:35.485878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:35.485878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:35.485878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:35.485878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:10:35.485878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:10:35.486810 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 87/172] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:35.496890 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21805f9-c53a-4dc1-a030-7f6dc2af8be9 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:35.519636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a89833-dd39-4c07-a298-0695139b22fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:35.522172 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a89833-dd39-4c07-a298-0695139b22fa None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:35.668694 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21805f9-c53a-4dc1-a030-7f6dc2af8be9 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:35.727202 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c3fc5-bcd3-4f26-bd91-9c3ea59c7aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:35.728361 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c3fc5-bcd3-4f26-bd91-9c3ea59c7aff None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:35.728845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c3fc5-bcd3-4f26-bd91-9c3ea59c7aff None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:35.729333 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c3fc5-bcd3-4f26-bd91-9c3ea59c7aff None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:35.730711 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c3fc5-bcd3-4f26-bd91-9c3ea59c7aff None admin] RBAC: Adding query filter params (name=member) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:35.731192 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c3fc5-bcd3-4f26-bd91-9c3ea59c7aff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:35.733638 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c3fc5-bcd3-4f26-bd91-9c3ea59c7aff None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:35.737368 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 86/173] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:10:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 20:10:35.738935 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cbea8-1d0a-4733-a6b9-31b7139108ac None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:35.739224 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cbea8-1d0a-4733-a6b9-31b7139108ac None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:35.739506 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cbea8-1d0a-4733-a6b9-31b7139108ac None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:35.743290 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 87/174] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:35.746237 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cbea8-1d0a-4733-a6b9-31b7139108ac None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:35.749596 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 88/175] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:10:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:35.751854 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba260bba-b19f-4155-bb94-b6e4733b0937 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:35.756991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba260bba-b19f-4155-bb94-b6e4733b0937 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:35.757351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba260bba-b19f-4155-bb94-b6e4733b0937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:35.775549 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-ba260bba-b19f-4155-bb94-b6e4733b0937 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:35.776710 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-ba260bba-b19f-4155-bb94-b6e4733b0937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:35.856712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cbea8-1d0a-4733-a6b9-31b7139108ac None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:35.867453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 89/176] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:35.869041 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba260bba-b19f-4155-bb94-b6e4733b0937 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:35.925331 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce937af4-ee86-4e10-9370-e48d777327a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:35.926490 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce937af4-ee86-4e10-9370-e48d777327a3 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:35.926840 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce937af4-ee86-4e10-9370-e48d777327a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:35.927251 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce937af4-ee86-4e10-9370-e48d777327a3 None admin] PATH_INFO: `/v3/projects/e66c9a82caa04ffb8ac50780877086d0` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:35.929690 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce937af4-ee86-4e10-9370-e48d777327a3 None admin] RBAC: Authorizing `identity:get_project(project_id=e66c9a82caa04ffb8ac50780877086d0)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:35.931256 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce937af4-ee86-4e10-9370-e48d777327a3 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:35.934806 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 88/177] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:35 2022] GET /identity/v3/projects/e66c9a82caa04ffb8ac50780877086d0 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:35.944193 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576aae5a-635b-4195-84ad-4c105661af5d None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:35.944193 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576aae5a-635b-4195-84ad-4c105661af5d None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:35.944193 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576aae5a-635b-4195-84ad-4c105661af5d None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:35.944193 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 89/178] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:35.944193 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576aae5a-635b-4195-84ad-4c105661af5d None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:36.033791 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba260bba-b19f-4155-bb94-b6e4733b0937 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:36.069614 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576aae5a-635b-4195-84ad-4c105661af5d None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:36.080458 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6e3da-1de4-47a1-a045-e56de713e734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:36.081446 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6e3da-1de4-47a1-a045-e56de713e734 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:36.081730 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6e3da-1de4-47a1-a045-e56de713e734 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:36.082002 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6e3da-1de4-47a1-a045-e56de713e734 None admin] PATH_INFO: `/v3/users/485b8697788141cb873e8d65a1b6b4cc` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:36.084218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6e3da-1de4-47a1-a045-e56de713e734 None admin] RBAC: Authorizing `identity:get_user(user_id=485b8697788141cb873e8d65a1b6b4cc)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:36.085728 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6e3da-1de4-47a1-a045-e56de713e734 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:36.088417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 90/179] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:35 2022] GET /identity/v3/users/485b8697788141cb873e8d65a1b6b4cc => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:36.089205 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6e3da-1de4-47a1-a045-e56de713e734 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:36.118469 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a79a96-d09f-4af3-be58-f5065af4d19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:36.119207 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a79a96-d09f-4af3-be58-f5065af4d19b None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:36.119486 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a79a96-d09f-4af3-be58-f5065af4d19b None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:36.119763 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a79a96-d09f-4af3-be58-f5065af4d19b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:36.132367 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a79a96-d09f-4af3-be58-f5065af4d19b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:36.141346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-65a79a96-d09f-4af3-be58-f5065af4d19b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:10:36.141346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:36.141346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:36.141346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:36.141346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:36.141346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:36.141346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:36.141346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:36.141346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:36.141346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:36.141346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:36.141346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:36.141346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:36.141346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:36.141346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:36.141346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:36.142409 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:36.142409 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:36.142409 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:36.142409 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:36.142409 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:36.142409 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:36.142409 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:36.142409 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:36.142409 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:36.142409 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:36.142409 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:36.142409 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:10:36.142409 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:36.142409 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:36.142409 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:36.142409 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:36.143308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:36.143308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:36.143308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:36.143308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:36.143308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:36.143308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:36.143308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:36.143308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:36.143308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:36.143308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:36.143308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:10:36.143308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:10:36.143308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 90/180] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:10:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:36.149174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476afb35-9e3f-4a36-99b5-30bca02e8584 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:36.149174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476afb35-9e3f-4a36-99b5-30bca02e8584 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:36.149174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476afb35-9e3f-4a36-99b5-30bca02e8584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:36.166789 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-476afb35-9e3f-4a36-99b5-30bca02e8584 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:36.167998 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-476afb35-9e3f-4a36-99b5-30bca02e8584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:36.206742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6e3da-1de4-47a1-a045-e56de713e734 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:36.246249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b444a25-daac-40ff-b246-19bcb1579da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:36.247313 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b444a25-daac-40ff-b246-19bcb1579da7 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:36.247780 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b444a25-daac-40ff-b246-19bcb1579da7 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:36.248274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b444a25-daac-40ff-b246-19bcb1579da7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:36.249650 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 91/181] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:36.250191 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b444a25-daac-40ff-b246-19bcb1579da7 None admin] RBAC: Adding query filter params (role.id=140f30ce618745eea43e96b91df3bbab, scope.project.id=e66c9a82caa04ffb8ac50780877086d0, user.id=485b8697788141cb873e8d65a1b6b4cc) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:36.250777 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b444a25-daac-40ff-b246-19bcb1579da7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:36.250873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476afb35-9e3f-4a36-99b5-30bca02e8584 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:36.253341 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b444a25-daac-40ff-b246-19bcb1579da7 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:36.264652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 91/182] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:10:36 2022] GET /identity/v3/role_assignments?user.id=485b8697788141cb873e8d65a1b6b4cc&scope.project.id=e66c9a82caa04ffb8ac50780877086d0&role.id=140f30ce618745eea43e96b91df3bbab => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:36.267398 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93139da0-395e-4f3a-8fab-a0e37743114d None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:36.268318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93139da0-395e-4f3a-8fab-a0e37743114d None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:36.268453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93139da0-395e-4f3a-8fab-a0e37743114d None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:36.273414 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 92/183] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:36.274203 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93139da0-395e-4f3a-8fab-a0e37743114d None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:36.400109 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476afb35-9e3f-4a36-99b5-30bca02e8584 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:36.437542 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93139da0-395e-4f3a-8fab-a0e37743114d None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:36.440211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92930b98-ff96-4132-9558-e4c0a457ee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:36.440870 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92930b98-ff96-4132-9558-e4c0a457ee05 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:36.441145 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92930b98-ff96-4132-9558-e4c0a457ee05 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:36.441424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92930b98-ff96-4132-9558-e4c0a457ee05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:36.492013 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1957a7-6651-42b5-b6d5-7d9936ab83b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:36.492741 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1957a7-6651-42b5-b6d5-7d9936ab83b7 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:36.493018 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1957a7-6651-42b5-b6d5-7d9936ab83b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:36.493292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1957a7-6651-42b5-b6d5-7d9936ab83b7 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:36.494114 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1957a7-6651-42b5-b6d5-7d9936ab83b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:36.494420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1957a7-6651-42b5-b6d5-7d9936ab83b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:36.495938 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1957a7-6651-42b5-b6d5-7d9936ab83b7 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:36.512595 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 93/184] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:36.512595 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d8b40-05e8-41e8-a627-0271a16babde None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:36.512595 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d8b40-05e8-41e8-a627-0271a16babde None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:36.512595 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d8b40-05e8-41e8-a627-0271a16babde None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:36.512595 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 94/185] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:36.512595 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d8b40-05e8-41e8-a627-0271a16babde None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:36.538135 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92930b98-ff96-4132-9558-e4c0a457ee05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:36.539656 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92930b98-ff96-4132-9558-e4c0a457ee05 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:36.664552 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d8b40-05e8-41e8-a627-0271a16babde None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:36.680289 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 92/186] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:10:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:10:36.680289 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60dffc-1262-49df-926f-ed00cf31ab5e None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:36.680289 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60dffc-1262-49df-926f-ed00cf31ab5e None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:36.680289 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60dffc-1262-49df-926f-ed00cf31ab5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:36.699521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-1f60dffc-1262-49df-926f-ed00cf31ab5e None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:36.700765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-1f60dffc-1262-49df-926f-ed00cf31ab5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:36.703591 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21783db5-ac1e-4b03-bb0e-664e780827d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:36.704434 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21783db5-ac1e-4b03-bb0e-664e780827d6 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:36.704713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21783db5-ac1e-4b03-bb0e-664e780827d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:36.704986 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21783db5-ac1e-4b03-bb0e-664e780827d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:36.706931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21783db5-ac1e-4b03-bb0e-664e780827d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:36.709529 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21783db5-ac1e-4b03-bb0e-664e780827d6 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:36.711786 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 95/187] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:10:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:36.713145 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21783db5-ac1e-4b03-bb0e-664e780827d6 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:36.778462 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 93/188] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:36.780600 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66bdf5-5055-48aa-9d55-203b88317391 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:36.780878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66bdf5-5055-48aa-9d55-203b88317391 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:36.781152 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66bdf5-5055-48aa-9d55-203b88317391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:36.805199 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-6b66bdf5-5055-48aa-9d55-203b88317391 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:36.806505 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-6b66bdf5-5055-48aa-9d55-203b88317391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:36.827525 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21783db5-ac1e-4b03-bb0e-664e780827d6 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:36.862842 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e0d38-0841-4779-bbe1-032e4f2906b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:36.863759 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e0d38-0841-4779-bbe1-032e4f2906b0 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:36.864037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e0d38-0841-4779-bbe1-032e4f2906b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:36.864383 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e0d38-0841-4779-bbe1-032e4f2906b0 None admin] PATH_INFO: `/v3/users/527e6fdf5d2444ce84c29a27ab86db3d` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:36.880375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e0d38-0841-4779-bbe1-032e4f2906b0 None admin] RBAC: Authorizing `identity:get_user(user_id=527e6fdf5d2444ce84c29a27ab86db3d)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:36.881771 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e0d38-0841-4779-bbe1-032e4f2906b0 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:36.883126 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 94/189] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:36.883872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 96/190] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:36 2022] GET /identity/v3/users/527e6fdf5d2444ce84c29a27ab86db3d => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:36.883984 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66bdf5-5055-48aa-9d55-203b88317391 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:36.884234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e0d38-0841-4779-bbe1-032e4f2906b0 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:36.997693 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e0d38-0841-4779-bbe1-032e4f2906b0 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:36.997971 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66bdf5-5055-48aa-9d55-203b88317391 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:37.037805 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd9621-7bdc-4365-adba-1a27d312ae65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:37.038147 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdcd4c-9c46-49b9-ad85-17861d7f1dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:37.038680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd9621-7bdc-4365-adba-1a27d312ae65 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:37.038958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd9621-7bdc-4365-adba-1a27d312ae65 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:37.039149 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdcd4c-9c46-49b9-ad85-17861d7f1dfa None admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:37.039378 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd9621-7bdc-4365-adba-1a27d312ae65 None admin] PATH_INFO: `/v3/projects/2464bf71255c4c6ca98665b836a2908c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:37.039604 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdcd4c-9c46-49b9-ad85-17861d7f1dfa None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:37.039972 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdcd4c-9c46-49b9-ad85-17861d7f1dfa None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:37.040822 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd9621-7bdc-4365-adba-1a27d312ae65 None admin] RBAC: Authorizing `identity:get_project(project_id=2464bf71255c4c6ca98665b836a2908c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:37.040962 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdcd4c-9c46-49b9-ad85-17861d7f1dfa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:37.042313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd9621-7bdc-4365-adba-1a27d312ae65 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:37.042537 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdcd4c-9c46-49b9-ad85-17861d7f1dfa None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:37.044071 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 95/191] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:36 2022] GET /identity/v3/projects/2464bf71255c4c6ca98665b836a2908c => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:37.044889 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd9621-7bdc-4365-adba-1a27d312ae65 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:37.065606 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 97/192] 10.222.0.71 () {60 vars in 1132 bytes} [Mon May 16 20:10:36 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:10:37.080399 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdcd4c-9c46-49b9-ad85-17861d7f1dfa None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:37.216955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd9621-7bdc-4365-adba-1a27d312ae65 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:37.243666 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdcd4c-9c46-49b9-ad85-17861d7f1dfa None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:37.277107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a5d1b-3b79-4cb0-b918-8d57d54ce096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:37.277642 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a5d1b-3b79-4cb0-b918-8d57d54ce096 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:37.277940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a5d1b-3b79-4cb0-b918-8d57d54ce096 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:37.278204 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a5d1b-3b79-4cb0-b918-8d57d54ce096 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:37.292364 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a5d1b-3b79-4cb0-b918-8d57d54ce096 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:37.301953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-504a5d1b-3b79-4cb0-b918-8d57d54ce096 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:10:37.301953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:37.301953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:37.301953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:37.301953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:37.301953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:37.301953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:37.301953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:37.301953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:37.301953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:37.301953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:37.301953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:37.301953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:37.301953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:37.301953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:37.301953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:37.303707 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:37.303707 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:37.303707 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:37.303707 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:37.303707 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:37.303707 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:37.303707 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:37.303707 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:37.303707 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:37.303707 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:37.303707 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:37.303707 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:10:37.303707 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:37.303707 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:37.303707 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:37.303707 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:37.305395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:37.305395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:37.305395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:37.305395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:37.305395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:37.305395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:37.305395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:37.305395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:37.305395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:37.305395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:37.305395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:10:37.305395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:10:37.305395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 96/193] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:37.305395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a5d1b-3b79-4cb0-b918-8d57d54ce096 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:37.314398 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f7e95-65d4-408b-a1f0-bfc3e5e09fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:37.315588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f7e95-65d4-408b-a1f0-bfc3e5e09fc5 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:37.316042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f7e95-65d4-408b-a1f0-bfc3e5e09fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:37.318034 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f7e95-65d4-408b-a1f0-bfc3e5e09fc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:37.425628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f7e95-65d4-408b-a1f0-bfc3e5e09fc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:37.427746 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f7e95-65d4-408b-a1f0-bfc3e5e09fc5 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:37.460523 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a5d1b-3b79-4cb0-b918-8d57d54ce096 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:37.509080 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7163e5-0fac-4335-9f6f-74604a42a6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:37.510472 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7163e5-0fac-4335-9f6f-74604a42a6a4 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:37.513057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7163e5-0fac-4335-9f6f-74604a42a6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:37.513057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7163e5-0fac-4335-9f6f-74604a42a6a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:37.535830 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7163e5-0fac-4335-9f6f-74604a42a6a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:37.552721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-5c7163e5-0fac-4335-9f6f-74604a42a6a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:10:37.552721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:37.552721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:37.552721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:37.552721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:37.552721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:37.552721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:37.552721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:37.552721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:37.552721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:37.552721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:37.552721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:37.552721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:37.552721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:37.552721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:37.552721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:37.553771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:37.553771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:37.553771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:37.553771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:37.553771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:37.553771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:37.553771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:37.553771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:37.553771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:37.553771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:37.553771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:37.553771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:10:37.553771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:37.553771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:37.553771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:37.553771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:37.554647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:37.554647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:37.554647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:37.554647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:37.554647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:37.554647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:37.554647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:37.554647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:37.554647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:37.554647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:37.554647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:10:37.554647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:10:37.555437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 97/194] 10.222.0.71 () {56 vars in 1114 bytes} [Mon May 16 20:10:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:37.557787 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7163e5-0fac-4335-9f6f-74604a42a6a4 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:37.616514 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 98/195] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:10:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:10:37.618360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f7e95-65d4-408b-a1f0-bfc3e5e09fc5 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:37.744017 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7163e5-0fac-4335-9f6f-74604a42a6a4 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:37.746522 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f7e95-65d4-408b-a1f0-bfc3e5e09fc5 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:37.787588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44337e-ecbc-4bba-82fa-43ea3e0fca6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:37.788393 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44337e-ecbc-4bba-82fa-43ea3e0fca6e None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:37.788785 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44337e-ecbc-4bba-82fa-43ea3e0fca6e None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:37.789168 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44337e-ecbc-4bba-82fa-43ea3e0fca6e None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:37.790050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44337e-ecbc-4bba-82fa-43ea3e0fca6e None admin] RBAC: Adding query filter params (name=reader) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:37.790468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44337e-ecbc-4bba-82fa-43ea3e0fca6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:37.792033 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44337e-ecbc-4bba-82fa-43ea3e0fca6e None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:37.803050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 99/196] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:10:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:37.803740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44337e-ecbc-4bba-82fa-43ea3e0fca6e None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:37.810018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2b91e-eab1-4432-b5b7-968b9d76ba97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:37.811205 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2b91e-eab1-4432-b5b7-968b9d76ba97 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:37.811789 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2b91e-eab1-4432-b5b7-968b9d76ba97 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:37.812333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2b91e-eab1-4432-b5b7-968b9d76ba97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:37.813986 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2b91e-eab1-4432-b5b7-968b9d76ba97 None admin] RBAC: Adding query filter params (role.id=99462c05ed484212893d40128c99f47c, scope.project.id=2464bf71255c4c6ca98665b836a2908c, user.id=485b8697788141cb873e8d65a1b6b4cc) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:37.814559 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2b91e-eab1-4432-b5b7-968b9d76ba97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:37.817603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2b91e-eab1-4432-b5b7-968b9d76ba97 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:37.829086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 98/197] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:10:37 2022] GET /identity/v3/role_assignments?user.id=485b8697788141cb873e8d65a1b6b4cc&scope.project.id=2464bf71255c4c6ca98665b836a2908c&role.id=99462c05ed484212893d40128c99f47c => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:37.830764 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2b91e-eab1-4432-b5b7-968b9d76ba97 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:37.925432 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44337e-ecbc-4bba-82fa-43ea3e0fca6e None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:37.970390 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13e21c-74dd-4463-aa75-cfe7d2b72ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:37.971098 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13e21c-74dd-4463-aa75-cfe7d2b72ca2 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:37.971377 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13e21c-74dd-4463-aa75-cfe7d2b72ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:37.971648 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13e21c-74dd-4463-aa75-cfe7d2b72ca2 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:37.972816 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13e21c-74dd-4463-aa75-cfe7d2b72ca2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:37.973215 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13e21c-74dd-4463-aa75-cfe7d2b72ca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:37.974664 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13e21c-74dd-4463-aa75-cfe7d2b72ca2 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:37.999113 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 100/198] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:10:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:38.000208 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13e21c-74dd-4463-aa75-cfe7d2b72ca2 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:38.095907 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2b91e-eab1-4432-b5b7-968b9d76ba97 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:38.132597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13e21c-74dd-4463-aa75-cfe7d2b72ca2 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:38.154023 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3eae1-9f66-4d84-a07f-d4921371ee35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:38.154936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3eae1-9f66-4d84-a07f-d4921371ee35 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:38.156139 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3eae1-9f66-4d84-a07f-d4921371ee35 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:38.156465 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3eae1-9f66-4d84-a07f-d4921371ee35 None admin] PATH_INFO: `/v3/projects/ff00118a162648a38b9438404dd67916` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:38.157869 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3eae1-9f66-4d84-a07f-d4921371ee35 None admin] RBAC: Authorizing `identity:get_project(project_id=ff00118a162648a38b9438404dd67916)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:38.164382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3eae1-9f66-4d84-a07f-d4921371ee35 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:38.167621 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 99/199] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:37 2022] GET /identity/v3/projects/ff00118a162648a38b9438404dd67916 => generated 302 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:38.168534 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3eae1-9f66-4d84-a07f-d4921371ee35 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:38.187322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a77d5-0ef2-4b32-a372-d9aa9d2418b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:38.188284 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a77d5-0ef2-4b32-a372-d9aa9d2418b6 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:38.188614 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a77d5-0ef2-4b32-a372-d9aa9d2418b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:38.188895 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a77d5-0ef2-4b32-a372-d9aa9d2418b6 None admin] PATH_INFO: `/v3/users/6c11474ef23a44958140ea5c60a802d2` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:38.190227 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a77d5-0ef2-4b32-a372-d9aa9d2418b6 None admin] RBAC: Authorizing `identity:get_user(user_id=6c11474ef23a44958140ea5c60a802d2)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:38.191739 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a77d5-0ef2-4b32-a372-d9aa9d2418b6 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:38.199129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 101/200] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:37 2022] GET /identity/v3/users/6c11474ef23a44958140ea5c60a802d2 => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:38.200099 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a77d5-0ef2-4b32-a372-d9aa9d2418b6 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:38.303650 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3eae1-9f66-4d84-a07f-d4921371ee35 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:38.333997 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a77d5-0ef2-4b32-a372-d9aa9d2418b6 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:38.341773 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5cc2a-41fe-4460-8f02-1e29d6da02f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:38.342669 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5cc2a-41fe-4460-8f02-1e29d6da02f1 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:38.342946 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5cc2a-41fe-4460-8f02-1e29d6da02f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:38.343217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5cc2a-41fe-4460-8f02-1e29d6da02f1 None admin] PATH_INFO: `/v3/users/527e6fdf5d2444ce84c29a27ab86db3d` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:38.345055 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5cc2a-41fe-4460-8f02-1e29d6da02f1 None admin] RBAC: Authorizing `identity:get_user(user_id=527e6fdf5d2444ce84c29a27ab86db3d)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:38.346719 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5cc2a-41fe-4460-8f02-1e29d6da02f1 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:38.349127 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 100/201] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:38 2022] GET /identity/v3/users/527e6fdf5d2444ce84c29a27ab86db3d => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:38.350162 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5cc2a-41fe-4460-8f02-1e29d6da02f1 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:38.378190 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285b45f-3940-40ca-a086-6cac193fa580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:38.379528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285b45f-3940-40ca-a086-6cac193fa580 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:38.379731 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285b45f-3940-40ca-a086-6cac193fa580 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:38.379997 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285b45f-3940-40ca-a086-6cac193fa580 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:38.380878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285b45f-3940-40ca-a086-6cac193fa580 None admin] RBAC: Adding query filter params (role.id=6576d9225a0946de877f527e3d15db05, scope.project.id=ff00118a162648a38b9438404dd67916, user.id=527e6fdf5d2444ce84c29a27ab86db3d) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:38.381185 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285b45f-3940-40ca-a086-6cac193fa580 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:38.382649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285b45f-3940-40ca-a086-6cac193fa580 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:38.388715 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 102/202] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:10:38 2022] GET /identity/v3/role_assignments?user.id=527e6fdf5d2444ce84c29a27ab86db3d&scope.project.id=ff00118a162648a38b9438404dd67916&role.id=6576d9225a0946de877f527e3d15db05 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:38.389575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285b45f-3940-40ca-a086-6cac193fa580 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:38.515822 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285b45f-3940-40ca-a086-6cac193fa580 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:38.553219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5cc2a-41fe-4460-8f02-1e29d6da02f1 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:38.554068 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb6c3e-653a-47fc-9358-48a71df2358c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:38.554737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb6c3e-653a-47fc-9358-48a71df2358c None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:38.555015 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb6c3e-653a-47fc-9358-48a71df2358c None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:38.555291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb6c3e-653a-47fc-9358-48a71df2358c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:38.619250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bea47f-ca7e-4fca-9897-591c94490270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:38.620342 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bea47f-ca7e-4fca-9897-591c94490270 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:38.620871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bea47f-ca7e-4fca-9897-591c94490270 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:38.621186 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bea47f-ca7e-4fca-9897-591c94490270 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:38.634467 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb6c3e-653a-47fc-9358-48a71df2358c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:38.636054 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb6c3e-653a-47fc-9358-48a71df2358c None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:38.729889 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bea47f-ca7e-4fca-9897-591c94490270 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:38.731407 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bea47f-ca7e-4fca-9897-591c94490270 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:38.791805 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 103/203] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:10:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:10:38.801662 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb6c3e-653a-47fc-9358-48a71df2358c None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:38.892812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 101/204] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:10:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:10:38.898523 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bea47f-ca7e-4fca-9897-591c94490270 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:38.924198 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb6c3e-653a-47fc-9358-48a71df2358c None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:38.974759 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59903223-26be-4c8b-8185-0d0d085a3a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:38.976265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59903223-26be-4c8b-8185-0d0d085a3a85 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:38.976768 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59903223-26be-4c8b-8185-0d0d085a3a85 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:38.977254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59903223-26be-4c8b-8185-0d0d085a3a85 None admin] PATH_INFO: `/v3/projects/ff00118a162648a38b9438404dd67916` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:38.979384 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59903223-26be-4c8b-8185-0d0d085a3a85 None admin] RBAC: Authorizing `identity:get_project(project_id=ff00118a162648a38b9438404dd67916)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:38.982202 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59903223-26be-4c8b-8185-0d0d085a3a85 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:38.985604 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 104/205] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:38 2022] GET /identity/v3/projects/ff00118a162648a38b9438404dd67916 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:38.995646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59903223-26be-4c8b-8185-0d0d085a3a85 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:39.088532 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bea47f-ca7e-4fca-9897-591c94490270 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:39.152554 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256626bc-3ba4-4862-a831-1c0fc3a55e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:39.154130 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256626bc-3ba4-4862-a831-1c0fc3a55e5a None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:39.154630 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256626bc-3ba4-4862-a831-1c0fc3a55e5a None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:39.155113 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256626bc-3ba4-4862-a831-1c0fc3a55e5a None admin] PATH_INFO: `/v3/projects/e66c9a82caa04ffb8ac50780877086d0` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:39.157322 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256626bc-3ba4-4862-a831-1c0fc3a55e5a None admin] RBAC: Authorizing `identity:get_project(project_id=e66c9a82caa04ffb8ac50780877086d0)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:39.160013 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256626bc-3ba4-4862-a831-1c0fc3a55e5a None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:39.170139 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 102/206] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:38 2022] GET /identity/v3/projects/e66c9a82caa04ffb8ac50780877086d0 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:39.174737 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256626bc-3ba4-4862-a831-1c0fc3a55e5a None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:39.246652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59903223-26be-4c8b-8185-0d0d085a3a85 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:39.348922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be90309-954c-425b-9fef-d9bbbc486ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:39.350018 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be90309-954c-425b-9fef-d9bbbc486ca6 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:39.350501 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be90309-954c-425b-9fef-d9bbbc486ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:39.351070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be90309-954c-425b-9fef-d9bbbc486ca6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:39.352820 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be90309-954c-425b-9fef-d9bbbc486ca6 None admin] RBAC: Adding query filter params (role.id=140f30ce618745eea43e96b91df3bbab, scope.project.id=ff00118a162648a38b9438404dd67916, user.id=527e6fdf5d2444ce84c29a27ab86db3d) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:39.353369 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be90309-954c-425b-9fef-d9bbbc486ca6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:39.359971 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be90309-954c-425b-9fef-d9bbbc486ca6 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:39.381509 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 105/207] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:10:38 2022] GET /identity/v3/role_assignments?user.id=527e6fdf5d2444ce84c29a27ab86db3d&scope.project.id=ff00118a162648a38b9438404dd67916&role.id=140f30ce618745eea43e96b91df3bbab => generated 259 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:39.413282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256626bc-3ba4-4862-a831-1c0fc3a55e5a None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:39.474313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333934b-aea3-452d-8a14-69190108a185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:39.474882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333934b-aea3-452d-8a14-69190108a185 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:39.475371 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333934b-aea3-452d-8a14-69190108a185 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:39.475857 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333934b-aea3-452d-8a14-69190108a185 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:39.477513 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333934b-aea3-452d-8a14-69190108a185 None admin] RBAC: Adding query filter params (role.id=f7d1ff112a024e3190daa30a7814e054, scope.project.id=e66c9a82caa04ffb8ac50780877086d0, user.id=6c11474ef23a44958140ea5c60a802d2) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:39.478061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333934b-aea3-452d-8a14-69190108a185 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:39.480927 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333934b-aea3-452d-8a14-69190108a185 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:39.491320 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 103/208] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:10:39 2022] GET /identity/v3/role_assignments?user.id=6c11474ef23a44958140ea5c60a802d2&scope.project.id=e66c9a82caa04ffb8ac50780877086d0&role.id=f7d1ff112a024e3190daa30a7814e054 => generated 608 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:40.038241 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcff29-907c-4884-b58a-e69634026157 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:40.038775 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcff29-907c-4884-b58a-e69634026157 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:40.039224 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcff29-907c-4884-b58a-e69634026157 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:40.041924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 106/209] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:40.049028 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090d3a1-a372-4f7c-a935-1b9b36d521b0 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:40.049511 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090d3a1-a372-4f7c-a935-1b9b36d521b0 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:40.049969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090d3a1-a372-4f7c-a935-1b9b36d521b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:40.080738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-7090d3a1-a372-4f7c-a935-1b9b36d521b0 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:40.082756 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-7090d3a1-a372-4f7c-a935-1b9b36d521b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:40.213962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 104/210] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:40.243457 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcff29-907c-4884-b58a-e69634026157 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:40.349108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b108d1f-f0e7-4946-b3dd-e2e680a5eda7 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:40.349392 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b108d1f-f0e7-4946-b3dd-e2e680a5eda7 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:40.349739 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b108d1f-f0e7-4946-b3dd-e2e680a5eda7 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:40.351272 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 105/211] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:10:40.357371 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89137d5d-6d1b-42a5-b3ba-c93e0b2674c5 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:40.357760 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89137d5d-6d1b-42a5-b3ba-c93e0b2674c5 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:40.357953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89137d5d-6d1b-42a5-b3ba-c93e0b2674c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:40.377811 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-89137d5d-6d1b-42a5-b3ba-c93e0b2674c5 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:40.378773 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-89137d5d-6d1b-42a5-b3ba-c93e0b2674c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:40.464515 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcff29-907c-4884-b58a-e69634026157 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:40.473742 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 106/212] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:10:40.497002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89137d5d-6d1b-42a5-b3ba-c93e0b2674c5 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:40.514546 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0670d7-774d-453e-8c97-251b7e90a362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:40.515540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0670d7-774d-453e-8c97-251b7e90a362 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:40.515892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0670d7-774d-453e-8c97-251b7e90a362 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:40.516196 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0670d7-774d-453e-8c97-251b7e90a362 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:40.517420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0670d7-774d-453e-8c97-251b7e90a362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:40.518909 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0670d7-774d-453e-8c97-251b7e90a362 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:40.520669 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 107/213] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:10:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:40.526352 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0670d7-774d-453e-8c97-251b7e90a362 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:40.639894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0670d7-774d-453e-8c97-251b7e90a362 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:40.640549 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89137d5d-6d1b-42a5-b3ba-c93e0b2674c5 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:40.688881 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed435198-b7ed-4134-97fe-d9b01298e84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:40.689773 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed435198-b7ed-4134-97fe-d9b01298e84e None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:40.690167 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed435198-b7ed-4134-97fe-d9b01298e84e None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:40.690361 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed435198-b7ed-4134-97fe-d9b01298e84e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:40.691067 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141ea39-e660-4a93-9804-f064c21decd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:40.692378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141ea39-e660-4a93-9804-f064c21decd6 None admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:40.692864 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141ea39-e660-4a93-9804-f064c21decd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:40.693296 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141ea39-e660-4a93-9804-f064c21decd6 None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:40.694054 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141ea39-e660-4a93-9804-f064c21decd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:40.695575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141ea39-e660-4a93-9804-f064c21decd6 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:40.718394 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed435198-b7ed-4134-97fe-d9b01298e84e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:40.728189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 108/214] 10.222.0.71 () {60 vars in 1132 bytes} [Mon May 16 20:10:40 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:10:40.744079 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-ed435198-b7ed-4134-97fe-d9b01298e84e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:10:40.744079 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:40.744079 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:40.744079 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:40.744079 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:40.744079 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:40.744079 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:40.744079 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:40.744079 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:40.744079 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:40.744079 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:40.744079 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:40.744079 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:40.744079 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:40.744079 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:40.744079 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:40.745057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:40.745057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:40.745057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:40.745057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:40.745057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:40.745057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:40.745057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:40.745057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:40.745057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:40.745057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:40.745057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:40.745057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:10:40.745057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:40.745057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:40.745057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:40.745057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:40.745819 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:40.745819 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:40.745819 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:40.745819 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:40.745819 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:40.745819 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:40.745819 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:40.745819 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:40.745819 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:40.745819 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:40.745819 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:10:40.745819 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:10:40.746988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 107/215] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:10:40.754539 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141ea39-e660-4a93-9804-f064c21decd6 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:40.896182 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141ea39-e660-4a93-9804-f064c21decd6 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:40.936284 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addcf0b-0ced-4d2e-8283-544b1d5a7266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:40.936982 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addcf0b-0ced-4d2e-8283-544b1d5a7266 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:40.937264 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addcf0b-0ced-4d2e-8283-544b1d5a7266 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:40.937541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addcf0b-0ced-4d2e-8283-544b1d5a7266 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:40.938307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addcf0b-0ced-4d2e-8283-544b1d5a7266 None admin] RBAC: Adding query filter params (name=member) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:40.938611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addcf0b-0ced-4d2e-8283-544b1d5a7266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:40.941198 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addcf0b-0ced-4d2e-8283-544b1d5a7266 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:40.950684 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 109/216] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:10:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:40.959280 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed435198-b7ed-4134-97fe-d9b01298e84e None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:41.081608 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed435198-b7ed-4134-97fe-d9b01298e84e None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:41.123106 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf2a3d-f5fa-45e8-806c-8a5d3c7403ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:41.124010 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf2a3d-f5fa-45e8-806c-8a5d3c7403ab None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:41.124357 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf2a3d-f5fa-45e8-806c-8a5d3c7403ab None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:41.124598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf2a3d-f5fa-45e8-806c-8a5d3c7403ab None admin] PATH_INFO: `/v3/users/e60d9b29780a442aa978a5697cb27bb1` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:41.154149 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf2a3d-f5fa-45e8-806c-8a5d3c7403ab None admin] RBAC: Authorizing `identity:get_user(user_id=e60d9b29780a442aa978a5697cb27bb1)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:41.156237 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf2a3d-f5fa-45e8-806c-8a5d3c7403ab None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:41.159159 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 108/217] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:40 2022] GET /identity/v3/users/e60d9b29780a442aa978a5697cb27bb1 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:41.167340 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addcf0b-0ced-4d2e-8283-544b1d5a7266 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:41.334165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addcf0b-0ced-4d2e-8283-544b1d5a7266 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:41.375738 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ca3bc-baa7-4476-9596-6ca7b097fbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:41.376431 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ca3bc-baa7-4476-9596-6ca7b097fbcf None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:41.376733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ca3bc-baa7-4476-9596-6ca7b097fbcf None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:41.376988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ca3bc-baa7-4476-9596-6ca7b097fbcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:41.481201 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ca3bc-baa7-4476-9596-6ca7b097fbcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:41.483771 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ca3bc-baa7-4476-9596-6ca7b097fbcf None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:41.692584 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 110/218] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:10:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:10:41.698017 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf2a3d-f5fa-45e8-806c-8a5d3c7403ab None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:41.839928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f4380-0069-449a-9344-fc789fd6fb41 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:41.840413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f4380-0069-449a-9344-fc789fd6fb41 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:41.840899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f4380-0069-449a-9344-fc789fd6fb41 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:41.845573 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 111/219] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:41.851509 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d991ca-8370-4189-8388-7081f83d7264 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:41.852132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d991ca-8370-4189-8388-7081f83d7264 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:41.852660 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d991ca-8370-4189-8388-7081f83d7264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:41.882685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-88d991ca-8370-4189-8388-7081f83d7264 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:41.885182 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-88d991ca-8370-4189-8388-7081f83d7264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:41.889836 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf2a3d-f5fa-45e8-806c-8a5d3c7403ab None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:41.966294 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb86217-0e67-4086-8de6-5a5d9d8c2f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:41.967528 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb86217-0e67-4086-8de6-5a5d9d8c2f1c None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:41.968036 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb86217-0e67-4086-8de6-5a5d9d8c2f1c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:41.968565 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb86217-0e67-4086-8de6-5a5d9d8c2f1c None admin] PATH_INFO: `/v3/projects/ff00118a162648a38b9438404dd67916` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:41.977020 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb86217-0e67-4086-8de6-5a5d9d8c2f1c None admin] RBAC: Authorizing `identity:get_project(project_id=ff00118a162648a38b9438404dd67916)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:41.978876 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb86217-0e67-4086-8de6-5a5d9d8c2f1c None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:41.980960 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 109/220] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:41 2022] GET /identity/v3/projects/ff00118a162648a38b9438404dd67916 => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:42.005024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb86217-0e67-4086-8de6-5a5d9d8c2f1c None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:42.037932 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 112/221] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:42.074791 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d991ca-8370-4189-8388-7081f83d7264 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:42.296737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d991ca-8370-4189-8388-7081f83d7264 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:42.306518 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb86217-0e67-4086-8de6-5a5d9d8c2f1c None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:42.353489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae57e69-1f18-403b-8bbb-0aa4c51dfa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:42.354306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae57e69-1f18-403b-8bbb-0aa4c51dfa7f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:42.354585 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae57e69-1f18-403b-8bbb-0aa4c51dfa7f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:42.354856 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae57e69-1f18-403b-8bbb-0aa4c51dfa7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:42.385096 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae57e69-1f18-403b-8bbb-0aa4c51dfa7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:42.387725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59956104-1ca9-405f-bfb9-89e25e69f45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:42.388412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59956104-1ca9-405f-bfb9-89e25e69f45c None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:42.388760 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59956104-1ca9-405f-bfb9-89e25e69f45c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:42.389052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59956104-1ca9-405f-bfb9-89e25e69f45c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:42.390005 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59956104-1ca9-405f-bfb9-89e25e69f45c None admin] RBAC: Adding query filter params (role.id=99462c05ed484212893d40128c99f47c, scope.project.id=ff00118a162648a38b9438404dd67916, user.id=e60d9b29780a442aa978a5697cb27bb1) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:42.390594 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59956104-1ca9-405f-bfb9-89e25e69f45c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:42.392380 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59956104-1ca9-405f-bfb9-89e25e69f45c None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:42.402112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-1ae57e69-1f18-403b-8bbb-0aa4c51dfa7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:10:42.402112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:42.402112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:42.402112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:42.402112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:42.402112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:42.402112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:42.402112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:42.402112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:42.402112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:42.402112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:42.402112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:42.402112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:42.402112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:42.402112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:42.402112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:42.403080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:42.403080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:42.403080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:42.403080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:42.403080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:42.403080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:42.403080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:42.403080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:42.403080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:42.403080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:42.403080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:42.403080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:10:42.403080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:42.403080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:42.403080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:42.403080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:42.404616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:42.404616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:42.404616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:42.404616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:42.404616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:42.404616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:42.404616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:42.404616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:42.404616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:42.404616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:42.404616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:10:42.404616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:10:42.404616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 113/222] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:10:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:42.408538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 110/223] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:10:42 2022] GET /identity/v3/role_assignments?user.id=e60d9b29780a442aa978a5697cb27bb1&scope.project.id=ff00118a162648a38b9438404dd67916&role.id=99462c05ed484212893d40128c99f47c => generated 259 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:42.413315 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae57e69-1f18-403b-8bbb-0aa4c51dfa7f None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:42.580396 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae57e69-1f18-403b-8bbb-0aa4c51dfa7f None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:42.632507 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc612ad3-9608-4ba1-b176-1dcbb17094f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:42.633228 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc612ad3-9608-4ba1-b176-1dcbb17094f5 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:42.633511 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc612ad3-9608-4ba1-b176-1dcbb17094f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:42.633787 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc612ad3-9608-4ba1-b176-1dcbb17094f5 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:42.634628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc612ad3-9608-4ba1-b176-1dcbb17094f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:42.634939 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc612ad3-9608-4ba1-b176-1dcbb17094f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:42.636466 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc612ad3-9608-4ba1-b176-1dcbb17094f5 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:42.651937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 114/224] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:42.658853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59956104-1ca9-405f-bfb9-89e25e69f45c None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:42.791186 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59956104-1ca9-405f-bfb9-89e25e69f45c None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:42.836181 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4c55e-c044-4909-b2b7-2f5801f4202c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:42.837673 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4c55e-c044-4909-b2b7-2f5801f4202c None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:42.838181 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4c55e-c044-4909-b2b7-2f5801f4202c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:42.838660 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4c55e-c044-4909-b2b7-2f5801f4202c None admin] PATH_INFO: `/v3/users/527e6fdf5d2444ce84c29a27ab86db3d` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:42.841221 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4c55e-c044-4909-b2b7-2f5801f4202c None admin] RBAC: Authorizing `identity:get_user(user_id=527e6fdf5d2444ce84c29a27ab86db3d)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:42.842950 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4c55e-c044-4909-b2b7-2f5801f4202c None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:42.843310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d8cab-ac47-4b20-82a5-16867b7177c7 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:42.844066 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d8cab-ac47-4b20-82a5-16867b7177c7 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:42.844601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d8cab-ac47-4b20-82a5-16867b7177c7 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:42.845394 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 111/225] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:42 2022] GET /identity/v3/users/527e6fdf5d2444ce84c29a27ab86db3d => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:42.847971 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 115/226] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:10:42.851865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4c55e-c044-4909-b2b7-2f5801f4202c None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:42.856036 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b42f8-0874-4c52-9acc-2f32206a14b6 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:42.856401 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b42f8-0874-4c52-9acc-2f32206a14b6 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:42.856687 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b42f8-0874-4c52-9acc-2f32206a14b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:42.893999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-cf7b42f8-0874-4c52-9acc-2f32206a14b6 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:42.895907 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-cf7b42f8-0874-4c52-9acc-2f32206a14b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:43.060829 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 116/227] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:43.076863 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4c55e-c044-4909-b2b7-2f5801f4202c None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:43.126274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b42f8-0874-4c52-9acc-2f32206a14b6 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:43.137976 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd2757-147a-4141-9d63-7fe9000af3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:43.138955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd2757-147a-4141-9d63-7fe9000af3cb None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:43.139324 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd2757-147a-4141-9d63-7fe9000af3cb None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:43.139623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd2757-147a-4141-9d63-7fe9000af3cb None admin] PATH_INFO: `/v3/projects/ff00118a162648a38b9438404dd67916` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:43.141353 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd2757-147a-4141-9d63-7fe9000af3cb None admin] RBAC: Authorizing `identity:get_project(project_id=ff00118a162648a38b9438404dd67916)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:43.142988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd2757-147a-4141-9d63-7fe9000af3cb None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:43.145636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 112/228] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:42 2022] GET /identity/v3/projects/ff00118a162648a38b9438404dd67916 => generated 302 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:43.151734 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd2757-147a-4141-9d63-7fe9000af3cb None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:43.246410 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b42f8-0874-4c52-9acc-2f32206a14b6 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:43.323045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6668ecc-6624-4546-a142-9303b8166f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:43.323876 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6668ecc-6624-4546-a142-9303b8166f89 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:43.324184 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6668ecc-6624-4546-a142-9303b8166f89 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:43.324459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6668ecc-6624-4546-a142-9303b8166f89 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:43.342145 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6668ecc-6624-4546-a142-9303b8166f89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:43.351682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-b6668ecc-6624-4546-a142-9303b8166f89 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:10:43.351682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:43.351682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:43.351682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:43.351682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:43.351682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:43.351682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:43.351682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:43.351682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:43.351682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:43.351682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:43.351682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:43.351682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:43.351682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:43.351682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:43.351682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:43.352690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:43.352690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:43.352690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:43.352690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:43.352690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:43.352690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:43.352690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:43.352690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:43.352690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:43.352690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:43.352690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:43.352690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:10:43.352690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:43.352690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:43.352690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:43.352690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:43.353952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:43.353952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:43.353952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:43.353952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:43.353952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:43.353952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:43.353952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:43.353952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:43.353952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:43.353952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:43.353952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:10:43.353952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:10:43.353952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 117/229] 10.222.0.71 () {56 vars in 1114 bytes} [Mon May 16 20:10:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:10:43.359240 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6668ecc-6624-4546-a142-9303b8166f89 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:43.386411 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd2757-147a-4141-9d63-7fe9000af3cb None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:43.466662 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6668ecc-6624-4546-a142-9303b8166f89 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:43.480936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a091f0f-c802-4cab-b54e-f78fcfdc1504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:43.481846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a091f0f-c802-4cab-b54e-f78fcfdc1504 None admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:43.482125 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a091f0f-c802-4cab-b54e-f78fcfdc1504 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:43.482399 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a091f0f-c802-4cab-b54e-f78fcfdc1504 None admin] PATH_INFO: `/v3/projects/ff00118a162648a38b9438404dd67916/users/527e6fdf5d2444ce84c29a27ab86db3d/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:43.490426 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a091f0f-c802-4cab-b54e-f78fcfdc1504 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff00118a162648a38b9438404dd67916, user_id=527e6fdf5d2444ce84c29a27ab86db3d, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:43.491923 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a091f0f-c802-4cab-b54e-f78fcfdc1504 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:43.518696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 113/230] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:10:43 2022] PUT /identity/v3/projects/ff00118a162648a38b9438404dd67916/users/527e6fdf5d2444ce84c29a27ab86db3d/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:10:43.525641 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac507f-1837-4895-b6b4-85fa298a7a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:43.526495 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac507f-1837-4895-b6b4-85fa298a7a7e None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:43.526784 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac507f-1837-4895-b6b4-85fa298a7a7e None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:43.527091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac507f-1837-4895-b6b4-85fa298a7a7e None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:43.527994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac507f-1837-4895-b6b4-85fa298a7a7e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:43.528447 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac507f-1837-4895-b6b4-85fa298a7a7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:43.529993 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac507f-1837-4895-b6b4-85fa298a7a7e None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:43.541305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 118/231] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:10:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:43.547583 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a091f0f-c802-4cab-b54e-f78fcfdc1504 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:43.694169 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a091f0f-c802-4cab-b54e-f78fcfdc1504 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:43.734831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948818c-6de1-4ab2-8d38-cd8b3f380d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:43.735732 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948818c-6de1-4ab2-8d38-cd8b3f380d86 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:43.736026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948818c-6de1-4ab2-8d38-cd8b3f380d86 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:43.736358 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948818c-6de1-4ab2-8d38-cd8b3f380d86 None admin] PATH_INFO: `/v3/users/527e6fdf5d2444ce84c29a27ab86db3d` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:43.737672 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948818c-6de1-4ab2-8d38-cd8b3f380d86 None admin] RBAC: Authorizing `identity:get_user(user_id=527e6fdf5d2444ce84c29a27ab86db3d)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:43.739762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948818c-6de1-4ab2-8d38-cd8b3f380d86 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:43.742139 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 114/232] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:43 2022] GET /identity/v3/users/527e6fdf5d2444ce84c29a27ab86db3d => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:43.749050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac507f-1837-4895-b6b4-85fa298a7a7e None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:43.898000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac507f-1837-4895-b6b4-85fa298a7a7e None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:43.948754 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec3a36-668c-4c8a-825b-b4a7d024f98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:43.949620 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec3a36-668c-4c8a-825b-b4a7d024f98b None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:43.949957 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec3a36-668c-4c8a-825b-b4a7d024f98b None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:43.950254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec3a36-668c-4c8a-825b-b4a7d024f98b None admin] PATH_INFO: `/v3/projects/ff00118a162648a38b9438404dd67916` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:43.951616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec3a36-668c-4c8a-825b-b4a7d024f98b None admin] RBAC: Authorizing `identity:get_project(project_id=ff00118a162648a38b9438404dd67916)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:43.953181 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec3a36-668c-4c8a-825b-b4a7d024f98b None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:43.957406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 119/233] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:43 2022] GET /identity/v3/projects/ff00118a162648a38b9438404dd67916 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:43.969330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948818c-6de1-4ab2-8d38-cd8b3f380d86 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:44.126431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948818c-6de1-4ab2-8d38-cd8b3f380d86 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:44.175244 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c156e-515f-4ad2-ae6e-ca7180a07e5e None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:44.175785 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c156e-515f-4ad2-ae6e-ca7180a07e5e None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:44.176781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c156e-515f-4ad2-ae6e-ca7180a07e5e None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:44.177196 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c744ee0-0e50-4e02-836b-93fa58fe1e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:44.178664 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c744ee0-0e50-4e02-836b-93fa58fe1e41 None admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:44.179187 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c744ee0-0e50-4e02-836b-93fa58fe1e41 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:44.179673 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c744ee0-0e50-4e02-836b-93fa58fe1e41 None admin] PATH_INFO: `/v3/projects/ff00118a162648a38b9438404dd67916/users/527e6fdf5d2444ce84c29a27ab86db3d/roles/140f30ce618745eea43e96b91df3bbab` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:44.180234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 120/234] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:44.186915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c744ee0-0e50-4e02-836b-93fa58fe1e41 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff00118a162648a38b9438404dd67916, user_id=527e6fdf5d2444ce84c29a27ab86db3d, role_id=140f30ce618745eea43e96b91df3bbab)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:44.188780 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c744ee0-0e50-4e02-836b-93fa58fe1e41 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:44.195513 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f29c27-b24e-4b39-a043-304bb5a83377 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:44.198279 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f29c27-b24e-4b39-a043-304bb5a83377 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:44.199018 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f29c27-b24e-4b39-a043-304bb5a83377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:44.221634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 115/235] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:10:43 2022] PUT /identity/v3/projects/ff00118a162648a38b9438404dd67916/users/527e6fdf5d2444ce84c29a27ab86db3d/roles/140f30ce618745eea43e96b91df3bbab => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:10:44.235258 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-93f29c27-b24e-4b39-a043-304bb5a83377 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:44.237534 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-93f29c27-b24e-4b39-a043-304bb5a83377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:44.273729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014eef3-b78f-4063-9f32-f53b931989dd None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:44.274369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014eef3-b78f-4063-9f32-f53b931989dd None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:44.274860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014eef3-b78f-4063-9f32-f53b931989dd None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:44.278634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 116/236] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:44.284417 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f1e10-dfbd-4ccb-9969-0ab4e8ef753f None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:44.285603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f1e10-dfbd-4ccb-9969-0ab4e8ef753f None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:44.286531 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f1e10-dfbd-4ccb-9969-0ab4e8ef753f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:44.313748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-9d1f1e10-dfbd-4ccb-9969-0ab4e8ef753f None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:44.320389 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-9d1f1e10-dfbd-4ccb-9969-0ab4e8ef753f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:44.383946 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 121/237] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:44.428552 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f29c27-b24e-4b39-a043-304bb5a83377 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:44.457682 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 117/238] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:44.484319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f1e10-dfbd-4ccb-9969-0ab4e8ef753f None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:44.571958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f29c27-b24e-4b39-a043-304bb5a83377 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:44.607366 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f1e10-dfbd-4ccb-9969-0ab4e8ef753f None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:44.625541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca669c-eef4-46e5-975b-0a7176ca095e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:44.626356 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca669c-eef4-46e5-975b-0a7176ca095e None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:44.626636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca669c-eef4-46e5-975b-0a7176ca095e None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:44.626912 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca669c-eef4-46e5-975b-0a7176ca095e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:44.640909 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca669c-eef4-46e5-975b-0a7176ca095e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:44.648987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-39ca669c-eef4-46e5-975b-0a7176ca095e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:10:44.648987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:44.648987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:44.648987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:44.648987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:44.648987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:44.648987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:44.648987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:44.648987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:44.648987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:44.648987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:44.648987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:44.648987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:44.648987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:44.648987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:44.648987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:44.650011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:44.650011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:44.650011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:44.650011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:44.650011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:44.650011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:44.650011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:44.650011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:44.650011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:44.650011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:44.650011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:44.650011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:10:44.650011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:44.650011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:44.650011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:44.650011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:44.651157 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:44.651157 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:44.651157 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:44.651157 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:44.651157 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:44.651157 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:44.651157 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:44.651157 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:44.651157 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:44.651157 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:44.651157 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:10:44.651157 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:10:44.651157 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 122/239] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:44.658106 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca669c-eef4-46e5-975b-0a7176ca095e None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:44.693995 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab21b57-3273-4938-9042-68064cd268f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:44.695760 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab21b57-3273-4938-9042-68064cd268f1 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:44.696038 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab21b57-3273-4938-9042-68064cd268f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:44.696331 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab21b57-3273-4938-9042-68064cd268f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:44.699496 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab21b57-3273-4938-9042-68064cd268f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:44.702022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab21b57-3273-4938-9042-68064cd268f1 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:44.704914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 118/240] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:10:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:44.716264 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab21b57-3273-4938-9042-68064cd268f1 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:44.869726 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca669c-eef4-46e5-975b-0a7176ca095e None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:44.914285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab21b57-3273-4938-9042-68064cd268f1 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:44.942995 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcf664-6551-4f5b-9e0b-9ea596f5c2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:44.943755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcf664-6551-4f5b-9e0b-9ea596f5c2c2 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:44.944039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcf664-6551-4f5b-9e0b-9ea596f5c2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:44.944343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcf664-6551-4f5b-9e0b-9ea596f5c2c2 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:44.945145 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fcf664-6551-4f5b-9e0b-9ea596f5c2c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:44.945455 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fcf664-6551-4f5b-9e0b-9ea596f5c2c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:44.946969 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fcf664-6551-4f5b-9e0b-9ea596f5c2c2 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:44.957730 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 123/241] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:10:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:44.963485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcf664-6551-4f5b-9e0b-9ea596f5c2c2 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:44.987338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6e7ab-6a17-48ce-874e-ee4dbb2fa402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:44.988206 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6e7ab-6a17-48ce-874e-ee4dbb2fa402 None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:44.988932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6e7ab-6a17-48ce-874e-ee4dbb2fa402 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:44.989072 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6e7ab-6a17-48ce-874e-ee4dbb2fa402 None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:44.992185 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e6e7ab-6a17-48ce-874e-ee4dbb2fa402 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:44.992185 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e6e7ab-6a17-48ce-874e-ee4dbb2fa402 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:45.031251 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 119/242] 10.222.0.71 () {60 vars in 1132 bytes} [Mon May 16 20:10:44 2022] POST /identity/v3/users => generated 293 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:10:45.125789 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcf664-6551-4f5b-9e0b-9ea596f5c2c2 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:45.180127 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba47cc-1d87-48ed-bdec-328fac6f5144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:45.181127 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba47cc-1d87-48ed-bdec-328fac6f5144 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:45.181406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba47cc-1d87-48ed-bdec-328fac6f5144 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:45.181674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba47cc-1d87-48ed-bdec-328fac6f5144 None admin] PATH_INFO: `/v3/users/87160d947e3849fbacdb6e3b8b8ff8d1` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:45.205698 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba47cc-1d87-48ed-bdec-328fac6f5144 None admin] RBAC: Authorizing `identity:get_user(user_id=87160d947e3849fbacdb6e3b8b8ff8d1)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:45.205698 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba47cc-1d87-48ed-bdec-328fac6f5144 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:45.208298 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 124/243] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:44 2022] GET /identity/v3/users/87160d947e3849fbacdb6e3b8b8ff8d1 => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:45.219891 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6e7ab-6a17-48ce-874e-ee4dbb2fa402 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:45.365748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6e7ab-6a17-48ce-874e-ee4dbb2fa402 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:45.434382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4920eb-4f98-4993-af2a-59d7cf4cbde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:45.435465 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4920eb-4f98-4993-af2a-59d7cf4cbde2 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:45.435951 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4920eb-4f98-4993-af2a-59d7cf4cbde2 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:45.436490 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4920eb-4f98-4993-af2a-59d7cf4cbde2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:45.570211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4920eb-4f98-4993-af2a-59d7cf4cbde2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:45.572689 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4920eb-4f98-4993-af2a-59d7cf4cbde2 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:45.608186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de764242-33ed-4722-998a-ab219bf000ad None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:45.608754 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de764242-33ed-4722-998a-ab219bf000ad None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:45.609169 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de764242-33ed-4722-998a-ab219bf000ad None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:45.613871 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 125/244] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:45.625459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1472f-ea00-4c6e-99b7-26f5292af5c1 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:45.626067 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1472f-ea00-4c6e-99b7-26f5292af5c1 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:45.626682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1472f-ea00-4c6e-99b7-26f5292af5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:45.654393 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-c1b1472f-ea00-4c6e-99b7-26f5292af5c1 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:45.655789 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-c1b1472f-ea00-4c6e-99b7-26f5292af5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:45.748748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 126/245] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:45.764828 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 120/246] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:10:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:10:45.773126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1472f-ea00-4c6e-99b7-26f5292af5c1 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:45.782675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4920eb-4f98-4993-af2a-59d7cf4cbde2 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:45.912756 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4920eb-4f98-4993-af2a-59d7cf4cbde2 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:45.959924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1472f-ea00-4c6e-99b7-26f5292af5c1 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:45.968749 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cba14-7537-4e91-b6a6-ee180862a1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:45.969953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cba14-7537-4e91-b6a6-ee180862a1d8 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:45.970448 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cba14-7537-4e91-b6a6-ee180862a1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:45.970939 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cba14-7537-4e91-b6a6-ee180862a1d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:45.999530 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cba14-7537-4e91-b6a6-ee180862a1d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:46.015526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-361cba14-7537-4e91-b6a6-ee180862a1d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:10:46.015526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:46.015526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:46.015526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:46.015526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:46.015526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:46.015526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:46.015526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:46.015526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:46.015526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:46.015526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:46.015526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:46.015526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:46.015526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:46.015526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:46.015526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:46.016521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:46.016521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:46.016521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:46.016521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:46.016521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:46.016521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:46.016521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:46.016521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:46.016521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:46.016521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:46.016521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:46.016521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:10:46.016521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:46.016521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:46.016521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:46.016521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:46.017295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:46.017295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:46.017295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:46.017295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:46.017295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:46.017295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:46.017295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:46.017295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:46.017295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:46.017295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:46.017295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:10:46.017295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:10:46.021826 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 121/247] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:46.024231 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eef8c5-e0d1-4581-88ed-df551f2c6e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:46.025014 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eef8c5-e0d1-4581-88ed-df551f2c6e8c None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:46.025511 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eef8c5-e0d1-4581-88ed-df551f2c6e8c None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:46.026013 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eef8c5-e0d1-4581-88ed-df551f2c6e8c None admin] PATH_INFO: `/v3/projects/ff00118a162648a38b9438404dd67916` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:46.028422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eef8c5-e0d1-4581-88ed-df551f2c6e8c None admin] RBAC: Authorizing `identity:get_project(project_id=ff00118a162648a38b9438404dd67916)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:46.031370 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eef8c5-e0d1-4581-88ed-df551f2c6e8c None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:46.033979 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cba14-7537-4e91-b6a6-ee180862a1d8 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:46.034335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 127/248] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:45 2022] GET /identity/v3/projects/ff00118a162648a38b9438404dd67916 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:46.044039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eef8c5-e0d1-4581-88ed-df551f2c6e8c None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:46.166556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cba14-7537-4e91-b6a6-ee180862a1d8 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:46.169986 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eef8c5-e0d1-4581-88ed-df551f2c6e8c None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:46.212253 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759447a-a98b-4beb-a362-8e98ffc39b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:46.213697 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759447a-a98b-4beb-a362-8e98ffc39b4d None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:46.215213 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759447a-a98b-4beb-a362-8e98ffc39b4d None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:46.216132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759447a-a98b-4beb-a362-8e98ffc39b4d None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:46.217144 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759447a-a98b-4beb-a362-8e98ffc39b4d None admin] RBAC: Adding query filter params (name=member) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:46.218013 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759447a-a98b-4beb-a362-8e98ffc39b4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:46.219367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08955a-1b6e-4e00-ae47-412d1a6c0746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:46.221388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08955a-1b6e-4e00-ae47-412d1a6c0746 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:46.222201 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759447a-a98b-4beb-a362-8e98ffc39b4d None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:46.222897 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08955a-1b6e-4e00-ae47-412d1a6c0746 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:46.225123 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08955a-1b6e-4e00-ae47-412d1a6c0746 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:46.226248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08955a-1b6e-4e00-ae47-412d1a6c0746 None admin] RBAC: Adding query filter params (role.id=f7d1ff112a024e3190daa30a7814e054, scope.project.id=ff00118a162648a38b9438404dd67916, user.id=87160d947e3849fbacdb6e3b8b8ff8d1) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:46.226782 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08955a-1b6e-4e00-ae47-412d1a6c0746 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:46.228951 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08955a-1b6e-4e00-ae47-412d1a6c0746 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:46.244359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 128/249] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:10:46 2022] GET /identity/v3/role_assignments?user.id=87160d947e3849fbacdb6e3b8b8ff8d1&scope.project.id=ff00118a162648a38b9438404dd67916&role.id=f7d1ff112a024e3190daa30a7814e054 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:46.244730 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 122/250] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:10:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:46.250766 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08955a-1b6e-4e00-ae47-412d1a6c0746 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:46.367473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08955a-1b6e-4e00-ae47-412d1a6c0746 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:46.408603 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2455f1-b611-4b4d-93ab-b1ca4017f869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:46.409502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2455f1-b611-4b4d-93ab-b1ca4017f869 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:46.409783 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2455f1-b611-4b4d-93ab-b1ca4017f869 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:46.410095 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2455f1-b611-4b4d-93ab-b1ca4017f869 None admin] PATH_INFO: `/v3/users/e60d9b29780a442aa978a5697cb27bb1` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:46.411402 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2455f1-b611-4b4d-93ab-b1ca4017f869 None admin] RBAC: Authorizing `identity:get_user(user_id=e60d9b29780a442aa978a5697cb27bb1)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:46.412903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2455f1-b611-4b4d-93ab-b1ca4017f869 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:46.414938 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 129/251] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:46 2022] GET /identity/v3/users/e60d9b29780a442aa978a5697cb27bb1 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:46.420728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759447a-a98b-4beb-a362-8e98ffc39b4d None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:46.536678 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759447a-a98b-4beb-a362-8e98ffc39b4d None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:46.574118 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acd445-910d-4846-86e7-b1ecd5800e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:46.574987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acd445-910d-4846-86e7-b1ecd5800e4e None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:46.575262 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acd445-910d-4846-86e7-b1ecd5800e4e None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:46.575530 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acd445-910d-4846-86e7-b1ecd5800e4e None admin] PATH_INFO: `/v3/projects/ff00118a162648a38b9438404dd67916` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:46.576861 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acd445-910d-4846-86e7-b1ecd5800e4e None admin] RBAC: Authorizing `identity:get_project(project_id=ff00118a162648a38b9438404dd67916)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:46.578358 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acd445-910d-4846-86e7-b1ecd5800e4e None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:46.584181 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 123/252] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:46 2022] GET /identity/v3/projects/ff00118a162648a38b9438404dd67916 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:46.586657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2455f1-b611-4b4d-93ab-b1ca4017f869 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:46.749559 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2455f1-b611-4b4d-93ab-b1ca4017f869 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:46.797076 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291138b-d2ef-4829-8ca7-e70b3bb7e20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:46.798028 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291138b-d2ef-4829-8ca7-e70b3bb7e20d None admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:46.798313 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291138b-d2ef-4829-8ca7-e70b3bb7e20d None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:46.798594 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291138b-d2ef-4829-8ca7-e70b3bb7e20d None admin] PATH_INFO: `/v3/projects/ff00118a162648a38b9438404dd67916/users/e60d9b29780a442aa978a5697cb27bb1/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:46.801724 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291138b-d2ef-4829-8ca7-e70b3bb7e20d None admin] RBAC: Authorizing `identity:create_grant(project_id=ff00118a162648a38b9438404dd67916, user_id=e60d9b29780a442aa978a5697cb27bb1, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:46.803271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291138b-d2ef-4829-8ca7-e70b3bb7e20d None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:46.825535 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 130/253] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:10:46 2022] PUT /identity/v3/projects/ff00118a162648a38b9438404dd67916/users/e60d9b29780a442aa978a5697cb27bb1/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:10:47.038855 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5c3f4-da5b-435a-9f4f-30b483289c1e None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:47.039383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5c3f4-da5b-435a-9f4f-30b483289c1e None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:47.039383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5c3f4-da5b-435a-9f4f-30b483289c1e None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:47.041303 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 124/254] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:47.046970 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022d6a9-fa2b-4574-9d84-843844f2210d None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:47.047300 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022d6a9-fa2b-4574-9d84-843844f2210d None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:47.047542 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022d6a9-fa2b-4574-9d84-843844f2210d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:47.077414 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-d022d6a9-fa2b-4574-9d84-843844f2210d None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:47.078662 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-d022d6a9-fa2b-4574-9d84-843844f2210d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:47.173654 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 131/255] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:47.233277 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5c3f4-da5b-435a-9f4f-30b483289c1e None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:47.374789 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5c3f4-da5b-435a-9f4f-30b483289c1e None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:47.419017 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc2981-b722-4eec-a245-0fc234e28d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:47.419830 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc2981-b722-4eec-a245-0fc234e28d8d None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:47.420114 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc2981-b722-4eec-a245-0fc234e28d8d None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:47.420426 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc2981-b722-4eec-a245-0fc234e28d8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:47.433071 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc2981-b722-4eec-a245-0fc234e28d8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:47.442031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-10dc2981-b722-4eec-a245-0fc234e28d8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:10:47.442031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:47.442031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:47.442031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:47.442031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:47.442031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:47.442031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:47.442031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:47.442031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:47.442031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:47.442031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:47.442031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:47.442031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:47.442031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:47.442031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:47.442031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:47.443031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:47.443031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:47.443031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:47.443031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:47.443031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:47.443031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:47.443031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:47.443031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:47.443031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:47.443031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:47.443031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:47.443031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:10:47.443031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:47.443031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:47.443031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:47.443031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:47.443832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:47.443832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:47.443832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:47.443832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:47.443832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:47.443832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:47.443832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:47.443832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:47.443832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:47.443832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:47.443832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:10:47.443832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:10:47.448290 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 125/256] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:10:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:47.453385 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022d6a9-fa2b-4574-9d84-843844f2210d None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:47.622171 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022d6a9-fa2b-4574-9d84-843844f2210d None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:47.674080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a59653-06c0-4f77-834f-0bfd8968b503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:47.674689 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a59653-06c0-4f77-834f-0bfd8968b503 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:47.674975 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a59653-06c0-4f77-834f-0bfd8968b503 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:47.675253 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a59653-06c0-4f77-834f-0bfd8968b503 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:47.676889 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a59653-06c0-4f77-834f-0bfd8968b503 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:47.677206 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a59653-06c0-4f77-834f-0bfd8968b503 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:47.678626 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a59653-06c0-4f77-834f-0bfd8968b503 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:47.688364 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 132/257] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:47.694989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc2981-b722-4eec-a245-0fc234e28d8d None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:47.710772 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59130c23-14a7-4fb9-99fa-8cf2c3cf4abf None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:47.711075 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59130c23-14a7-4fb9-99fa-8cf2c3cf4abf None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:47.711333 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59130c23-14a7-4fb9-99fa-8cf2c3cf4abf None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:47.712969 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 133/258] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:47.719388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7066a5f-2953-4d88-b980-661587417251 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:47.720016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7066a5f-2953-4d88-b980-661587417251 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:47.720544 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7066a5f-2953-4d88-b980-661587417251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:47.740421 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-b7066a5f-2953-4d88-b980-661587417251 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:47.742007 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-b7066a5f-2953-4d88-b980-661587417251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:47.867341 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 134/259] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:10:47.916333 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7066a5f-2953-4d88-b980-661587417251 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:47.938557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc2981-b722-4eec-a245-0fc234e28d8d None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:48.020567 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51055da-f730-4877-970d-9adeb5d606c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:48.021609 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51055da-f730-4877-970d-9adeb5d606c2 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:48.021889 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51055da-f730-4877-970d-9adeb5d606c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:48.022352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51055da-f730-4877-970d-9adeb5d606c2 None admin] PATH_INFO: `/v3/users/527e6fdf5d2444ce84c29a27ab86db3d` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:48.028776 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51055da-f730-4877-970d-9adeb5d606c2 None admin] RBAC: Authorizing `identity:get_user(user_id=527e6fdf5d2444ce84c29a27ab86db3d)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:48.030659 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51055da-f730-4877-970d-9adeb5d606c2 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:48.032706 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 126/260] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:47 2022] GET /identity/v3/users/527e6fdf5d2444ce84c29a27ab86db3d => generated 283 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:48.042786 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51055da-f730-4877-970d-9adeb5d606c2 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:48.126766 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7066a5f-2953-4d88-b980-661587417251 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:48.182607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbcb03-1463-4036-8834-98134c8d02cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:48.183482 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbcb03-1463-4036-8834-98134c8d02cd None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:48.183770 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbcb03-1463-4036-8834-98134c8d02cd None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:48.184049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbcb03-1463-4036-8834-98134c8d02cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:48.206076 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbcb03-1463-4036-8834-98134c8d02cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:48.223887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-81cbcb03-1463-4036-8834-98134c8d02cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:10:48.223887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:48.223887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:48.223887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:48.223887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:48.223887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:48.223887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:48.223887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:48.223887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:48.223887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:48.223887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:48.223887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:48.223887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:48.223887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:48.223887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:48.223887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:48.225112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:48.225112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:48.225112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:48.225112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:48.225112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:48.225112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:48.225112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:48.225112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:48.225112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:48.225112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:48.225112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:48.225112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:10:48.225112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:48.225112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:48.225112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:48.225112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:48.226145 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:48.226145 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:48.226145 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:48.226145 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:48.226145 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:48.226145 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:48.226145 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:48.226145 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:48.226145 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:48.226145 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:48.226145 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:10:48.226145 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:10:48.226145 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 135/261] 10.222.0.71 () {56 vars in 1114 bytes} [Mon May 16 20:10:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:10:48.233069 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbcb03-1463-4036-8834-98134c8d02cd None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:48.306215 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51055da-f730-4877-970d-9adeb5d606c2 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:48.378070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a22f1-cbf5-467d-ab72-dbe509fe44ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:48.379723 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a22f1-cbf5-467d-ab72-dbe509fe44ad None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:48.380510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a22f1-cbf5-467d-ab72-dbe509fe44ad None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:48.380944 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a22f1-cbf5-467d-ab72-dbe509fe44ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:48.472268 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbcb03-1463-4036-8834-98134c8d02cd None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:48.544344 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a22f1-cbf5-467d-ab72-dbe509fe44ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:48.546083 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a22f1-cbf5-467d-ab72-dbe509fe44ad None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:48.554081 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c7cb8-ea85-4dec-9141-ea7c698e7219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:48.554774 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c7cb8-ea85-4dec-9141-ea7c698e7219 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:48.555052 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c7cb8-ea85-4dec-9141-ea7c698e7219 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:48.555320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c7cb8-ea85-4dec-9141-ea7c698e7219 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:48.556100 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c7cb8-ea85-4dec-9141-ea7c698e7219 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:48.556441 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c7cb8-ea85-4dec-9141-ea7c698e7219 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:48.557868 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c7cb8-ea85-4dec-9141-ea7c698e7219 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:48.575674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 136/262] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:10:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:48.581215 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c7cb8-ea85-4dec-9141-ea7c698e7219 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:48.774014 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 127/263] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:10:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:10:48.780482 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a22f1-cbf5-467d-ab72-dbe509fe44ad None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:48.820644 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c7cb8-ea85-4dec-9141-ea7c698e7219 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:48.914057 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3ec8f-daa2-41ec-a38b-4dcb18c0a0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:48.914950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3ec8f-daa2-41ec-a38b-4dcb18c0a0a4 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:48.915229 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3ec8f-daa2-41ec-a38b-4dcb18c0a0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:48.915513 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3ec8f-daa2-41ec-a38b-4dcb18c0a0a4 None admin] PATH_INFO: `/v3/users/527e6fdf5d2444ce84c29a27ab86db3d` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:48.921147 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3ec8f-daa2-41ec-a38b-4dcb18c0a0a4 None admin] RBAC: Authorizing `identity:get_user(user_id=527e6fdf5d2444ce84c29a27ab86db3d)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:48.922675 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3ec8f-daa2-41ec-a38b-4dcb18c0a0a4 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:48.924853 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 137/264] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:48 2022] GET /identity/v3/users/527e6fdf5d2444ce84c29a27ab86db3d => generated 283 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:48.931979 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3ec8f-daa2-41ec-a38b-4dcb18c0a0a4 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:49.008949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a22f1-cbf5-467d-ab72-dbe509fe44ad None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:49.064188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb814c-5d69-4019-a9ea-4a78b395024c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:49.073264 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb814c-5d69-4019-a9ea-4a78b395024c None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:49.073585 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb814c-5d69-4019-a9ea-4a78b395024c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:49.073818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb814c-5d69-4019-a9ea-4a78b395024c None admin] PATH_INFO: `/v3/projects/ff00118a162648a38b9438404dd67916` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:49.075229 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb814c-5d69-4019-a9ea-4a78b395024c None admin] RBAC: Authorizing `identity:get_project(project_id=ff00118a162648a38b9438404dd67916)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:49.076793 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb814c-5d69-4019-a9ea-4a78b395024c None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:49.078952 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 128/265] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:48 2022] GET /identity/v3/projects/ff00118a162648a38b9438404dd67916 => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:49.085863 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb814c-5d69-4019-a9ea-4a78b395024c None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:49.232268 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3ec8f-daa2-41ec-a38b-4dcb18c0a0a4 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:49.317862 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2efc3-6656-4b41-8eb0-2dda1ac7401f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:49.318558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2efc3-6656-4b41-8eb0-2dda1ac7401f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:49.318842 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2efc3-6656-4b41-8eb0-2dda1ac7401f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:49.319116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2efc3-6656-4b41-8eb0-2dda1ac7401f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:49.334687 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb814c-5d69-4019-a9ea-4a78b395024c None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:49.394939 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552a288-4b5f-4553-85be-e11c4138dc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:49.395677 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552a288-4b5f-4553-85be-e11c4138dc68 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:49.395956 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552a288-4b5f-4553-85be-e11c4138dc68 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:49.396327 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552a288-4b5f-4553-85be-e11c4138dc68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:49.397222 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552a288-4b5f-4553-85be-e11c4138dc68 None admin] RBAC: Adding query filter params (role.id=6576d9225a0946de877f527e3d15db05, scope.project.id=ff00118a162648a38b9438404dd67916, user.id=527e6fdf5d2444ce84c29a27ab86db3d) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:49.397580 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552a288-4b5f-4553-85be-e11c4138dc68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:49.399091 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552a288-4b5f-4553-85be-e11c4138dc68 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:49.410453 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 129/266] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:10:49 2022] GET /identity/v3/role_assignments?user.id=527e6fdf5d2444ce84c29a27ab86db3d&scope.project.id=ff00118a162648a38b9438404dd67916&role.id=6576d9225a0946de877f527e3d15db05 => generated 608 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:49.467942 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2efc3-6656-4b41-8eb0-2dda1ac7401f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:49.469548 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2efc3-6656-4b41-8eb0-2dda1ac7401f None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:49.498814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f1358-c721-4e94-941f-25ea10d3381f None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:49.499150 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f1358-c721-4e94-941f-25ea10d3381f None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:49.499368 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f1358-c721-4e94-941f-25ea10d3381f None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:49.501394 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 130/267] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:49.508050 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb2b80-7447-4b96-8095-dfc0f08aecf6 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:49.508410 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb2b80-7447-4b96-8095-dfc0f08aecf6 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:49.508620 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb2b80-7447-4b96-8095-dfc0f08aecf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:49.546252 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-c8cb2b80-7447-4b96-8095-dfc0f08aecf6 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:49.547512 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c8cb2b80-7447-4b96-8095-dfc0f08aecf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:49.622480 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 138/268] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:10:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 691 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 20:10:49.646218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2efc3-6656-4b41-8eb0-2dda1ac7401f None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:49.658737 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 131/269] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:49.693548 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb2b80-7447-4b96-8095-dfc0f08aecf6 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:49.829761 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2efc3-6656-4b41-8eb0-2dda1ac7401f None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:49.890679 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7de27-7cfa-4d99-8780-2c796a9f739a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:49.891922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7de27-7cfa-4d99-8780-2c796a9f739a None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:49.892438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7de27-7cfa-4d99-8780-2c796a9f739a None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:49.892962 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7de27-7cfa-4d99-8780-2c796a9f739a None admin] PATH_INFO: `/v3/projects/ff00118a162648a38b9438404dd67916` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:49.893385 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb2b80-7447-4b96-8095-dfc0f08aecf6 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:49.895421 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7de27-7cfa-4d99-8780-2c796a9f739a None admin] RBAC: Authorizing `identity:get_project(project_id=ff00118a162648a38b9438404dd67916)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:49.897513 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7de27-7cfa-4d99-8780-2c796a9f739a None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:49.901339 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 139/270] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:49 2022] GET /identity/v3/projects/ff00118a162648a38b9438404dd67916 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:49.903065 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d12cf-706d-4a53-9a12-3ede6568910e None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:49.903571 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d12cf-706d-4a53-9a12-3ede6568910e None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:49.904075 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d12cf-706d-4a53-9a12-3ede6568910e None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:49.906030 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 140/271] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:49.907244 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d12cf-706d-4a53-9a12-3ede6568910e None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:49.933988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aedeab-34ac-4c51-aebc-6bd85000c3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:49.934805 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aedeab-34ac-4c51-aebc-6bd85000c3f1 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:49.935089 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aedeab-34ac-4c51-aebc-6bd85000c3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:49.935348 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aedeab-34ac-4c51-aebc-6bd85000c3f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:49.936637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aedeab-34ac-4c51-aebc-6bd85000c3f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:49.938121 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aedeab-34ac-4c51-aebc-6bd85000c3f1 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:49.940184 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 132/272] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:10:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:49.945702 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1de42-21b5-4db9-a572-37f358617997 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:49.946020 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1de42-21b5-4db9-a572-37f358617997 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:49.946279 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1de42-21b5-4db9-a572-37f358617997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:49.966360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-4ed1de42-21b5-4db9-a572-37f358617997 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:49.967574 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-4ed1de42-21b5-4db9-a572-37f358617997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:50.033089 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d12cf-706d-4a53-9a12-3ede6568910e None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:50.048094 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 133/273] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:50.048987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1de42-21b5-4db9-a572-37f358617997 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:50.077207 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815de31-e9c0-42ec-baab-318871935dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:50.078399 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815de31-e9c0-42ec-baab-318871935dbc None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:50.078937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815de31-e9c0-42ec-baab-318871935dbc None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:50.079420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815de31-e9c0-42ec-baab-318871935dbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:50.080787 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815de31-e9c0-42ec-baab-318871935dbc None admin] RBAC: Adding query filter params (role.id=140f30ce618745eea43e96b91df3bbab, scope.project.id=ff00118a162648a38b9438404dd67916, user.id=527e6fdf5d2444ce84c29a27ab86db3d) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:50.081399 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815de31-e9c0-42ec-baab-318871935dbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:50.083737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815de31-e9c0-42ec-baab-318871935dbc None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:50.091288 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 141/274] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:10:49 2022] GET /identity/v3/role_assignments?user.id=527e6fdf5d2444ce84c29a27ab86db3d&scope.project.id=ff00118a162648a38b9438404dd67916&role.id=140f30ce618745eea43e96b91df3bbab => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:50.092832 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815de31-e9c0-42ec-baab-318871935dbc None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:50.170966 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1de42-21b5-4db9-a572-37f358617997 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:50.213238 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29723f58-600a-4763-acf0-18ddfb1f00c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:50.213939 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29723f58-600a-4763-acf0-18ddfb1f00c7 None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:50.214225 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29723f58-600a-4763-acf0-18ddfb1f00c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:50.214508 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29723f58-600a-4763-acf0-18ddfb1f00c7 None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:50.215259 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29723f58-600a-4763-acf0-18ddfb1f00c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:50.216996 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29723f58-600a-4763-acf0-18ddfb1f00c7 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:50.227361 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815de31-e9c0-42ec-baab-318871935dbc None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:50.255878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 134/275] 10.222.0.71 () {60 vars in 1132 bytes} [Mon May 16 20:10:50 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:10:50.314288 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42eb958-c55b-4404-b4b8-107358a7b3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:50.315518 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42eb958-c55b-4404-b4b8-107358a7b3f9 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:50.316004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42eb958-c55b-4404-b4b8-107358a7b3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:50.317209 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42eb958-c55b-4404-b4b8-107358a7b3f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:50.349603 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42eb958-c55b-4404-b4b8-107358a7b3f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:50.360999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-d42eb958-c55b-4404-b4b8-107358a7b3f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:10:50.360999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:50.360999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:50.360999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:50.360999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:50.360999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:50.360999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:50.360999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:50.360999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:50.360999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:50.360999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:50.360999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:50.360999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:50.360999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:50.360999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:50.360999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:50.362163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:50.362163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:50.362163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:50.362163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:50.362163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:50.362163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:50.362163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:50.362163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:50.362163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:50.362163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:50.362163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:50.362163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:10:50.362163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:50.362163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:50.362163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:50.362163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:50.363748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:50.363748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:50.363748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:50.363748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:50.363748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:50.363748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:50.363748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:50.363748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:50.363748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:50.363748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:50.363748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:10:50.363748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:10:50.374622 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 142/276] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:50.386335 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29723f58-600a-4763-acf0-18ddfb1f00c7 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:50.597935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21416944-da56-4656-9c41-5bfab5ba408e None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:50.598500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21416944-da56-4656-9c41-5bfab5ba408e None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:50.598929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21416944-da56-4656-9c41-5bfab5ba408e None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:50.601962 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 143/277] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:50.607485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29723f58-600a-4763-acf0-18ddfb1f00c7 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:50.608841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc27a4-34c7-4850-b69c-a28c3712c365 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:50.609375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc27a4-34c7-4850-b69c-a28c3712c365 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:50.609902 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc27a4-34c7-4850-b69c-a28c3712c365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:50.653305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-1bbc27a4-34c7-4850-b69c-a28c3712c365 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:50.655281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-1bbc27a4-34c7-4850-b69c-a28c3712c365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:50.657636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903f990-aa33-4e44-9927-a02dac7c2da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:50.658324 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903f990-aa33-4e44-9927-a02dac7c2da8 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:50.658601 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903f990-aa33-4e44-9927-a02dac7c2da8 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:50.658867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903f990-aa33-4e44-9927-a02dac7c2da8 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:50.659633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903f990-aa33-4e44-9927-a02dac7c2da8 None admin] RBAC: Adding query filter params (name=member) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:50.660422 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903f990-aa33-4e44-9927-a02dac7c2da8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:50.661868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903f990-aa33-4e44-9927-a02dac7c2da8 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:50.683848 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 135/278] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:10:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:50.695139 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903f990-aa33-4e44-9927-a02dac7c2da8 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:50.823594 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 144/279] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:50.870641 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc27a4-34c7-4850-b69c-a28c3712c365 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:50.939194 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903f990-aa33-4e44-9927-a02dac7c2da8 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:51.016391 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb83a6-2647-41cc-8a2b-dbcca80b310b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:51.017281 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb83a6-2647-41cc-8a2b-dbcca80b310b None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:51.017561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb83a6-2647-41cc-8a2b-dbcca80b310b None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:51.017830 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb83a6-2647-41cc-8a2b-dbcca80b310b None admin] PATH_INFO: `/v3/users/9f49ace51cc44130bbd52e112c57c3dd` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:51.033693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb83a6-2647-41cc-8a2b-dbcca80b310b None admin] RBAC: Authorizing `identity:get_user(user_id=9f49ace51cc44130bbd52e112c57c3dd)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:51.035857 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb83a6-2647-41cc-8a2b-dbcca80b310b None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:51.038012 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 136/280] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:50 2022] GET /identity/v3/users/9f49ace51cc44130bbd52e112c57c3dd => generated 293 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:51.039412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4739b-ea95-455f-b22e-6277b6d82d79 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:51.039691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4739b-ea95-455f-b22e-6277b6d82d79 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:51.039961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4739b-ea95-455f-b22e-6277b6d82d79 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:51.041641 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 137/281] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:51.046496 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4739b-ea95-455f-b22e-6277b6d82d79 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:51.100023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc27a4-34c7-4850-b69c-a28c3712c365 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:51.161834 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4739b-ea95-455f-b22e-6277b6d82d79 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:51.172775 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3507b61-2ffe-45cc-9532-3972c52bbab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:51.173888 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3507b61-2ffe-45cc-9532-3972c52bbab2 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:51.174382 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3507b61-2ffe-45cc-9532-3972c52bbab2 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:51.175233 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3507b61-2ffe-45cc-9532-3972c52bbab2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:51.198683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3507b61-2ffe-45cc-9532-3972c52bbab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:51.200452 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c3800-5614-4d80-b960-7e82977bc904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:51.201180 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c3800-5614-4d80-b960-7e82977bc904 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:51.201581 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c3800-5614-4d80-b960-7e82977bc904 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:51.202134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c3800-5614-4d80-b960-7e82977bc904 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:51.205096 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c3800-5614-4d80-b960-7e82977bc904 None admin] RBAC: Adding query filter params (role.id=99462c05ed484212893d40128c99f47c, user.id=9f49ace51cc44130bbd52e112c57c3dd, scope.system=all) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:51.205096 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c3800-5614-4d80-b960-7e82977bc904 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:51.205096 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c3800-5614-4d80-b960-7e82977bc904 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:51.211966 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 138/282] 10.222.0.71 () {56 vars in 1308 bytes} [Mon May 16 20:10:51 2022] GET /identity/v3/role_assignments?user.id=9f49ace51cc44130bbd52e112c57c3dd&scope.system=all&role.id=99462c05ed484212893d40128c99f47c => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:51.220186 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e557e6-4e40-41d1-8d3d-919b20536b3c None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:51.220186 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e557e6-4e40-41d1-8d3d-919b20536b3c None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:51.220186 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e557e6-4e40-41d1-8d3d-919b20536b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:51.220540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-d3507b61-2ffe-45cc-9532-3972c52bbab2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:10:51.220540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:51.220540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:51.220540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:51.220540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:51.220540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:51.220540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:51.220540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:51.220540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:51.220540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:51.220540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:51.220540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:51.220540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:51.220540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:51.220540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:51.220540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:51.221359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:51.221359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:51.221359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:51.221359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:51.221359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:51.221359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:51.221359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:51.221359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:51.221359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:51.221359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:51.221359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:51.221359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:10:51.221359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:51.221359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:51.221359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:51.221359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:51.223613 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:51.223613 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:51.223613 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:51.223613 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:51.223613 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:51.223613 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:51.223613 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:51.223613 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:51.223613 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:51.223613 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:51.223613 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:10:51.223613 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:10:51.226155 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 145/283] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:51.233161 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-71e557e6-4e40-41d1-8d3d-919b20536b3c None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:51.234365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-71e557e6-4e40-41d1-8d3d-919b20536b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:51.238476 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3507b61-2ffe-45cc-9532-3972c52bbab2 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:51.312974 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 139/284] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:51.337516 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e557e6-4e40-41d1-8d3d-919b20536b3c None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:51.376580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3507b61-2ffe-45cc-9532-3972c52bbab2 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:51.419067 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f19145-6e9c-4663-a8e1-9551b02b205f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:51.419780 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f19145-6e9c-4663-a8e1-9551b02b205f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:51.420067 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f19145-6e9c-4663-a8e1-9551b02b205f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:51.420398 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f19145-6e9c-4663-a8e1-9551b02b205f None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:51.421216 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f19145-6e9c-4663-a8e1-9551b02b205f None admin] RBAC: Adding query filter params (name=reader) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:51.421539 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f19145-6e9c-4663-a8e1-9551b02b205f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:51.423128 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f19145-6e9c-4663-a8e1-9551b02b205f None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:51.434515 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 146/285] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:10:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:51.440703 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f19145-6e9c-4663-a8e1-9551b02b205f None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:51.452355 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e557e6-4e40-41d1-8d3d-919b20536b3c None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:51.491769 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78fcc8-16b6-49c6-869a-9362d6054546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:51.492657 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78fcc8-16b6-49c6-869a-9362d6054546 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:51.492986 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78fcc8-16b6-49c6-869a-9362d6054546 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:51.493257 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78fcc8-16b6-49c6-869a-9362d6054546 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:51.506915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78fcc8-16b6-49c6-869a-9362d6054546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:51.515034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-3b78fcc8-16b6-49c6-869a-9362d6054546 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:10:51.515034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:51.515034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:51.515034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:51.515034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:51.515034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:51.515034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:51.515034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:51.515034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:51.515034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:51.515034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:51.515034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:51.515034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:51.515034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:51.515034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:51.515034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:51.517729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:51.517729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:51.517729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:51.517729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:51.517729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:51.517729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:51.517729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:51.517729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:51.517729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:51.517729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:51.517729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:51.517729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:10:51.517729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:51.517729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:51.517729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:51.517729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:51.520176 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:51.520176 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:51.520176 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:51.520176 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:51.520176 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:51.520176 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:51.520176 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:51.520176 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:51.520176 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:51.520176 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:51.520176 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:10:51.520176 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:10:51.520176 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 140/286] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:51.528556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78fcc8-16b6-49c6-869a-9362d6054546 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:51.676609 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f19145-6e9c-4663-a8e1-9551b02b205f None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:51.688955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78fcc8-16b6-49c6-869a-9362d6054546 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:51.714428 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf79d9-df72-4731-b06c-7425544b6de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:51.715304 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf79d9-df72-4731-b06c-7425544b6de0 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:51.715582 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf79d9-df72-4731-b06c-7425544b6de0 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:51.715854 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf79d9-df72-4731-b06c-7425544b6de0 None admin] PATH_INFO: `/v3/users/87160d947e3849fbacdb6e3b8b8ff8d1` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:51.717125 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf79d9-df72-4731-b06c-7425544b6de0 None admin] RBAC: Authorizing `identity:get_user(user_id=87160d947e3849fbacdb6e3b8b8ff8d1)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:51.718593 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf79d9-df72-4731-b06c-7425544b6de0 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:51.720658 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 147/287] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:51 2022] GET /identity/v3/users/87160d947e3849fbacdb6e3b8b8ff8d1 => generated 297 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:51.733545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf79d9-df72-4731-b06c-7425544b6de0 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:51.756944 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5634d3f-bdee-4380-8406-2107dfb87af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:51.758245 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5634d3f-bdee-4380-8406-2107dfb87af5 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:51.758757 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5634d3f-bdee-4380-8406-2107dfb87af5 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:51.759503 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5634d3f-bdee-4380-8406-2107dfb87af5 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:51.760747 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5634d3f-bdee-4380-8406-2107dfb87af5 None admin] RBAC: Adding query filter params (name=member) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:51.761391 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5634d3f-bdee-4380-8406-2107dfb87af5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:51.763081 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5634d3f-bdee-4380-8406-2107dfb87af5 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:51.783790 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 141/288] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:10:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:51.789836 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5634d3f-bdee-4380-8406-2107dfb87af5 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:51.860904 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf79d9-df72-4731-b06c-7425544b6de0 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:51.899030 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd277e-4d88-47b9-9d6a-1577dde91d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:51.899906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd277e-4d88-47b9-9d6a-1577dde91d45 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:51.900207 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd277e-4d88-47b9-9d6a-1577dde91d45 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:51.900482 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd277e-4d88-47b9-9d6a-1577dde91d45 None admin] PATH_INFO: `/v3/projects/ff00118a162648a38b9438404dd67916` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:51.902140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd277e-4d88-47b9-9d6a-1577dde91d45 None admin] RBAC: Authorizing `identity:get_project(project_id=ff00118a162648a38b9438404dd67916)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:51.903833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd277e-4d88-47b9-9d6a-1577dde91d45 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:51.905936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 148/289] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:51 2022] GET /identity/v3/projects/ff00118a162648a38b9438404dd67916 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:51.912696 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd277e-4d88-47b9-9d6a-1577dde91d45 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:52.030026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd277e-4d88-47b9-9d6a-1577dde91d45 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:52.070428 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5634d3f-bdee-4380-8406-2107dfb87af5 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:52.070817 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dd1b2-1db9-48d6-a71f-d1d1f4bd930c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:52.072106 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dd1b2-1db9-48d6-a71f-d1d1f4bd930c None admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:52.072574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dd1b2-1db9-48d6-a71f-d1d1f4bd930c None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:52.072987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dd1b2-1db9-48d6-a71f-d1d1f4bd930c None admin] PATH_INFO: `/v3/projects/ff00118a162648a38b9438404dd67916/users/87160d947e3849fbacdb6e3b8b8ff8d1/roles/f7d1ff112a024e3190daa30a7814e054` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:52.076925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6dd1b2-1db9-48d6-a71f-d1d1f4bd930c None admin] RBAC: Authorizing `identity:create_grant(project_id=ff00118a162648a38b9438404dd67916, user_id=87160d947e3849fbacdb6e3b8b8ff8d1, role_id=f7d1ff112a024e3190daa30a7814e054)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:52.079823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6dd1b2-1db9-48d6-a71f-d1d1f4bd930c None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:52.104245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 149/290] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:10:51 2022] PUT /identity/v3/projects/ff00118a162648a38b9438404dd67916/users/87160d947e3849fbacdb6e3b8b8ff8d1/roles/f7d1ff112a024e3190daa30a7814e054 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:10:52.154542 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1db1f-a57b-4bd2-a366-f38c57c7a702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:52.155453 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1db1f-a57b-4bd2-a366-f38c57c7a702 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:52.155800 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1db1f-a57b-4bd2-a366-f38c57c7a702 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:52.156140 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1db1f-a57b-4bd2-a366-f38c57c7a702 None admin] PATH_INFO: `/v3/users/e60d9b29780a442aa978a5697cb27bb1` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:52.158801 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1db1f-a57b-4bd2-a366-f38c57c7a702 None admin] RBAC: Authorizing `identity:get_user(user_id=e60d9b29780a442aa978a5697cb27bb1)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:52.160413 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1db1f-a57b-4bd2-a366-f38c57c7a702 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:52.162370 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 142/291] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:51 2022] GET /identity/v3/users/e60d9b29780a442aa978a5697cb27bb1 => generated 297 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:52.168234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dd1b2-1db9-48d6-a71f-d1d1f4bd930c None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:52.416685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dd1b2-1db9-48d6-a71f-d1d1f4bd930c None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:52.483996 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2f6c7-c9b0-49c0-b054-1feb1d9cc609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:52.485019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2f6c7-c9b0-49c0-b054-1feb1d9cc609 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:52.485374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2f6c7-c9b0-49c0-b054-1feb1d9cc609 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:52.485682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2f6c7-c9b0-49c0-b054-1feb1d9cc609 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:52.587667 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2f6c7-c9b0-49c0-b054-1feb1d9cc609 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:52.589583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2f6c7-c9b0-49c0-b054-1feb1d9cc609 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:52.710253 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 150/292] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:10:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:10:52.721323 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1db1f-a57b-4bd2-a366-f38c57c7a702 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:52.898498 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1db1f-a57b-4bd2-a366-f38c57c7a702 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:52.948603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59a2af-ba06-4941-90f9-024d8a4955ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:52.949456 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59a2af-ba06-4941-90f9-024d8a4955ff None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:52.949732 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59a2af-ba06-4941-90f9-024d8a4955ff None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:52.949999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59a2af-ba06-4941-90f9-024d8a4955ff None admin] PATH_INFO: `/v3/projects/ff00118a162648a38b9438404dd67916` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:52.957340 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59a2af-ba06-4941-90f9-024d8a4955ff None admin] RBAC: Authorizing `identity:get_project(project_id=ff00118a162648a38b9438404dd67916)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:52.958858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59a2af-ba06-4941-90f9-024d8a4955ff None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:52.961033 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 143/293] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:52 2022] GET /identity/v3/projects/ff00118a162648a38b9438404dd67916 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:52.966731 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2f6c7-c9b0-49c0-b054-1feb1d9cc609 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:53.092205 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2f6c7-c9b0-49c0-b054-1feb1d9cc609 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:53.139620 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0689ea-e3f3-4808-8a0a-c7d813896802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:53.141385 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0689ea-e3f3-4808-8a0a-c7d813896802 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:53.141946 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0689ea-e3f3-4808-8a0a-c7d813896802 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:53.142461 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0689ea-e3f3-4808-8a0a-c7d813896802 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:53.143531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0689ea-e3f3-4808-8a0a-c7d813896802 None admin] RBAC: Adding query filter params (role.id=99462c05ed484212893d40128c99f47c, scope.project.id=ff00118a162648a38b9438404dd67916, user.id=e60d9b29780a442aa978a5697cb27bb1) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:53.144060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0689ea-e3f3-4808-8a0a-c7d813896802 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:53.146421 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0689ea-e3f3-4808-8a0a-c7d813896802 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:53.153775 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 151/294] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:10:52 2022] GET /identity/v3/role_assignments?user.id=e60d9b29780a442aa978a5697cb27bb1&scope.project.id=ff00118a162648a38b9438404dd67916&role.id=99462c05ed484212893d40128c99f47c => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:53.740055 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d6631-7c42-4d2c-a4ef-d0c1f7c0910b None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:53.740647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d6631-7c42-4d2c-a4ef-d0c1f7c0910b None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:53.741090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d6631-7c42-4d2c-a4ef-d0c1f7c0910b None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:53.743776 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 144/295] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:53.755955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b6241-22cc-407f-a328-341969c38759 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:53.757016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b6241-22cc-407f-a328-341969c38759 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:53.757765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b6241-22cc-407f-a328-341969c38759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:53.789071 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-d64b6241-22cc-407f-a328-341969c38759 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:53.791395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-d64b6241-22cc-407f-a328-341969c38759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:53.934445 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 152/296] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:53.976589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d6631-7c42-4d2c-a4ef-d0c1f7c0910b None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:54.012767 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2f2b7-4f88-4ed8-8fce-2089c17625b8 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:54.013391 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2f2b7-4f88-4ed8-8fce-2089c17625b8 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:54.013859 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2f2b7-4f88-4ed8-8fce-2089c17625b8 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:54.015993 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 153/297] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:10:54.021972 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b17aad-2eba-414f-a236-b4f37d8630ab None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:54.022600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b17aad-2eba-414f-a236-b4f37d8630ab None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:54.023085 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b17aad-2eba-414f-a236-b4f37d8630ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:54.041583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-d9b17aad-2eba-414f-a236-b4f37d8630ab None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:54.043122 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-d9b17aad-2eba-414f-a236-b4f37d8630ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:54.121074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 154/298] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:10:54.127497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d6631-7c42-4d2c-a4ef-d0c1f7c0910b None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:54.155775 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b17aad-2eba-414f-a236-b4f37d8630ab None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:54.169742 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4256cf4-a387-4f56-a7be-9c604c7119e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:54.170532 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4256cf4-a387-4f56-a7be-9c604c7119e0 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:54.170985 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4256cf4-a387-4f56-a7be-9c604c7119e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:54.171403 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4256cf4-a387-4f56-a7be-9c604c7119e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:54.172753 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4256cf4-a387-4f56-a7be-9c604c7119e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:54.174339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4256cf4-a387-4f56-a7be-9c604c7119e0 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:54.177186 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 145/299] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:10:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:54.184760 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4256cf4-a387-4f56-a7be-9c604c7119e0 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:54.317827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4256cf4-a387-4f56-a7be-9c604c7119e0 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:54.356611 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050b5d9-9aca-481a-b7b9-ac17b985dbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:54.357272 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b17aad-2eba-414f-a236-b4f37d8630ab None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:54.357749 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050b5d9-9aca-481a-b7b9-ac17b985dbda None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:54.358191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050b5d9-9aca-481a-b7b9-ac17b985dbda None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:54.358611 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050b5d9-9aca-481a-b7b9-ac17b985dbda None admin] PATH_INFO: `/v3/groups` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:54.359511 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050b5d9-9aca-481a-b7b9-ac17b985dbda None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:54.361273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050b5d9-9aca-481a-b7b9-ac17b985dbda None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:54.384827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 146/300] 10.222.0.71 () {60 vars in 1134 bytes} [Mon May 16 20:10:54 2022] POST /identity/v3/groups => generated 229 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:10:54.430818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933478d8-f324-4179-8652-01a5735bf050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:54.432632 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933478d8-f324-4179-8652-01a5735bf050 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:54.433381 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933478d8-f324-4179-8652-01a5735bf050 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:54.434066 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933478d8-f324-4179-8652-01a5735bf050 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:54.455829 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933478d8-f324-4179-8652-01a5735bf050 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:54.472121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-933478d8-f324-4179-8652-01a5735bf050 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:10:54.472121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:54.472121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:54.472121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:54.472121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:54.472121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:54.472121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:54.472121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:54.472121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:54.472121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:54.472121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:54.472121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:54.472121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:54.472121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:54.472121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:54.472121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:54.474175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:54.474175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:54.474175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:54.474175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:54.474175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:54.474175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:54.474175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:54.474175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:54.474175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:54.474175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:54.474175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:54.474175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:10:54.474175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:54.474175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:54.474175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:54.474175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:54.475959 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:54.475959 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:54.475959 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:54.475959 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:54.475959 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:54.475959 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:54.475959 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:54.475959 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:54.475959 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:54.475959 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:54.475959 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:10:54.475959 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:10:54.479888 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 155/301] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:54.490498 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050b5d9-9aca-481a-b7b9-ac17b985dbda None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:54.560826 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02d2db-fd1f-46b2-9fc8-df68c5338687 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:54.561114 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02d2db-fd1f-46b2-9fc8-df68c5338687 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:54.561399 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02d2db-fd1f-46b2-9fc8-df68c5338687 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:54.563153 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 156/302] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:54.569564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939dead-13c0-4311-a8ae-9ee32111512f None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:54.569759 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939dead-13c0-4311-a8ae-9ee32111512f None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:54.570100 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939dead-13c0-4311-a8ae-9ee32111512f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:54.591201 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-9939dead-13c0-4311-a8ae-9ee32111512f None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:54.592875 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-9939dead-13c0-4311-a8ae-9ee32111512f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:54.617748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050b5d9-9aca-481a-b7b9-ac17b985dbda None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:54.663407 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd6650-96ee-49d2-8d55-babdaaa4f53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:54.664141 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd6650-96ee-49d2-8d55-babdaaa4f53d None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:54.664506 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd6650-96ee-49d2-8d55-babdaaa4f53d None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:54.664782 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd6650-96ee-49d2-8d55-babdaaa4f53d None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:54.665555 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd6650-96ee-49d2-8d55-babdaaa4f53d None admin] RBAC: Adding query filter params (name=reader) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:54.665864 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd6650-96ee-49d2-8d55-babdaaa4f53d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:54.667297 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd6650-96ee-49d2-8d55-babdaaa4f53d None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:54.677721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 147/303] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:10:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:54.684315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd6650-96ee-49d2-8d55-babdaaa4f53d None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:54.693146 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 157/304] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:54.736464 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939dead-13c0-4311-a8ae-9ee32111512f None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:54.806774 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd6650-96ee-49d2-8d55-babdaaa4f53d None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:54.849718 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac934b-aceb-497b-9ab2-91f1aa1717bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:54.850530 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac934b-aceb-497b-9ab2-91f1aa1717bf None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:54.850813 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac934b-aceb-497b-9ab2-91f1aa1717bf None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:54.851089 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac934b-aceb-497b-9ab2-91f1aa1717bf None admin] PATH_INFO: `/v3/users/23da78a0e14f4fcfb4401c7db39c91d6` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:54.868366 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac934b-aceb-497b-9ab2-91f1aa1717bf None admin] RBAC: Authorizing `identity:get_user(user_id=23da78a0e14f4fcfb4401c7db39c91d6)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:54.869878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac934b-aceb-497b-9ab2-91f1aa1717bf None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:54.872048 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 148/305] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:54 2022] GET /identity/v3/users/23da78a0e14f4fcfb4401c7db39c91d6 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:54.878171 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac934b-aceb-497b-9ab2-91f1aa1717bf None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:54.907263 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939dead-13c0-4311-a8ae-9ee32111512f None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:54.945975 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e76985-a745-4e0b-b6a0-77a0e40de35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:54.947039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e76985-a745-4e0b-b6a0-77a0e40de35f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:54.947509 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e76985-a745-4e0b-b6a0-77a0e40de35f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:54.947929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e76985-a745-4e0b-b6a0-77a0e40de35f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:54.960420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e76985-a745-4e0b-b6a0-77a0e40de35f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:54.968652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-47e76985-a745-4e0b-b6a0-77a0e40de35f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:10:54.968652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:54.968652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:54.968652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:54.968652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:54.968652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:54.968652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:54.968652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:54.968652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:54.968652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:54.968652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:54.968652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:54.968652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:54.968652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:54.968652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:54.968652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:54.969653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:54.969653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:54.969653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:54.969653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:54.969653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:54.969653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:54.969653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:54.969653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:54.969653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:54.969653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:54.969653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:54.969653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:10:54.969653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:54.969653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:54.969653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:54.969653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:54.970450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:54.970450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:54.970450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:54.970450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:54.970450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:54.970450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:54.970450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:54.970450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:54.970450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:54.970450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:54.970450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:10:54.970450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:10:54.978843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 158/306] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:10:54.980127 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e76985-a745-4e0b-b6a0-77a0e40de35f None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:55.084706 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac934b-aceb-497b-9ab2-91f1aa1717bf None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:55.094373 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e76985-a745-4e0b-b6a0-77a0e40de35f None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:55.135625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb5be1-6e05-4dfd-9dcf-c62aebf916c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:55.136755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb5be1-6e05-4dfd-9dcf-c62aebf916c2 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:55.137243 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb5be1-6e05-4dfd-9dcf-c62aebf916c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:55.137706 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb5be1-6e05-4dfd-9dcf-c62aebf916c2 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:55.138654 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb5be1-6e05-4dfd-9dcf-c62aebf916c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:55.139323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb5be1-6e05-4dfd-9dcf-c62aebf916c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:55.141696 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb5be1-6e05-4dfd-9dcf-c62aebf916c2 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:55.151604 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f38b8-6fb9-43da-89c5-8a8eac4ee2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:55.152696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f38b8-6fb9-43da-89c5-8a8eac4ee2a7 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:55.153119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f38b8-6fb9-43da-89c5-8a8eac4ee2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:55.153529 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f38b8-6fb9-43da-89c5-8a8eac4ee2a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:55.154546 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f38b8-6fb9-43da-89c5-8a8eac4ee2a7 None admin] RBAC: Adding query filter params (role.id=f7d1ff112a024e3190daa30a7814e054, user.id=23da78a0e14f4fcfb4401c7db39c91d6, scope.system=all) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:55.155028 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f38b8-6fb9-43da-89c5-8a8eac4ee2a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:55.156819 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f38b8-6fb9-43da-89c5-8a8eac4ee2a7 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:55.158761 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 159/307] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:10:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:55.160788 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3934c-d83c-479a-addb-72f3a115e0cc None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:55.161262 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3934c-d83c-479a-addb-72f3a115e0cc None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:55.161692 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3934c-d83c-479a-addb-72f3a115e0cc None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:55.163234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 160/308] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:55.168549 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 149/309] 10.222.0.71 () {56 vars in 1308 bytes} [Mon May 16 20:10:54 2022] GET /identity/v3/role_assignments?user.id=23da78a0e14f4fcfb4401c7db39c91d6&scope.system=all&role.id=f7d1ff112a024e3190daa30a7814e054 => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:55.168980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3934c-d83c-479a-addb-72f3a115e0cc None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:55.171229 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88e7c9-a6af-4b1d-9ee6-dd087a3108d3 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:55.171893 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88e7c9-a6af-4b1d-9ee6-dd087a3108d3 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:55.172577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88e7c9-a6af-4b1d-9ee6-dd087a3108d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:55.208642 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-de88e7c9-a6af-4b1d-9ee6-dd087a3108d3 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:55.210535 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-de88e7c9-a6af-4b1d-9ee6-dd087a3108d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:55.320906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 150/310] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:55.325675 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3934c-d83c-479a-addb-72f3a115e0cc None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:55.344715 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88e7c9-a6af-4b1d-9ee6-dd087a3108d3 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:55.371277 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d501706-aafc-4771-9642-f3c1cc80a5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:55.372514 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d501706-aafc-4771-9642-f3c1cc80a5b3 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:55.372993 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d501706-aafc-4771-9642-f3c1cc80a5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:55.373439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d501706-aafc-4771-9642-f3c1cc80a5b3 None admin] PATH_INFO: `/v3/users/9f49ace51cc44130bbd52e112c57c3dd` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:55.375181 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d501706-aafc-4771-9642-f3c1cc80a5b3 None admin] RBAC: Authorizing `identity:get_user(user_id=9f49ace51cc44130bbd52e112c57c3dd)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:55.376909 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d501706-aafc-4771-9642-f3c1cc80a5b3 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:55.379980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 161/311] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:55 2022] GET /identity/v3/users/9f49ace51cc44130bbd52e112c57c3dd => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:55.386524 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d501706-aafc-4771-9642-f3c1cc80a5b3 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:55.515807 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88e7c9-a6af-4b1d-9ee6-dd087a3108d3 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:55.524485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d501706-aafc-4771-9642-f3c1cc80a5b3 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:55.559971 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687868ef-6f60-4e88-86b1-f6026c38af61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:55.560800 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687868ef-6f60-4e88-86b1-f6026c38af61 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:55.561076 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687868ef-6f60-4e88-86b1-f6026c38af61 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:55.561348 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687868ef-6f60-4e88-86b1-f6026c38af61 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:55.563731 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6ba7d-d96d-4448-8714-c75bfaf58ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:55.564897 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6ba7d-d96d-4448-8714-c75bfaf58ca5 None admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:55.565391 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6ba7d-d96d-4448-8714-c75bfaf58ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:55.565927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6ba7d-d96d-4448-8714-c75bfaf58ca5 None admin] PATH_INFO: `/v3/system/users/9f49ace51cc44130bbd52e112c57c3dd/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:55.567824 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6ba7d-d96d-4448-8714-c75bfaf58ca5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9f49ace51cc44130bbd52e112c57c3dd, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:55.569483 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6ba7d-d96d-4448-8714-c75bfaf58ca5 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:55.573006 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687868ef-6f60-4e88-86b1-f6026c38af61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:55.584928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-687868ef-6f60-4e88-86b1-f6026c38af61 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:10:55.584928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:55.584928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:55.584928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:55.584928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:55.584928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:55.584928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:55.584928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:55.584928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:55.584928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:55.584928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:55.584928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:55.584928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:55.584928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:55.584928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:55.584928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:55.585873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:55.585873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:55.585873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:55.585873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:55.585873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:55.585873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:55.585873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:55.585873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:55.585873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:55.585873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:55.585873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:55.585873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:10:55.585873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:55.585873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:55.585873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:55.585873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:55.586879 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:55.586879 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:55.586879 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:55.586879 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:55.586879 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:55.586879 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:55.586879 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:55.586879 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:55.586879 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:55.586879 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:55.586879 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:10:55.586879 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:10:55.586879 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 151/312] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:10:55.588854 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687868ef-6f60-4e88-86b1-f6026c38af61 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:55.592515 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 162/313] 10.222.0.71 () {58 vars in 1334 bytes} [Mon May 16 20:10:55 2022] PUT /identity/v3/system/users/9f49ace51cc44130bbd52e112c57c3dd/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:10:55.724863 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687868ef-6f60-4e88-86b1-f6026c38af61 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:55.766308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1a018-f540-4756-a6c0-a5f8b26782f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:55.766994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1a018-f540-4756-a6c0-a5f8b26782f8 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:55.767268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1a018-f540-4756-a6c0-a5f8b26782f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:55.767542 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1a018-f540-4756-a6c0-a5f8b26782f8 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:55.768346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1a018-f540-4756-a6c0-a5f8b26782f8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:55.768656 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1a018-f540-4756-a6c0-a5f8b26782f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:55.770229 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1a018-f540-4756-a6c0-a5f8b26782f8 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:55.780137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 152/314] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:10:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:55.785919 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6ba7d-d96d-4448-8714-c75bfaf58ca5 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:55.916975 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6ba7d-d96d-4448-8714-c75bfaf58ca5 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:55.957407 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a7290-357a-414c-8b4b-60f64496a774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:55.958682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a7290-357a-414c-8b4b-60f64496a774 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:55.959086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a7290-357a-414c-8b4b-60f64496a774 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:55.959370 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a7290-357a-414c-8b4b-60f64496a774 None admin] PATH_INFO: `/v3/users/87160d947e3849fbacdb6e3b8b8ff8d1` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:55.960793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a7290-357a-414c-8b4b-60f64496a774 None admin] RBAC: Authorizing `identity:get_user(user_id=87160d947e3849fbacdb6e3b8b8ff8d1)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:55.962281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a7290-357a-414c-8b4b-60f64496a774 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:55.964449 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 163/315] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:55 2022] GET /identity/v3/users/87160d947e3849fbacdb6e3b8b8ff8d1 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:55.969861 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1a018-f540-4756-a6c0-a5f8b26782f8 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:56.090341 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1a018-f540-4756-a6c0-a5f8b26782f8 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:56.128035 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057f7ef-820a-46ae-acdc-30598e9d8f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:56.128775 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057f7ef-820a-46ae-acdc-30598e9d8f48 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:56.129106 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057f7ef-820a-46ae-acdc-30598e9d8f48 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:56.129425 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057f7ef-820a-46ae-acdc-30598e9d8f48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:56.204211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057f7ef-820a-46ae-acdc-30598e9d8f48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:56.204211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057f7ef-820a-46ae-acdc-30598e9d8f48 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:56.310689 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 153/316] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:10:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:10:56.316400 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a7290-357a-414c-8b4b-60f64496a774 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:56.452618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a7290-357a-414c-8b4b-60f64496a774 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:56.504389 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1cf92-33a9-4e77-80c4-20248ce7df89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:56.505520 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1cf92-33a9-4e77-80c4-20248ce7df89 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:56.505804 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1cf92-33a9-4e77-80c4-20248ce7df89 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:56.506083 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1cf92-33a9-4e77-80c4-20248ce7df89 None admin] PATH_INFO: `/v3/projects/ff00118a162648a38b9438404dd67916` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:56.507349 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1cf92-33a9-4e77-80c4-20248ce7df89 None admin] RBAC: Authorizing `identity:get_project(project_id=ff00118a162648a38b9438404dd67916)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:56.508827 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1cf92-33a9-4e77-80c4-20248ce7df89 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:56.510926 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 164/317] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:10:56 2022] GET /identity/v3/projects/ff00118a162648a38b9438404dd67916 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:56.516851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057f7ef-820a-46ae-acdc-30598e9d8f48 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:56.634800 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057f7ef-820a-46ae-acdc-30598e9d8f48 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:56.672940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051f5c6-0b96-4820-9a7d-654835026ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:56.673594 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051f5c6-0b96-4820-9a7d-654835026ba1 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:56.673867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051f5c6-0b96-4820-9a7d-654835026ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:56.674136 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051f5c6-0b96-4820-9a7d-654835026ba1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:56.674970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051f5c6-0b96-4820-9a7d-654835026ba1 None admin] RBAC: Adding query filter params (role.id=f7d1ff112a024e3190daa30a7814e054, scope.project.id=ff00118a162648a38b9438404dd67916, user.id=87160d947e3849fbacdb6e3b8b8ff8d1) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:56.675913 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051f5c6-0b96-4820-9a7d-654835026ba1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:56.677437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051f5c6-0b96-4820-9a7d-654835026ba1 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:56.684452 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 154/318] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:10:56 2022] GET /identity/v3/role_assignments?user.id=87160d947e3849fbacdb6e3b8b8ff8d1&scope.project.id=ff00118a162648a38b9438404dd67916&role.id=f7d1ff112a024e3190daa30a7814e054 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:56.973901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000048d-48f4-49c9-8568-b0fe47a86da4 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:56.974868 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000048d-48f4-49c9-8568-b0fe47a86da4 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:56.975542 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000048d-48f4-49c9-8568-b0fe47a86da4 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:56.978092 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 165/319] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:56.983726 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5117d9-74b3-4c51-99f4-feb2c25d80f2 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:56.984369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5117d9-74b3-4c51-99f4-feb2c25d80f2 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:56.984369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5117d9-74b3-4c51-99f4-feb2c25d80f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:57.004796 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-8b5117d9-74b3-4c51-99f4-feb2c25d80f2 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:57.006028 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8b5117d9-74b3-4c51-99f4-feb2c25d80f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:57.082588 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 155/320] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:10:57.105922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000048d-48f4-49c9-8568-b0fe47a86da4 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:57.278570 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000048d-48f4-49c9-8568-b0fe47a86da4 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:57.338308 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6215603-0ef8-41ed-af6b-739a67176686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:57.339664 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6215603-0ef8-41ed-af6b-739a67176686 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:57.340181 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6215603-0ef8-41ed-af6b-739a67176686 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:57.340692 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6215603-0ef8-41ed-af6b-739a67176686 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:57.342819 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6215603-0ef8-41ed-af6b-739a67176686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:57.345593 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6215603-0ef8-41ed-af6b-739a67176686 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:57.349051 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 166/321] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:10:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:57.358182 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5117d9-74b3-4c51-99f4-feb2c25d80f2 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:57.536532 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5117d9-74b3-4c51-99f4-feb2c25d80f2 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:57.599476 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3407ae4-097b-41fd-acc8-6beef535db03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:57.600659 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3407ae4-097b-41fd-acc8-6beef535db03 None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:57.601168 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3407ae4-097b-41fd-acc8-6beef535db03 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:57.601659 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3407ae4-097b-41fd-acc8-6beef535db03 None admin] PATH_INFO: `/v3/groups` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:57.602947 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3407ae4-097b-41fd-acc8-6beef535db03 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:57.605629 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3407ae4-097b-41fd-acc8-6beef535db03 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:57.631282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 156/322] 10.222.0.71 () {60 vars in 1134 bytes} [Mon May 16 20:10:57 2022] POST /identity/v3/groups => generated 226 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:10:57.725186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3e76c-ebe0-47ed-80de-d2cfc3a504c2 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:57.725516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3e76c-ebe0-47ed-80de-d2cfc3a504c2 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:57.725750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3e76c-ebe0-47ed-80de-d2cfc3a504c2 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:57.727369 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 167/323] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:57.733229 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fff2d5-0ca9-4b90-82ad-56bbac1f6636 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:57.733612 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fff2d5-0ca9-4b90-82ad-56bbac1f6636 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:57.733831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fff2d5-0ca9-4b90-82ad-56bbac1f6636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:57.752308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-95fff2d5-0ca9-4b90-82ad-56bbac1f6636 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:57.753593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-95fff2d5-0ca9-4b90-82ad-56bbac1f6636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:57.836140 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 157/324] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:10:57.859533 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3e76c-ebe0-47ed-80de-d2cfc3a504c2 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:57.999571 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3e76c-ebe0-47ed-80de-d2cfc3a504c2 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:58.059658 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12409a49-e8bc-47c1-b3f2-233d29fbd707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:58.060516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12409a49-e8bc-47c1-b3f2-233d29fbd707 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:58.060801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12409a49-e8bc-47c1-b3f2-233d29fbd707 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:58.061074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12409a49-e8bc-47c1-b3f2-233d29fbd707 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:58.073473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12409a49-e8bc-47c1-b3f2-233d29fbd707 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:58.082152 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-12409a49-e8bc-47c1-b3f2-233d29fbd707 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:10:58.082152 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:58.082152 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:58.082152 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:58.082152 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:58.082152 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:58.082152 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:58.082152 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:58.082152 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:58.082152 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:58.082152 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:58.082152 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:58.082152 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:58.082152 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:58.082152 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:58.082152 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:58.083118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:58.083118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:58.083118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:58.083118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:58.083118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:58.083118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:58.083118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:58.083118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:58.083118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:58.083118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:58.083118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:58.083118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:10:58.083118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:58.083118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:58.083118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:58.083118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:58.083900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:58.083900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:58.083900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:58.083900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:58.083900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:58.083900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:58.083900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:58.083900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:58.083900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:58.083900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:58.083900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:10:58.083900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:10:58.084531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 168/325] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:10:58.091142 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fff2d5-0ca9-4b90-82ad-56bbac1f6636 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:58.215075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fff2d5-0ca9-4b90-82ad-56bbac1f6636 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:58.254695 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a6bf5-58b0-4d46-9cac-dbd0dc38c577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:58.255382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a6bf5-58b0-4d46-9cac-dbd0dc38c577 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:58.255692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a6bf5-58b0-4d46-9cac-dbd0dc38c577 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:58.255936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a6bf5-58b0-4d46-9cac-dbd0dc38c577 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:58.256777 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a6bf5-58b0-4d46-9cac-dbd0dc38c577 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:58.257340 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a6bf5-58b0-4d46-9cac-dbd0dc38c577 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:58.258614 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a6bf5-58b0-4d46-9cac-dbd0dc38c577 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:58.259332 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c43209-6798-4be6-9ca0-f007b77d8dea None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:58.259818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c43209-6798-4be6-9ca0-f007b77d8dea None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:58.260336 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c43209-6798-4be6-9ca0-f007b77d8dea None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:58.261738 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 169/326] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:10:58.268006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783893a-8bf3-417f-bc2e-8af54fd82908 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:58.268343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783893a-8bf3-417f-bc2e-8af54fd82908 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:58.268607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783893a-8bf3-417f-bc2e-8af54fd82908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:58.270576 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 158/327] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:10:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:58.277776 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a6bf5-58b0-4d46-9cac-dbd0dc38c577 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:58.292716 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-d783893a-8bf3-417f-bc2e-8af54fd82908 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:10:58.294150 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-d783893a-8bf3-417f-bc2e-8af54fd82908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:10:58.397773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 170/328] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:10:58.429233 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783893a-8bf3-417f-bc2e-8af54fd82908 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:58.439708 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a6bf5-58b0-4d46-9cac-dbd0dc38c577 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:58.500918 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13dd81-3e97-4e15-9560-b7d9ebd57e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:58.502279 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13dd81-3e97-4e15-9560-b7d9ebd57e35 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:58.502960 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13dd81-3e97-4e15-9560-b7d9ebd57e35 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:58.504226 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13dd81-3e97-4e15-9560-b7d9ebd57e35 None admin] PATH_INFO: `/v3/users/23da78a0e14f4fcfb4401c7db39c91d6` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:58.507722 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13dd81-3e97-4e15-9560-b7d9ebd57e35 None admin] RBAC: Authorizing `identity:get_user(user_id=23da78a0e14f4fcfb4401c7db39c91d6)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:58.509367 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13dd81-3e97-4e15-9560-b7d9ebd57e35 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:58.511199 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 159/329] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:58 2022] GET /identity/v3/users/23da78a0e14f4fcfb4401c7db39c91d6 => generated 293 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:58.516837 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13dd81-3e97-4e15-9560-b7d9ebd57e35 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:58.577721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783893a-8bf3-417f-bc2e-8af54fd82908 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:58.626173 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9d26f-7e59-48e9-a0eb-2045bc0a916b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:58.627408 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9d26f-7e59-48e9-a0eb-2045bc0a916b None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:58.627981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9d26f-7e59-48e9-a0eb-2045bc0a916b None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:58.628987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9d26f-7e59-48e9-a0eb-2045bc0a916b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:58.645370 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9d26f-7e59-48e9-a0eb-2045bc0a916b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:10:58.653773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-72d9d26f-7e59-48e9-a0eb-2045bc0a916b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:10:58.653773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:10:58.653773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:10:58.653773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:10:58.653773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:10:58.653773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:10:58.653773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:10:58.653773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:10:58.653773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:10:58.653773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:10:58.653773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:10:58.653773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:10:58.653773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:10:58.653773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:10:58.653773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:10:58.653773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:10:58.654813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:10:58.654813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:10:58.654813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:10:58.654813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:10:58.654813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:10:58.654813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:10:58.654813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:10:58.654813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:10:58.654813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:10:58.654813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:10:58.654813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:10:58.654813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:10:58.654813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:10:58.654813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:10:58.654813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:10:58.654813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:10:58.655600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:10:58.655600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:10:58.655600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:10:58.655600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:10:58.655600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:10:58.655600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:10:58.655600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:10:58.655600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:10:58.655600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:10:58.655600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:10:58.655600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:10:58.655600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:10:58.657955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 171/330] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:10:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:10:58.665262 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9d26f-7e59-48e9-a0eb-2045bc0a916b None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:58.709209 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13dd81-3e97-4e15-9560-b7d9ebd57e35 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:58.757296 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d9253-b503-4243-8b66-6e71aba7db1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:58.758345 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d9253-b503-4243-8b66-6e71aba7db1e None admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:58.758727 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d9253-b503-4243-8b66-6e71aba7db1e None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:58.759122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d9253-b503-4243-8b66-6e71aba7db1e None admin] PATH_INFO: `/v3/system/users/23da78a0e14f4fcfb4401c7db39c91d6/roles/f7d1ff112a024e3190daa30a7814e054` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:58.760891 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d9253-b503-4243-8b66-6e71aba7db1e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=23da78a0e14f4fcfb4401c7db39c91d6, role_id=f7d1ff112a024e3190daa30a7814e054)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:58.762460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d9253-b503-4243-8b66-6e71aba7db1e None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:58.778843 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 160/331] 10.222.0.71 () {58 vars in 1334 bytes} [Mon May 16 20:10:58 2022] PUT /identity/v3/system/users/23da78a0e14f4fcfb4401c7db39c91d6/roles/f7d1ff112a024e3190daa30a7814e054 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:10:58.788023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9d26f-7e59-48e9-a0eb-2045bc0a916b None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:58.832069 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc9623-8a0e-4e04-a9eb-782931c117af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:58.833790 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc9623-8a0e-4e04-a9eb-782931c117af None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:58.834325 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc9623-8a0e-4e04-a9eb-782931c117af None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:58.834763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc9623-8a0e-4e04-a9eb-782931c117af None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:58.835750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc9623-8a0e-4e04-a9eb-782931c117af None admin] RBAC: Adding query filter params (name=member) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:58.836280 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc9623-8a0e-4e04-a9eb-782931c117af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:58.837936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc9623-8a0e-4e04-a9eb-782931c117af None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:58.849641 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 172/332] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:10:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:10:58.856025 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d9253-b503-4243-8b66-6e71aba7db1e None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:58.994815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d9253-b503-4243-8b66-6e71aba7db1e None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:59.041728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d6618-43c5-4798-9cac-190a0e7bc09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:59.042957 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d6618-43c5-4798-9cac-190a0e7bc09a None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:59.043440 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d6618-43c5-4798-9cac-190a0e7bc09a None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:59.043958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d6618-43c5-4798-9cac-190a0e7bc09a None admin] PATH_INFO: `/v3/users/9f49ace51cc44130bbd52e112c57c3dd` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:59.045710 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d6618-43c5-4798-9cac-190a0e7bc09a None admin] RBAC: Authorizing `identity:get_user(user_id=9f49ace51cc44130bbd52e112c57c3dd)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:59.047462 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d6618-43c5-4798-9cac-190a0e7bc09a None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:59.049953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 161/333] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:10:58 2022] GET /identity/v3/users/9f49ace51cc44130bbd52e112c57c3dd => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:10:59.058279 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc9623-8a0e-4e04-a9eb-782931c117af None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:10:59.280031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc9623-8a0e-4e04-a9eb-782931c117af None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:10:59.327389 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba86bc5-280b-42ab-9aa7-def39bbe31d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:10:59.328065 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba86bc5-280b-42ab-9aa7-def39bbe31d0 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:10:59.328428 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba86bc5-280b-42ab-9aa7-def39bbe31d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:10:59.328950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba86bc5-280b-42ab-9aa7-def39bbe31d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:10:59.330379 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba86bc5-280b-42ab-9aa7-def39bbe31d0 None admin] RBAC: Adding query filter params (role.id=99462c05ed484212893d40128c99f47c, user.id=9f49ace51cc44130bbd52e112c57c3dd, scope.system=all) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:10:59.330926 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba86bc5-280b-42ab-9aa7-def39bbe31d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:10:59.334498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba86bc5-280b-42ab-9aa7-def39bbe31d0 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:10:59.359832 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 173/334] 10.222.0.71 () {56 vars in 1308 bytes} [Mon May 16 20:10:59 2022] GET /identity/v3/role_assignments?user.id=9f49ace51cc44130bbd52e112c57c3dd&scope.system=all&role.id=99462c05ed484212893d40128c99f47c => generated 510 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:11:02.372906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716963ab-b751-4869-9683-148bf48cd4eb None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:02.373857 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716963ab-b751-4869-9683-148bf48cd4eb None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:02.374276 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716963ab-b751-4869-9683-148bf48cd4eb None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:02.376213 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 162/335] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:02.386304 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd82f46-8374-478d-80cb-79e77041d6fb None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:02.386846 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd82f46-8374-478d-80cb-79e77041d6fb None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:02.387228 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd82f46-8374-478d-80cb-79e77041d6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:02.422814 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-dbd82f46-8374-478d-80cb-79e77041d6fb None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:02.424143 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-dbd82f46-8374-478d-80cb-79e77041d6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:02.527178 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 174/336] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:11:02.555907 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3811f-5219-4cb0-be92-ab26a2e89936 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:02.556446 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3811f-5219-4cb0-be92-ab26a2e89936 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:02.556909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3811f-5219-4cb0-be92-ab26a2e89936 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:02.558816 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 163/337] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:02.569861 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd82f46-8374-478d-80cb-79e77041d6fb None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:02.573790 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66206ee3-c80e-43dd-9ed3-2c451326b20e None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:02.574325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66206ee3-c80e-43dd-9ed3-2c451326b20e None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:02.574819 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66206ee3-c80e-43dd-9ed3-2c451326b20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:02.599656 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-66206ee3-c80e-43dd-9ed3-2c451326b20e None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:02.601247 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-66206ee3-c80e-43dd-9ed3-2c451326b20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:02.754876 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 164/338] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:11:02.756751 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36973fd-36b3-460f-8e60-f29876c7b443 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:02.756966 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36973fd-36b3-460f-8e60-f29876c7b443 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:02.757304 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36973fd-36b3-460f-8e60-f29876c7b443 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:02.759727 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 165/339] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:02.767018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955c30f-a648-4582-98f1-598e26c6f80e None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:02.767525 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955c30f-a648-4582-98f1-598e26c6f80e None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:02.767999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955c30f-a648-4582-98f1-598e26c6f80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:02.806878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd82f46-8374-478d-80cb-79e77041d6fb None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:02.807566 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-8955c30f-a648-4582-98f1-598e26c6f80e None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:02.809119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8955c30f-a648-4582-98f1-598e26c6f80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:02.855006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3441c7-7761-4264-bf54-11ea1f42b987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:02.855900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3441c7-7761-4264-bf54-11ea1f42b987 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:02.857044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3441c7-7761-4264-bf54-11ea1f42b987 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:02.857344 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3441c7-7761-4264-bf54-11ea1f42b987 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:02.877847 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3441c7-7761-4264-bf54-11ea1f42b987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:02.903221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-9c3441c7-7761-4264-bf54-11ea1f42b987 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:11:02.903221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:02.903221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:02.903221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:02.903221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:02.903221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:02.903221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:02.903221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:02.903221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:02.903221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:02.903221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:02.903221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:02.903221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:02.903221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:02.903221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:02.903221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:02.904245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:02.904245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:02.904245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:02.904245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:02.904245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:02.904245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:02.904245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:02.904245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:02.904245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:02.904245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:02.904245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:02.904245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:02.904245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:02.904245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:02.904245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:02.904245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:02.905031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:02.905031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:02.905031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:02.905031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:02.905031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:02.905031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:02.905031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:02.905031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:02.905031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:02.905031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:02.905031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:11:02.905031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:02.905642 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 175/340] 10.222.0.71 () {56 vars in 1114 bytes} [Mon May 16 20:11:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:02.907334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3441c7-7761-4264-bf54-11ea1f42b987 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:02.908623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 166/341] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:02.910109 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb14ef-4e68-49af-a9e9-815a44e3e454 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:02.910397 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb14ef-4e68-49af-a9e9-815a44e3e454 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:02.910669 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb14ef-4e68-49af-a9e9-815a44e3e454 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:02.916281 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 167/342] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:02.919519 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fe025-fbd8-4ea2-aebb-a0a63246e5eb None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:02.919806 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fe025-fbd8-4ea2-aebb-a0a63246e5eb None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:02.920379 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fe025-fbd8-4ea2-aebb-a0a63246e5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:02.942064 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-3e8fe025-fbd8-4ea2-aebb-a0a63246e5eb None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:02.943894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-3e8fe025-fbd8-4ea2-aebb-a0a63246e5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:03.026787 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 168/343] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:11:03.027713 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fe025-fbd8-4ea2-aebb-a0a63246e5eb None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:03.064198 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3441c7-7761-4264-bf54-11ea1f42b987 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:03.122569 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5ef5c-4fda-42e1-a000-fa402e0eac38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:03.123722 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5ef5c-4fda-42e1-a000-fa402e0eac38 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:03.124272 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5ef5c-4fda-42e1-a000-fa402e0eac38 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:03.124698 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5ef5c-4fda-42e1-a000-fa402e0eac38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:03.141753 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5ef5c-4fda-42e1-a000-fa402e0eac38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:03.153016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-07b5ef5c-4fda-42e1-a000-fa402e0eac38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:11:03.153016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:03.153016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:03.153016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:03.153016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:03.153016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:03.153016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:03.153016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:03.153016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:03.153016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:03.153016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:03.153016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:03.153016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:03.153016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:03.153016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:03.153016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:03.154159 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:03.154159 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:03.154159 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:03.154159 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:03.154159 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:03.154159 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:03.154159 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:03.154159 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:03.154159 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:03.154159 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:03.154159 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:03.154159 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:03.154159 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:03.154159 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:03.154159 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:03.154159 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:03.155039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:03.155039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:03.155039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:03.155039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:03.155039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:03.155039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:03.155039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:03.155039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:03.155039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:03.155039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:03.155039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:11:03.155039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:03.155039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 176/344] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:11:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:03.155741 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5ef5c-4fda-42e1-a000-fa402e0eac38 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:03.169903 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fe025-fbd8-4ea2-aebb-a0a63246e5eb None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:03.223178 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c315228-f721-4ac7-ad60-9e8f094b9d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:03.223859 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c315228-f721-4ac7-ad60-9e8f094b9d15 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:03.224137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c315228-f721-4ac7-ad60-9e8f094b9d15 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:03.224458 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c315228-f721-4ac7-ad60-9e8f094b9d15 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:03.225216 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c315228-f721-4ac7-ad60-9e8f094b9d15 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:03.225515 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c315228-f721-4ac7-ad60-9e8f094b9d15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:03.230632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c315228-f721-4ac7-ad60-9e8f094b9d15 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:03.242063 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 169/345] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:03.243513 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e231c5c-15b2-42fc-a8f7-e34dbf6bbd3f None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:03.243802 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e231c5c-15b2-42fc-a8f7-e34dbf6bbd3f None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:03.244075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e231c5c-15b2-42fc-a8f7-e34dbf6bbd3f None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:03.245621 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 170/346] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:03.246189 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e231c5c-15b2-42fc-a8f7-e34dbf6bbd3f None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:03.340025 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5ef5c-4fda-42e1-a000-fa402e0eac38 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:03.391043 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf28fb5-40e6-4ed0-b780-23259b4a9a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:03.391663 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e231c5c-15b2-42fc-a8f7-e34dbf6bbd3f None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:03.392046 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf28fb5-40e6-4ed0-b780-23259b4a9a98 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:03.392046 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf28fb5-40e6-4ed0-b780-23259b4a9a98 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:03.392437 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf28fb5-40e6-4ed0-b780-23259b4a9a98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:03.408190 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf28fb5-40e6-4ed0-b780-23259b4a9a98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:03.415574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-9cf28fb5-40e6-4ed0-b780-23259b4a9a98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:11:03.415574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:03.415574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:03.415574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:03.415574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:03.415574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:03.415574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:03.415574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:03.415574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:03.415574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:03.415574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:03.415574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:03.415574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:03.415574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:03.415574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:03.415574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:03.416633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:03.416633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:03.416633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:03.416633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:03.416633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:03.416633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:03.416633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:03.416633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:03.416633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:03.416633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:03.416633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:03.416633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:03.416633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:03.416633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:03.416633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:03.416633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:03.417473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:03.417473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:03.417473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:03.417473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:03.417473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:03.417473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:03.417473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:03.417473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:03.417473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:03.417473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:03.417473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:11:03.417473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:03.417473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 177/347] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:11:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:03.418153 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf28fb5-40e6-4ed0-b780-23259b4a9a98 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:03.428486 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d5c66-b9a3-41cd-877f-a8cad6b7d9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:03.429277 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d5c66-b9a3-41cd-877f-a8cad6b7d9df None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:03.429551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d5c66-b9a3-41cd-877f-a8cad6b7d9df None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:03.429819 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d5c66-b9a3-41cd-877f-a8cad6b7d9df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:03.442775 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d5c66-b9a3-41cd-877f-a8cad6b7d9df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:03.450572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-9b6d5c66-b9a3-41cd-877f-a8cad6b7d9df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:11:03.450572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:03.450572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:03.450572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:03.450572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:03.450572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:03.450572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:03.450572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:03.450572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:03.450572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:03.450572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:03.450572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:03.450572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:03.450572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:03.450572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:03.450572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:03.451474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:03.451474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:03.451474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:03.451474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:03.451474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:03.451474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:03.451474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:03.451474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:03.451474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:03.451474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:03.451474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:03.451474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:03.451474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:03.451474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:03.451474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:03.451474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:03.452284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:03.452284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:03.452284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:03.452284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:03.452284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:03.452284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:03.452284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:03.452284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:03.452284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:03.452284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:03.452284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 20:11:03.452284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:03.452284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 171/348] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:11:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:03.453436 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8395398-5260-45ad-9929-69c56738007a None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:03.453961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8395398-5260-45ad-9929-69c56738007a None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:03.453961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8395398-5260-45ad-9929-69c56738007a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:03.472621 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-c8395398-5260-45ad-9929-69c56738007a None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:03.473895 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c8395398-5260-45ad-9929-69c56738007a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:03.526931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf28fb5-40e6-4ed0-b780-23259b4a9a98 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:03.544780 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 172/349] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:03.545720 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8395398-5260-45ad-9929-69c56738007a None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:03.563905 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ad44b-170d-4a54-b9ef-fe64a8fdee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:03.564662 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ad44b-170d-4a54-b9ef-fe64a8fdee05 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:03.564941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ad44b-170d-4a54-b9ef-fe64a8fdee05 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:03.565210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ad44b-170d-4a54-b9ef-fe64a8fdee05 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:03.567052 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ad44b-170d-4a54-b9ef-fe64a8fdee05 None admin] RBAC: Adding query filter params (name=member) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:03.567166 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ad44b-170d-4a54-b9ef-fe64a8fdee05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:03.568529 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ad44b-170d-4a54-b9ef-fe64a8fdee05 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:03.577196 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 178/350] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:11:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:03.579536 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ad44b-170d-4a54-b9ef-fe64a8fdee05 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:03.668082 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8395398-5260-45ad-9929-69c56738007a None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:03.697251 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ad44b-170d-4a54-b9ef-fe64a8fdee05 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:03.716951 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2de17-e3fb-4da6-a847-6986c3895163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:03.717411 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2de17-e3fb-4da6-a847-6986c3895163 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:03.717923 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2de17-e3fb-4da6-a847-6986c3895163 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:03.718289 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2de17-e3fb-4da6-a847-6986c3895163 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:03.747042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6b0fb-2830-410e-b4e4-6a60dad48bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:03.748067 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6b0fb-2830-410e-b4e4-6a60dad48bfb None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:03.748380 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6b0fb-2830-410e-b4e4-6a60dad48bfb None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:03.748666 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6b0fb-2830-410e-b4e4-6a60dad48bfb None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:03.749449 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6b0fb-2830-410e-b4e4-6a60dad48bfb None admin] RBAC: Adding query filter params (name=member) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:03.749761 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6b0fb-2830-410e-b4e4-6a60dad48bfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:03.751186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6b0fb-2830-410e-b4e4-6a60dad48bfb None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:03.761076 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 179/351] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:11:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:03.761879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6b0fb-2830-410e-b4e4-6a60dad48bfb None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:03.829509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2de17-e3fb-4da6-a847-6986c3895163 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:03.831095 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2de17-e3fb-4da6-a847-6986c3895163 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:03.913258 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6b0fb-2830-410e-b4e4-6a60dad48bfb None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:03.966410 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4bea6-bb71-4f13-8446-da506576a926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:03.967126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4bea6-bb71-4f13-8446-da506576a926 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:03.967271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4bea6-bb71-4f13-8446-da506576a926 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:03.967604 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4bea6-bb71-4f13-8446-da506576a926 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:03.968370 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4bea6-bb71-4f13-8446-da506576a926 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:03.968662 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4bea6-bb71-4f13-8446-da506576a926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:03.970083 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4bea6-bb71-4f13-8446-da506576a926 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:03.985888 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 180/352] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:11:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:03.988320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8ea74-b4f7-49e9-a7aa-2b0c9f68dfd2 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:03.988800 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8ea74-b4f7-49e9-a7aa-2b0c9f68dfd2 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:03.989353 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8ea74-b4f7-49e9-a7aa-2b0c9f68dfd2 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:03.991710 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 181/353] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:03.992553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 173/354] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:11:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:11:03.993111 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8ea74-b4f7-49e9-a7aa-2b0c9f68dfd2 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:03.993416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2de17-e3fb-4da6-a847-6986c3895163 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:04.139406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8ea74-b4f7-49e9-a7aa-2b0c9f68dfd2 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:04.154787 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2de17-e3fb-4da6-a847-6986c3895163 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:04.200084 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8331390-45b5-4403-8f94-d2b2b09cc53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:04.203996 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8331390-45b5-4403-8f94-d2b2b09cc53a None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:04.203996 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8331390-45b5-4403-8f94-d2b2b09cc53a None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:04.203996 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8331390-45b5-4403-8f94-d2b2b09cc53a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:04.210699 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948e007-79e4-4238-a63e-ec047de614ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:04.211373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948e007-79e4-4238-a63e-ec047de614ac None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:04.211657 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948e007-79e4-4238-a63e-ec047de614ac None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:04.211933 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948e007-79e4-4238-a63e-ec047de614ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:04.220026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8331390-45b5-4403-8f94-d2b2b09cc53a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:04.230849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-a8331390-45b5-4403-8f94-d2b2b09cc53a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:11:04.230849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:04.230849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:04.230849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:04.230849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:04.230849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:04.230849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:04.230849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:04.230849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:04.230849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:04.230849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:04.230849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:04.230849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:04.230849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:04.230849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:04.230849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:04.232257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:04.232257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:04.232257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:04.232257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:04.232257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:04.232257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:04.232257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:04.232257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:04.232257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:04.232257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:04.232257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:04.232257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:04.232257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:04.232257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:04.232257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:04.232257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:04.233178 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:04.233178 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:04.233178 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:04.233178 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:04.233178 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:04.233178 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:04.233178 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:04.233178 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:04.233178 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:04.233178 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:04.233178 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:11:04.233178 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:04.233178 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 182/355] 10.222.0.71 () {56 vars in 1114 bytes} [Mon May 16 20:11:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:04.234636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8331390-45b5-4403-8f94-d2b2b09cc53a None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:04.305396 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948e007-79e4-4238-a63e-ec047de614ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:04.306686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948e007-79e4-4238-a63e-ec047de614ac None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:04.395358 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8331390-45b5-4403-8f94-d2b2b09cc53a None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:04.434236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d2834-2144-40fa-9bc0-33d68420da28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:04.434513 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 174/356] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:11:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:11:04.435683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d2834-2144-40fa-9bc0-33d68420da28 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:04.436017 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfea67e-d455-4022-9a47-09d3b38024b5 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:04.436339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfea67e-d455-4022-9a47-09d3b38024b5 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:04.436487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d2834-2144-40fa-9bc0-33d68420da28 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:04.436661 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfea67e-d455-4022-9a47-09d3b38024b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:04.436758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d2834-2144-40fa-9bc0-33d68420da28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:04.455058 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-3bfea67e-d455-4022-9a47-09d3b38024b5 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:04.456360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-3bfea67e-d455-4022-9a47-09d3b38024b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:04.534964 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 175/357] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:04.536397 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfea67e-d455-4022-9a47-09d3b38024b5 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:04.537780 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d2834-2144-40fa-9bc0-33d68420da28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:04.539721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d2834-2144-40fa-9bc0-33d68420da28 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:04.649865 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 183/358] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:11:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:11:04.654737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d2834-2144-40fa-9bc0-33d68420da28 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:04.654851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfea67e-d455-4022-9a47-09d3b38024b5 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:04.692327 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272f7ce-5fb9-47fc-a9d0-df0308eb53bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:04.693330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272f7ce-5fb9-47fc-a9d0-df0308eb53bb None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:04.693695 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272f7ce-5fb9-47fc-a9d0-df0308eb53bb None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:04.694069 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272f7ce-5fb9-47fc-a9d0-df0308eb53bb None admin] PATH_INFO: `/v3/users/23da78a0e14f4fcfb4401c7db39c91d6` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:04.695404 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272f7ce-5fb9-47fc-a9d0-df0308eb53bb None admin] RBAC: Authorizing `identity:get_user(user_id=23da78a0e14f4fcfb4401c7db39c91d6)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:04.696894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272f7ce-5fb9-47fc-a9d0-df0308eb53bb None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:04.698727 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 176/359] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:11:04 2022] GET /identity/v3/users/23da78a0e14f4fcfb4401c7db39c91d6 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:04.699316 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272f7ce-5fb9-47fc-a9d0-df0308eb53bb None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:04.760922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d2834-2144-40fa-9bc0-33d68420da28 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:04.795185 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdc1e0-c944-473e-80e6-4ed3cc88efcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:04.795958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdc1e0-c944-473e-80e6-4ed3cc88efcc None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:04.796262 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdc1e0-c944-473e-80e6-4ed3cc88efcc None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:04.796534 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdc1e0-c944-473e-80e6-4ed3cc88efcc None admin] PATH_INFO: `/v3/projects/e66c9a82caa04ffb8ac50780877086d0` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:04.797719 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdc1e0-c944-473e-80e6-4ed3cc88efcc None admin] RBAC: Authorizing `identity:get_project(project_id=e66c9a82caa04ffb8ac50780877086d0)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:04.799163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdc1e0-c944-473e-80e6-4ed3cc88efcc None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:04.800923 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 184/360] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:11:04 2022] GET /identity/v3/projects/e66c9a82caa04ffb8ac50780877086d0 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:04.801688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdc1e0-c944-473e-80e6-4ed3cc88efcc None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:04.843917 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272f7ce-5fb9-47fc-a9d0-df0308eb53bb None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:04.880077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5e251-8d79-4431-8892-8eaeb5360efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:04.880764 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5e251-8d79-4431-8892-8eaeb5360efd None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:04.881037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5e251-8d79-4431-8892-8eaeb5360efd None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:04.881300 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5e251-8d79-4431-8892-8eaeb5360efd None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:04.882072 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5e251-8d79-4431-8892-8eaeb5360efd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:04.882368 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5e251-8d79-4431-8892-8eaeb5360efd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:04.883889 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5e251-8d79-4431-8892-8eaeb5360efd None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:04.892969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 177/361] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:04.894378 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5e251-8d79-4431-8892-8eaeb5360efd None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:04.914504 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdc1e0-c944-473e-80e6-4ed3cc88efcc None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:04.953453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220f10a-ad69-45c1-b3e5-710e79837241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:04.954331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220f10a-ad69-45c1-b3e5-710e79837241 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:04.954612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220f10a-ad69-45c1-b3e5-710e79837241 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:04.954912 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220f10a-ad69-45c1-b3e5-710e79837241 None admin] PATH_INFO: `/v3/projects/ff00118a162648a38b9438404dd67916` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:04.956753 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220f10a-ad69-45c1-b3e5-710e79837241 None admin] RBAC: Authorizing `identity:get_project(project_id=ff00118a162648a38b9438404dd67916)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:04.958233 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220f10a-ad69-45c1-b3e5-710e79837241 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:04.960030 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 185/362] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:11:04 2022] GET /identity/v3/projects/ff00118a162648a38b9438404dd67916 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:04.960870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220f10a-ad69-45c1-b3e5-710e79837241 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:05.023008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5e251-8d79-4431-8892-8eaeb5360efd None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:05.081605 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27da2c-d12d-45f3-bb91-7a79012ef9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:05.082994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27da2c-d12d-45f3-bb91-7a79012ef9ec None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:05.083492 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27da2c-d12d-45f3-bb91-7a79012ef9ec None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:05.083632 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220f10a-ad69-45c1-b3e5-710e79837241 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:05.083987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27da2c-d12d-45f3-bb91-7a79012ef9ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:05.096373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27da2c-d12d-45f3-bb91-7a79012ef9ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:05.104675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-7f27da2c-d12d-45f3-bb91-7a79012ef9ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:11:05.104675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:05.104675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:05.104675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:05.104675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:05.104675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:05.104675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:05.104675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:05.104675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:05.104675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:05.104675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:05.104675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:05.104675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:05.104675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:05.104675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:05.104675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:05.106803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:05.106803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:05.106803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:05.106803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:05.106803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:05.106803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:05.106803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:05.106803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:05.106803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:05.106803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:05.106803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:05.106803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:05.106803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:05.106803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:05.106803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:05.106803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:05.108538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:05.108538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:05.108538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:05.108538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:05.108538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:05.108538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:05.108538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:05.108538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:05.108538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:05.108538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:05.108538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:11:05.108538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:05.108538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 178/363] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:11:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:05.108538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27da2c-d12d-45f3-bb91-7a79012ef9ec None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:05.127501 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0599a-1a51-4768-bf1c-4999e9194c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:05.129141 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0599a-1a51-4768-bf1c-4999e9194c41 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:05.129458 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0599a-1a51-4768-bf1c-4999e9194c41 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:05.129738 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0599a-1a51-4768-bf1c-4999e9194c41 None admin] PATH_INFO: `/v3/projects/e66c9a82caa04ffb8ac50780877086d0` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:05.131087 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0599a-1a51-4768-bf1c-4999e9194c41 None admin] RBAC: Authorizing `identity:get_project(project_id=e66c9a82caa04ffb8ac50780877086d0)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:05.132574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0599a-1a51-4768-bf1c-4999e9194c41 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:05.134360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 186/364] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:11:04 2022] GET /identity/v3/projects/e66c9a82caa04ffb8ac50780877086d0 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:05.135145 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0599a-1a51-4768-bf1c-4999e9194c41 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:05.253574 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27da2c-d12d-45f3-bb91-7a79012ef9ec None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:05.266431 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0599a-1a51-4768-bf1c-4999e9194c41 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:05.310747 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43414d35-fa51-4511-9be5-f5ac2fa22c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:05.311501 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782fe77-d379-47cf-a669-47b9105c764b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:05.311796 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43414d35-fa51-4511-9be5-f5ac2fa22c23 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:05.312322 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43414d35-fa51-4511-9be5-f5ac2fa22c23 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:05.312564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782fe77-d379-47cf-a669-47b9105c764b None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:05.312801 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43414d35-fa51-4511-9be5-f5ac2fa22c23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:05.312953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782fe77-d379-47cf-a669-47b9105c764b None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:05.313297 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782fe77-d379-47cf-a669-47b9105c764b None admin] PATH_INFO: `/v3/groups/295d31655af149ad9194a8bf56aa128a` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:05.314410 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43414d35-fa51-4511-9be5-f5ac2fa22c23 None admin] RBAC: Adding query filter params (role.id=f7d1ff112a024e3190daa30a7814e054, user.id=23da78a0e14f4fcfb4401c7db39c91d6, scope.system=all) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:05.314961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43414d35-fa51-4511-9be5-f5ac2fa22c23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:05.318232 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43414d35-fa51-4511-9be5-f5ac2fa22c23 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:05.321622 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782fe77-d379-47cf-a669-47b9105c764b None admin] RBAC: Authorizing `identity:get_group(group_id=295d31655af149ad9194a8bf56aa128a)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:05.323482 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782fe77-d379-47cf-a669-47b9105c764b None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:05.325600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 187/365] 10.222.0.71 () {56 vars in 1180 bytes} [Mon May 16 20:11:05 2022] GET /identity/v3/groups/295d31655af149ad9194a8bf56aa128a => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:05.326658 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782fe77-d379-47cf-a669-47b9105c764b None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:05.339594 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 179/366] 10.222.0.71 () {56 vars in 1308 bytes} [Mon May 16 20:11:05 2022] GET /identity/v3/role_assignments?user.id=23da78a0e14f4fcfb4401c7db39c91d6&scope.system=all&role.id=f7d1ff112a024e3190daa30a7814e054 => generated 510 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:05.340390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43414d35-fa51-4511-9be5-f5ac2fa22c23 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:05.467578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782fe77-d379-47cf-a669-47b9105c764b None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:05.506050 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43414d35-fa51-4511-9be5-f5ac2fa22c23 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:05.521807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05dc75a-7274-4c95-90f4-e88d7cefac49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:05.522926 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05dc75a-7274-4c95-90f4-e88d7cefac49 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:05.523421 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05dc75a-7274-4c95-90f4-e88d7cefac49 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:05.523790 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05dc75a-7274-4c95-90f4-e88d7cefac49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:05.554318 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb39f86-c280-4e26-b88c-498222362a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:05.555418 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb39f86-c280-4e26-b88c-498222362a08 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:05.555696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb39f86-c280-4e26-b88c-498222362a08 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:05.555967 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb39f86-c280-4e26-b88c-498222362a08 None admin] PATH_INFO: `/v3/groups/295d31655af149ad9194a8bf56aa128a` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:05.557846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb39f86-c280-4e26-b88c-498222362a08 None admin] RBAC: Authorizing `identity:get_group(group_id=295d31655af149ad9194a8bf56aa128a)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:05.558931 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb39f86-c280-4e26-b88c-498222362a08 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:05.560715 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 180/367] 10.222.0.71 () {56 vars in 1180 bytes} [Mon May 16 20:11:05 2022] GET /identity/v3/groups/295d31655af149ad9194a8bf56aa128a => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:05.561500 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb39f86-c280-4e26-b88c-498222362a08 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:05.618013 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05dc75a-7274-4c95-90f4-e88d7cefac49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:05.619389 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05dc75a-7274-4c95-90f4-e88d7cefac49 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:05.714349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb39f86-c280-4e26-b88c-498222362a08 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:05.757458 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95939f-739d-46b4-8326-11b84e4e46d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:05.758445 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95939f-739d-46b4-8326-11b84e4e46d0 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:05.758722 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95939f-739d-46b4-8326-11b84e4e46d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:05.758996 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95939f-739d-46b4-8326-11b84e4e46d0 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:05.759745 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95939f-739d-46b4-8326-11b84e4e46d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:05.760050 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95939f-739d-46b4-8326-11b84e4e46d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:05.761460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95939f-739d-46b4-8326-11b84e4e46d0 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:05.771190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 181/368] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:11:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:05.772069 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95939f-739d-46b4-8326-11b84e4e46d0 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:05.780096 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 188/369] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:11:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:11:05.780996 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05dc75a-7274-4c95-90f4-e88d7cefac49 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:05.893616 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95939f-739d-46b4-8326-11b84e4e46d0 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:05.902806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05dc75a-7274-4c95-90f4-e88d7cefac49 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:05.930284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846e37f-ba27-470a-9e9d-d14b954dbc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:05.931109 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846e37f-ba27-470a-9e9d-d14b954dbc9d None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:05.931389 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846e37f-ba27-470a-9e9d-d14b954dbc9d None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:05.931883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846e37f-ba27-470a-9e9d-d14b954dbc9d None admin] PATH_INFO: `/v3/groups/295d31655af149ad9194a8bf56aa128a` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:05.932891 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846e37f-ba27-470a-9e9d-d14b954dbc9d None admin] RBAC: Authorizing `identity:get_group(group_id=295d31655af149ad9194a8bf56aa128a)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:05.934331 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846e37f-ba27-470a-9e9d-d14b954dbc9d None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:05.936293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 182/370] 10.222.0.71 () {56 vars in 1180 bytes} [Mon May 16 20:11:05 2022] GET /identity/v3/groups/295d31655af149ad9194a8bf56aa128a => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:05.937074 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846e37f-ba27-470a-9e9d-d14b954dbc9d None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:05.938614 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee243a-eb7a-4036-a9c0-140a78bd5e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:05.939273 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee243a-eb7a-4036-a9c0-140a78bd5e56 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:05.939756 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee243a-eb7a-4036-a9c0-140a78bd5e56 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:05.940037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee243a-eb7a-4036-a9c0-140a78bd5e56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:05.942332 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee243a-eb7a-4036-a9c0-140a78bd5e56 None admin] RBAC: Adding query filter params (group.id=295d31655af149ad9194a8bf56aa128a, role.id=140f30ce618745eea43e96b91df3bbab, scope.project.id=e66c9a82caa04ffb8ac50780877086d0) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:05.942647 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee243a-eb7a-4036-a9c0-140a78bd5e56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:05.944144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee243a-eb7a-4036-a9c0-140a78bd5e56 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:05.949853 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 189/371] 10.222.0.71 () {56 vars in 1376 bytes} [Mon May 16 20:11:05 2022] GET /identity/v3/role_assignments?group.id=295d31655af149ad9194a8bf56aa128a&scope.project.id=e66c9a82caa04ffb8ac50780877086d0&role.id=140f30ce618745eea43e96b91df3bbab => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:05.950659 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee243a-eb7a-4036-a9c0-140a78bd5e56 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:06.058332 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846e37f-ba27-470a-9e9d-d14b954dbc9d None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:06.085592 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee243a-eb7a-4036-a9c0-140a78bd5e56 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:06.096980 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc6974-ec25-4a22-a82d-1e893d6c1d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:06.098041 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc6974-ec25-4a22-a82d-1e893d6c1d69 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:06.098332 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc6974-ec25-4a22-a82d-1e893d6c1d69 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:06.098613 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc6974-ec25-4a22-a82d-1e893d6c1d69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:06.099497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc6974-ec25-4a22-a82d-1e893d6c1d69 None admin] RBAC: Adding query filter params (group.id=295d31655af149ad9194a8bf56aa128a, role.id=99462c05ed484212893d40128c99f47c, scope.project.id=ff00118a162648a38b9438404dd67916) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:06.099812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc6974-ec25-4a22-a82d-1e893d6c1d69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:06.101393 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc6974-ec25-4a22-a82d-1e893d6c1d69 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:06.107924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 183/372] 10.222.0.71 () {56 vars in 1376 bytes} [Mon May 16 20:11:05 2022] GET /identity/v3/role_assignments?group.id=295d31655af149ad9194a8bf56aa128a&scope.project.id=ff00118a162648a38b9438404dd67916&role.id=99462c05ed484212893d40128c99f47c => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:06.112476 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc6974-ec25-4a22-a82d-1e893d6c1d69 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:06.149605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c436588-5dbd-4533-81e8-4c5e95d7932f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:06.150512 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c436588-5dbd-4533-81e8-4c5e95d7932f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:06.150918 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c436588-5dbd-4533-81e8-4c5e95d7932f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:06.151353 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c436588-5dbd-4533-81e8-4c5e95d7932f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:06.264528 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc6974-ec25-4a22-a82d-1e893d6c1d69 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:06.266157 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c436588-5dbd-4533-81e8-4c5e95d7932f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:06.270690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c436588-5dbd-4533-81e8-4c5e95d7932f None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:06.310418 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb5c1f-b8d8-4a09-b620-4ae2090dbf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:06.311348 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb5c1f-b8d8-4a09-b620-4ae2090dbf69 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:06.311760 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb5c1f-b8d8-4a09-b620-4ae2090dbf69 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:06.312047 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb5c1f-b8d8-4a09-b620-4ae2090dbf69 None admin] PATH_INFO: `/v3/projects/ff00118a162648a38b9438404dd67916` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:06.314255 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb5c1f-b8d8-4a09-b620-4ae2090dbf69 None admin] RBAC: Authorizing `identity:get_project(project_id=ff00118a162648a38b9438404dd67916)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:06.316618 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb5c1f-b8d8-4a09-b620-4ae2090dbf69 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:06.318995 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 184/373] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:11:06 2022] GET /identity/v3/projects/ff00118a162648a38b9438404dd67916 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:06.319843 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb5c1f-b8d8-4a09-b620-4ae2090dbf69 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:06.439617 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb5c1f-b8d8-4a09-b620-4ae2090dbf69 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:06.467451 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 190/374] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:11:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:11:06.468846 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c436588-5dbd-4533-81e8-4c5e95d7932f None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:06.484475 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539de66a-289c-4b0e-97de-885f7210fca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:06.485146 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539de66a-289c-4b0e-97de-885f7210fca2 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:06.485407 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539de66a-289c-4b0e-97de-885f7210fca2 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:06.485689 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539de66a-289c-4b0e-97de-885f7210fca2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:06.486534 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539de66a-289c-4b0e-97de-885f7210fca2 None admin] RBAC: Adding query filter params (group.id=295d31655af149ad9194a8bf56aa128a, role.id=99462c05ed484212893d40128c99f47c, scope.project.id=e66c9a82caa04ffb8ac50780877086d0) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:06.486851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539de66a-289c-4b0e-97de-885f7210fca2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:06.489473 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539de66a-289c-4b0e-97de-885f7210fca2 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:06.495769 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 185/375] 10.222.0.71 () {56 vars in 1376 bytes} [Mon May 16 20:11:06 2022] GET /identity/v3/role_assignments?group.id=295d31655af149ad9194a8bf56aa128a&scope.project.id=e66c9a82caa04ffb8ac50780877086d0&role.id=99462c05ed484212893d40128c99f47c => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:06.505436 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539de66a-289c-4b0e-97de-885f7210fca2 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:06.625103 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539de66a-289c-4b0e-97de-885f7210fca2 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:06.666693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d84d9a-384e-4ff8-923a-7d32118be682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:06.667562 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d84d9a-384e-4ff8-923a-7d32118be682 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:06.667845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d84d9a-384e-4ff8-923a-7d32118be682 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:06.668120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d84d9a-384e-4ff8-923a-7d32118be682 None admin] PATH_INFO: `/v3/projects/8a002d9ef0e2477e8031bd7bef5cfc65` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:06.669525 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d84d9a-384e-4ff8-923a-7d32118be682 None admin] RBAC: Authorizing `identity:get_project(project_id=8a002d9ef0e2477e8031bd7bef5cfc65)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:06.670947 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d84d9a-384e-4ff8-923a-7d32118be682 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:06.680242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 186/376] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:11:06 2022] GET /identity/v3/projects/8a002d9ef0e2477e8031bd7bef5cfc65 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:06.680242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d84d9a-384e-4ff8-923a-7d32118be682 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:06.704380 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c436588-5dbd-4533-81e8-4c5e95d7932f None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:06.760005 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a291028-2c0b-4cf4-9b26-257a9d7e779a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:06.761614 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a291028-2c0b-4cf4-9b26-257a9d7e779a None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:06.762134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a291028-2c0b-4cf4-9b26-257a9d7e779a None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:06.762643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a291028-2c0b-4cf4-9b26-257a9d7e779a None admin] PATH_INFO: `/v3/groups/295d31655af149ad9194a8bf56aa128a` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:06.765067 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a291028-2c0b-4cf4-9b26-257a9d7e779a None admin] RBAC: Authorizing `identity:get_group(group_id=295d31655af149ad9194a8bf56aa128a)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:06.780393 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a291028-2c0b-4cf4-9b26-257a9d7e779a None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:06.784123 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 191/377] 10.222.0.71 () {56 vars in 1180 bytes} [Mon May 16 20:11:06 2022] GET /identity/v3/groups/295d31655af149ad9194a8bf56aa128a => generated 226 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:06.791606 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a291028-2c0b-4cf4-9b26-257a9d7e779a None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:06.904944 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d84d9a-384e-4ff8-923a-7d32118be682 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:06.939992 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a291028-2c0b-4cf4-9b26-257a9d7e779a None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:06.965450 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c52e33-c91e-4cb9-ab52-548de86d4e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:06.967452 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c52e33-c91e-4cb9-ab52-548de86d4e0d None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:06.968213 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c52e33-c91e-4cb9-ab52-548de86d4e0d None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:06.969017 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c52e33-c91e-4cb9-ab52-548de86d4e0d None admin] PATH_INFO: `/v3/groups/529408c6d66342e394412eafee179f1b` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:06.977305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f5a9c-bca7-4bd5-b66a-cbeadd2b15e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:06.977972 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f5a9c-bca7-4bd5-b66a-cbeadd2b15e5 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:06.978255 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f5a9c-bca7-4bd5-b66a-cbeadd2b15e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:06.978532 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f5a9c-bca7-4bd5-b66a-cbeadd2b15e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:06.979437 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f5a9c-bca7-4bd5-b66a-cbeadd2b15e5 None admin] RBAC: Adding query filter params (group.id=295d31655af149ad9194a8bf56aa128a, role.id=140f30ce618745eea43e96b91df3bbab, scope.project.id=ff00118a162648a38b9438404dd67916) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:06.979755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f5a9c-bca7-4bd5-b66a-cbeadd2b15e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:06.981265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f5a9c-bca7-4bd5-b66a-cbeadd2b15e5 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:06.983504 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c52e33-c91e-4cb9-ab52-548de86d4e0d None admin] RBAC: Authorizing `identity:get_group(group_id=529408c6d66342e394412eafee179f1b)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:06.986621 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c52e33-c91e-4cb9-ab52-548de86d4e0d None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:06.988355 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 192/378] 10.222.0.71 () {56 vars in 1376 bytes} [Mon May 16 20:11:06 2022] GET /identity/v3/role_assignments?group.id=295d31655af149ad9194a8bf56aa128a&scope.project.id=ff00118a162648a38b9438404dd67916&role.id=140f30ce618745eea43e96b91df3bbab => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:06.991539 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 187/379] 10.222.0.71 () {56 vars in 1180 bytes} [Mon May 16 20:11:06 2022] GET /identity/v3/groups/529408c6d66342e394412eafee179f1b => generated 229 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:11:06.997298 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f5a9c-bca7-4bd5-b66a-cbeadd2b15e5 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:07.135246 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f5a9c-bca7-4bd5-b66a-cbeadd2b15e5 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:07.177892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3706d-3c54-4893-8087-e352e8a1dbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:07.178579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3706d-3c54-4893-8087-e352e8a1dbff None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:07.178862 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3706d-3c54-4893-8087-e352e8a1dbff None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:07.179136 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3706d-3c54-4893-8087-e352e8a1dbff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:07.180007 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3706d-3c54-4893-8087-e352e8a1dbff None admin] RBAC: Adding query filter params (group.id=529408c6d66342e394412eafee179f1b, role.id=6576d9225a0946de877f527e3d15db05, scope.project.id=8a002d9ef0e2477e8031bd7bef5cfc65) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:07.180353 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3706d-3c54-4893-8087-e352e8a1dbff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:07.181897 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3706d-3c54-4893-8087-e352e8a1dbff None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:07.188927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 193/380] 10.222.0.71 () {56 vars in 1376 bytes} [Mon May 16 20:11:06 2022] GET /identity/v3/role_assignments?group.id=529408c6d66342e394412eafee179f1b&scope.project.id=8a002d9ef0e2477e8031bd7bef5cfc65&role.id=6576d9225a0946de877f527e3d15db05 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:08.924063 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a1ca0-50f8-4d86-bf38-311181b4286d None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:08.925279 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a1ca0-50f8-4d86-bf38-311181b4286d None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:08.925868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a1ca0-50f8-4d86-bf38-311181b4286d None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:08.928304 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 188/381] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:08.933883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3ff4b-fc76-440f-92ad-a95bbe0b8913 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:08.934719 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3ff4b-fc76-440f-92ad-a95bbe0b8913 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:08.935138 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3ff4b-fc76-440f-92ad-a95bbe0b8913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:08.961707 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-afc3ff4b-fc76-440f-92ad-a95bbe0b8913 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:08.963346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-afc3ff4b-fc76-440f-92ad-a95bbe0b8913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:09.086630 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 194/382] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:09.109331 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a1ca0-50f8-4d86-bf38-311181b4286d None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:09.281577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a1ca0-50f8-4d86-bf38-311181b4286d None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:09.337680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea918e0-35ee-42c1-9b64-2a7af4076817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:09.338510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea918e0-35ee-42c1-9b64-2a7af4076817 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:09.338800 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea918e0-35ee-42c1-9b64-2a7af4076817 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:09.339073 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea918e0-35ee-42c1-9b64-2a7af4076817 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:09.355652 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea918e0-35ee-42c1-9b64-2a7af4076817 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:09.365867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-dea918e0-35ee-42c1-9b64-2a7af4076817 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:11:09.365867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:09.365867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:09.365867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:09.365867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:09.365867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:09.365867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:09.365867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:09.365867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:09.365867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:09.365867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:09.365867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:09.365867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:09.365867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:09.365867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:09.365867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:09.367892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:09.367892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:09.367892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:09.367892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:09.367892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:09.367892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:09.367892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:09.367892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:09.367892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:09.367892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:09.367892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:09.367892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:09.367892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:09.367892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:09.367892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:09.367892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:09.369763 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:09.369763 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:09.369763 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:09.369763 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:09.369763 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:09.369763 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:09.369763 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:09.369763 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:09.369763 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:09.369763 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:09.369763 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:11:09.369763 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:09.376207 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 189/383] 10.222.0.71 () {56 vars in 1114 bytes} [Mon May 16 20:11:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:09.377171 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3ff4b-fc76-440f-92ad-a95bbe0b8913 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:09.459126 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c068d79-c3e9-433a-a3a2-115932d3f22a None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:09.459417 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c068d79-c3e9-433a-a3a2-115932d3f22a None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:09.459703 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c068d79-c3e9-433a-a3a2-115932d3f22a None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:09.461549 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 190/384] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:09.473220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad88ca-96e2-4b28-a73b-aa289170ed53 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:09.473632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad88ca-96e2-4b28-a73b-aa289170ed53 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:09.473784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad88ca-96e2-4b28-a73b-aa289170ed53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:09.508700 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-88ad88ca-96e2-4b28-a73b-aa289170ed53 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:09.509873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-88ad88ca-96e2-4b28-a73b-aa289170ed53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:09.615628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3ff4b-fc76-440f-92ad-a95bbe0b8913 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:09.686059 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c5052-41b1-4bca-82d8-56fc7376ef46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:09.687174 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c5052-41b1-4bca-82d8-56fc7376ef46 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:09.687676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c5052-41b1-4bca-82d8-56fc7376ef46 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:09.688188 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c5052-41b1-4bca-82d8-56fc7376ef46 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:09.689604 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c5052-41b1-4bca-82d8-56fc7376ef46 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:09.690152 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c5052-41b1-4bca-82d8-56fc7376ef46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:09.693257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c5052-41b1-4bca-82d8-56fc7376ef46 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:09.709174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 191/385] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:09.722219 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 195/386] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:09.731642 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad88ca-96e2-4b28-a73b-aa289170ed53 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:09.736980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c5052-41b1-4bca-82d8-56fc7376ef46 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:09.881421 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c5052-41b1-4bca-82d8-56fc7376ef46 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:09.918582 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c3fe5-5a58-427e-b4b6-4cace7d94d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:09.919381 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c3fe5-5a58-427e-b4b6-4cace7d94d16 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:09.919665 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c3fe5-5a58-427e-b4b6-4cace7d94d16 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:09.919940 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c3fe5-5a58-427e-b4b6-4cace7d94d16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:09.931068 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c3fe5-5a58-427e-b4b6-4cace7d94d16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:09.939249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-db2c3fe5-5a58-427e-b4b6-4cace7d94d16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:11:09.939249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:09.939249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:09.939249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:09.939249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:09.939249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:09.939249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:09.939249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:09.939249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:09.939249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:09.939249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:09.939249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:09.939249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:09.939249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:09.939249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:09.939249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:09.942936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:09.942936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:09.942936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:09.942936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:09.942936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:09.942936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:09.942936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:09.942936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:09.942936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:09.942936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:09.942936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:09.942936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:09.942936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:09.942936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:09.942936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:09.942936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:09.945541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:09.945541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:09.945541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:09.945541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:09.945541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:09.945541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:09.945541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:09.945541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:09.945541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:09.945541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:09.945541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:11:09.945541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:09.945541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 196/387] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:11:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:11:09.948123 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c3fe5-5a58-427e-b4b6-4cace7d94d16 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:10.041338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad88ca-96e2-4b28-a73b-aa289170ed53 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:10.063188 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c3fe5-5a58-427e-b4b6-4cace7d94d16 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:10.115630 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29092cd8-f6fc-4b98-919d-3b7e99de8b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:10.116878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6faca7-fc00-4e77-830e-dd0dc6fdd4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:10.117164 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29092cd8-f6fc-4b98-919d-3b7e99de8b69 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:10.117549 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6faca7-fc00-4e77-830e-dd0dc6fdd4b3 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:10.117805 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29092cd8-f6fc-4b98-919d-3b7e99de8b69 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:10.118071 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6faca7-fc00-4e77-830e-dd0dc6fdd4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:10.118303 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29092cd8-f6fc-4b98-919d-3b7e99de8b69 None admin] PATH_INFO: `/v3/groups/295d31655af149ad9194a8bf56aa128a` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:10.118534 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6faca7-fc00-4e77-830e-dd0dc6fdd4b3 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:10.124188 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6faca7-fc00-4e77-830e-dd0dc6fdd4b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:10.124188 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6faca7-fc00-4e77-830e-dd0dc6fdd4b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:10.124188 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6faca7-fc00-4e77-830e-dd0dc6fdd4b3 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:10.125585 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29092cd8-f6fc-4b98-919d-3b7e99de8b69 None admin] RBAC: Authorizing `identity:get_group(group_id=295d31655af149ad9194a8bf56aa128a)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:10.129863 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29092cd8-f6fc-4b98-919d-3b7e99de8b69 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:10.131543 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 197/388] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:11:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:11:10.137290 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6faca7-fc00-4e77-830e-dd0dc6fdd4b3 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:10.142006 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 192/389] 10.222.0.71 () {56 vars in 1180 bytes} [Mon May 16 20:11:09 2022] GET /identity/v3/groups/295d31655af149ad9194a8bf56aa128a => generated 226 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:10.152577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29092cd8-f6fc-4b98-919d-3b7e99de8b69 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:10.246360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6faca7-fc00-4e77-830e-dd0dc6fdd4b3 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:10.281442 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004767ed-a768-44ae-9b45-b243f82f0c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:10.282412 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004767ed-a768-44ae-9b45-b243f82f0c77 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:10.282696 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004767ed-a768-44ae-9b45-b243f82f0c77 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:10.282976 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004767ed-a768-44ae-9b45-b243f82f0c77 None admin] PATH_INFO: `/v3/groups/295d31655af149ad9194a8bf56aa128a` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:10.284485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004767ed-a768-44ae-9b45-b243f82f0c77 None admin] RBAC: Authorizing `identity:get_group(group_id=295d31655af149ad9194a8bf56aa128a)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:10.286328 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004767ed-a768-44ae-9b45-b243f82f0c77 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:10.288541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 198/390] 10.222.0.71 () {56 vars in 1180 bytes} [Mon May 16 20:11:10 2022] GET /identity/v3/groups/295d31655af149ad9194a8bf56aa128a => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:11:10.289845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ae451-a5b5-4b81-8353-2e0dd20c3352 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:10.290130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ae451-a5b5-4b81-8353-2e0dd20c3352 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:10.290344 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29092cd8-f6fc-4b98-919d-3b7e99de8b69 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:10.290579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ae451-a5b5-4b81-8353-2e0dd20c3352 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:10.296300 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 199/391] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:10.297230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ae451-a5b5-4b81-8353-2e0dd20c3352 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:10.334780 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03dae2-9033-4410-9828-984475de102a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:10.335775 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03dae2-9033-4410-9828-984475de102a None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:10.336206 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03dae2-9033-4410-9828-984475de102a None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:10.336551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03dae2-9033-4410-9828-984475de102a None admin] PATH_INFO: `/v3/projects/e66c9a82caa04ffb8ac50780877086d0` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:10.337911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03dae2-9033-4410-9828-984475de102a None admin] RBAC: Authorizing `identity:get_project(project_id=e66c9a82caa04ffb8ac50780877086d0)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:10.339512 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03dae2-9033-4410-9828-984475de102a None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:10.341808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 193/392] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:11:10 2022] GET /identity/v3/projects/e66c9a82caa04ffb8ac50780877086d0 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:11:10.343273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80567117-6674-49f4-9ed3-d0df9cb417fe None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:10.343679 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80567117-6674-49f4-9ed3-d0df9cb417fe None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:10.344022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80567117-6674-49f4-9ed3-d0df9cb417fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:10.363411 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-80567117-6674-49f4-9ed3-d0df9cb417fe None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:10.364905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-80567117-6674-49f4-9ed3-d0df9cb417fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:10.410030 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ae451-a5b5-4b81-8353-2e0dd20c3352 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:10.448309 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 194/393] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:10.449213 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80567117-6674-49f4-9ed3-d0df9cb417fe None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:10.451836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065718b-9105-43a1-a35e-6a1518c18ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:10.452733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065718b-9105-43a1-a35e-6a1518c18ad0 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:10.453066 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065718b-9105-43a1-a35e-6a1518c18ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:10.456638 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065718b-9105-43a1-a35e-6a1518c18ad0 None admin] PATH_INFO: `/v3/projects/ff00118a162648a38b9438404dd67916` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:10.456638 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065718b-9105-43a1-a35e-6a1518c18ad0 None admin] RBAC: Authorizing `identity:get_project(project_id=ff00118a162648a38b9438404dd67916)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:10.459170 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065718b-9105-43a1-a35e-6a1518c18ad0 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:10.465108 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 200/394] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:11:10 2022] GET /identity/v3/projects/ff00118a162648a38b9438404dd67916 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:10.473528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065718b-9105-43a1-a35e-6a1518c18ad0 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:10.567700 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80567117-6674-49f4-9ed3-d0df9cb417fe None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:10.579300 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065718b-9105-43a1-a35e-6a1518c18ad0 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:10.605005 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d2d0c-1d0c-406b-977b-d790e395f7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:10.605991 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d2d0c-1d0c-406b-977b-d790e395f7d9 None admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:10.606362 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d2d0c-1d0c-406b-977b-d790e395f7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:10.606701 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d2d0c-1d0c-406b-977b-d790e395f7d9 None admin] PATH_INFO: `/v3/projects/e66c9a82caa04ffb8ac50780877086d0/groups/295d31655af149ad9194a8bf56aa128a/roles/140f30ce618745eea43e96b91df3bbab` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:10.609039 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d2d0c-1d0c-406b-977b-d790e395f7d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e66c9a82caa04ffb8ac50780877086d0, group_id=295d31655af149ad9194a8bf56aa128a, role_id=140f30ce618745eea43e96b91df3bbab)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:10.610577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d2d0c-1d0c-406b-977b-d790e395f7d9 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:10.614832 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d134d4-b063-45f7-89a4-42dfbfa851aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:10.615648 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d134d4-b063-45f7-89a4-42dfbfa851aa None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:10.616087 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d134d4-b063-45f7-89a4-42dfbfa851aa None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:10.616414 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d134d4-b063-45f7-89a4-42dfbfa851aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:10.626522 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 195/395] 10.222.0.71 () {58 vars in 1442 bytes} [Mon May 16 20:11:10 2022] PUT /identity/v3/projects/e66c9a82caa04ffb8ac50780877086d0/groups/295d31655af149ad9194a8bf56aa128a/roles/140f30ce618745eea43e96b91df3bbab => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:11:10.627818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d2d0c-1d0c-406b-977b-d790e395f7d9 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:10.629544 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d134d4-b063-45f7-89a4-42dfbfa851aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:10.637749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-98d134d4-b063-45f7-89a4-42dfbfa851aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:11:10.637749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:10.637749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:10.637749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:10.637749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:10.637749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:10.637749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:10.637749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:10.637749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:10.637749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:10.637749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:10.637749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:10.637749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:10.637749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:10.637749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:10.637749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:10.638723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:10.638723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:10.638723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:10.638723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:10.638723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:10.638723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:10.638723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:10.638723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:10.638723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:10.638723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:10.638723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:10.638723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:10.638723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:10.638723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:10.638723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:10.638723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:10.640008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:10.640008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:10.640008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:10.640008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:10.640008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:10.640008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:10.640008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:10.640008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:10.640008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:10.640008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:10.640008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:11:10.640008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:10.640008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 201/396] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:11:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:10.646672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d134d4-b063-45f7-89a4-42dfbfa851aa None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:10.752217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d2d0c-1d0c-406b-977b-d790e395f7d9 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:10.761788 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d134d4-b063-45f7-89a4-42dfbfa851aa None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:10.795754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefbe05-4b43-4d1d-ba99-dec42738ff75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:10.797090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefbe05-4b43-4d1d-ba99-dec42738ff75 None admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:10.797619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefbe05-4b43-4d1d-ba99-dec42738ff75 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:10.798096 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefbe05-4b43-4d1d-ba99-dec42738ff75 None admin] PATH_INFO: `/v3/projects/ff00118a162648a38b9438404dd67916/groups/295d31655af149ad9194a8bf56aa128a/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:10.802161 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefbe05-4b43-4d1d-ba99-dec42738ff75 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff00118a162648a38b9438404dd67916, group_id=295d31655af149ad9194a8bf56aa128a, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:10.802677 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c69ba2-0085-46b9-8b18-a442c22a4879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:10.803359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c69ba2-0085-46b9-8b18-a442c22a4879 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:10.803637 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c69ba2-0085-46b9-8b18-a442c22a4879 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:10.803910 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c69ba2-0085-46b9-8b18-a442c22a4879 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:10.804713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c69ba2-0085-46b9-8b18-a442c22a4879 None admin] RBAC: Adding query filter params (name=member) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:10.805021 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c69ba2-0085-46b9-8b18-a442c22a4879 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:10.805455 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefbe05-4b43-4d1d-ba99-dec42738ff75 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:10.806417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c69ba2-0085-46b9-8b18-a442c22a4879 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:10.817488 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 202/397] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:11:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:10.821945 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 196/398] 10.222.0.71 () {58 vars in 1442 bytes} [Mon May 16 20:11:10 2022] PUT /identity/v3/projects/ff00118a162648a38b9438404dd67916/groups/295d31655af149ad9194a8bf56aa128a/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:11:10.823738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefbe05-4b43-4d1d-ba99-dec42738ff75 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:10.823891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a5eb1-6779-4ec8-81f3-d8be9ecbfc63 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:10.824069 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a5eb1-6779-4ec8-81f3-d8be9ecbfc63 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:10.824357 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a5eb1-6779-4ec8-81f3-d8be9ecbfc63 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:10.825947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 203/399] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:10.835060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e27574-80fa-461d-adc7-e56c166c1aa2 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:10.835499 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e27574-80fa-461d-adc7-e56c166c1aa2 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:10.835879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e27574-80fa-461d-adc7-e56c166c1aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:10.855871 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-c4e27574-80fa-461d-adc7-e56c166c1aa2 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:10.857489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-c4e27574-80fa-461d-adc7-e56c166c1aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:10.937022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 204/400] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:11:10.957870 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefbe05-4b43-4d1d-ba99-dec42738ff75 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:10.996837 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e27574-80fa-461d-adc7-e56c166c1aa2 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:11.002462 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d936620-28b1-4aa1-9fe6-15fe7bfcfab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:11.004558 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d936620-28b1-4aa1-9fe6-15fe7bfcfab7 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:11.005022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d936620-28b1-4aa1-9fe6-15fe7bfcfab7 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:11.005464 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d936620-28b1-4aa1-9fe6-15fe7bfcfab7 None admin] PATH_INFO: `/v3/groups/295d31655af149ad9194a8bf56aa128a` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:11.007036 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d936620-28b1-4aa1-9fe6-15fe7bfcfab7 None admin] RBAC: Authorizing `identity:get_group(group_id=295d31655af149ad9194a8bf56aa128a)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:11.008798 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d936620-28b1-4aa1-9fe6-15fe7bfcfab7 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:11.011225 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 197/401] 10.222.0.71 () {56 vars in 1180 bytes} [Mon May 16 20:11:10 2022] GET /identity/v3/groups/295d31655af149ad9194a8bf56aa128a => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:11.020498 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d936620-28b1-4aa1-9fe6-15fe7bfcfab7 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:11.127285 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e27574-80fa-461d-adc7-e56c166c1aa2 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:11.153784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d936620-28b1-4aa1-9fe6-15fe7bfcfab7 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:11.189442 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfd728-d010-4613-add8-af1ce6decd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:11.191340 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfd728-d010-4613-add8-af1ce6decd77 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:11.193516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfd728-d010-4613-add8-af1ce6decd77 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:11.193516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfd728-d010-4613-add8-af1ce6decd77 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:11.211139 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e58a0f-52b2-4fb7-a014-1352e71b44d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:11.212981 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e58a0f-52b2-4fb7-a014-1352e71b44d5 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:11.213103 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e58a0f-52b2-4fb7-a014-1352e71b44d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:11.213523 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e58a0f-52b2-4fb7-a014-1352e71b44d5 None admin] PATH_INFO: `/v3/projects/e66c9a82caa04ffb8ac50780877086d0` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:11.215085 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfd728-d010-4613-add8-af1ce6decd77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:11.216245 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e58a0f-52b2-4fb7-a014-1352e71b44d5 None admin] RBAC: Authorizing `identity:get_project(project_id=e66c9a82caa04ffb8ac50780877086d0)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:11.218725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e58a0f-52b2-4fb7-a014-1352e71b44d5 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:11.224338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 198/402] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:11:11 2022] GET /identity/v3/projects/e66c9a82caa04ffb8ac50780877086d0 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:11.225648 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca41340-7b85-4ab5-9d82-d8f5292dfd39 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:11.226133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca41340-7b85-4ab5-9d82-d8f5292dfd39 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:11.226610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca41340-7b85-4ab5-9d82-d8f5292dfd39 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:11.236190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 199/403] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:11.236413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-31bfd728-d010-4613-add8-af1ce6decd77 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:11:11.236413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:11.236413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:11.236413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:11.236413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:11.236413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:11.236413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:11.236413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:11.236413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:11.236413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:11.236413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:11.236413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:11.236413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:11.236413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:11.236413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:11.236413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:11.237941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:11.237941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:11.237941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:11.237941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:11.237941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:11.237941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:11.237941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:11.237941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:11.237941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:11.237941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:11.237941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:11.237941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:11.237941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:11.237941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:11.237941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:11.237941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:11.238777 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:11.238777 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:11.238777 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:11.238777 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:11.238777 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:11.238777 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:11.238777 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:11.238777 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:11.238777 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:11.238777 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:11.238777 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:11:11.238777 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:11.238777 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 205/404] 10.222.0.71 () {56 vars in 1114 bytes} [Mon May 16 20:11:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:11.239445 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca41340-7b85-4ab5-9d82-d8f5292dfd39 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:11.248492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e0c88-2c9c-4229-98ca-9363612cebeb None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:11.248783 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e0c88-2c9c-4229-98ca-9363612cebeb None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:11.249060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e0c88-2c9c-4229-98ca-9363612cebeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:11.276944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-c11e0c88-2c9c-4229-98ca-9363612cebeb None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:11.280930 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-c11e0c88-2c9c-4229-98ca-9363612cebeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:11.360298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca41340-7b85-4ab5-9d82-d8f5292dfd39 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:11.416209 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 206/405] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:11.416209 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e0c88-2c9c-4229-98ca-9363612cebeb None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:11.444735 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824711d-8f3b-4140-bf76-7cb18e647151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:11.445946 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824711d-8f3b-4140-bf76-7cb18e647151 None admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:11.446378 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824711d-8f3b-4140-bf76-7cb18e647151 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:11.447272 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824711d-8f3b-4140-bf76-7cb18e647151 None admin] PATH_INFO: `/v3/projects/e66c9a82caa04ffb8ac50780877086d0/groups/295d31655af149ad9194a8bf56aa128a/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:11.451897 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824711d-8f3b-4140-bf76-7cb18e647151 None admin] RBAC: Authorizing `identity:create_grant(project_id=e66c9a82caa04ffb8ac50780877086d0, group_id=295d31655af149ad9194a8bf56aa128a, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:11.454503 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824711d-8f3b-4140-bf76-7cb18e647151 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:11.478266 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 200/406] 10.222.0.71 () {58 vars in 1442 bytes} [Mon May 16 20:11:11 2022] PUT /identity/v3/projects/e66c9a82caa04ffb8ac50780877086d0/groups/295d31655af149ad9194a8bf56aa128a/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:11:11.479420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824711d-8f3b-4140-bf76-7cb18e647151 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:11.641577 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e0c88-2c9c-4229-98ca-9363612cebeb None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:11.702187 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824711d-8f3b-4140-bf76-7cb18e647151 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:11.703325 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ef186-7cab-497d-b495-d657914e4ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:11.704278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ef186-7cab-497d-b495-d657914e4ef7 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:11.705457 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ef186-7cab-497d-b495-d657914e4ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:11.705744 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ef186-7cab-497d-b495-d657914e4ef7 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:11.707327 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ef186-7cab-497d-b495-d657914e4ef7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:11.707723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ef186-7cab-497d-b495-d657914e4ef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:11.709164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ef186-7cab-497d-b495-d657914e4ef7 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:11.718808 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 207/407] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:11.729423 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ef186-7cab-497d-b495-d657914e4ef7 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:11.742245 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32951561-3e12-4fe0-a199-b3dcf3518734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:11.743141 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32951561-3e12-4fe0-a199-b3dcf3518734 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:11.743427 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32951561-3e12-4fe0-a199-b3dcf3518734 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:11.743699 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32951561-3e12-4fe0-a199-b3dcf3518734 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:11.756312 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32951561-3e12-4fe0-a199-b3dcf3518734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:11.764499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-32951561-3e12-4fe0-a199-b3dcf3518734 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:11:11.764499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:11.764499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:11.764499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:11.764499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:11.764499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:11.764499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:11.764499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:11.764499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:11.764499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:11.764499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:11.764499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:11.764499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:11.764499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:11.764499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:11.764499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:11.765686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:11.765686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:11.765686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:11.765686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:11.765686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:11.765686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:11.765686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:11.765686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:11.765686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:11.765686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:11.765686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:11.765686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:11.765686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:11.765686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:11.765686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:11.765686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:11.766510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:11.766510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:11.766510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:11.766510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:11.766510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:11.766510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:11.766510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:11.766510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:11.766510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:11.766510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:11.766510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:11:11.766510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:11.766510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 201/408] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:11:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:11.790682 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32951561-3e12-4fe0-a199-b3dcf3518734 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:11.920345 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ef186-7cab-497d-b495-d657914e4ef7 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:11.966921 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed2278-eb2f-4900-b165-5c084ad0d13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:11.967794 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed2278-eb2f-4900-b165-5c084ad0d13d None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:11.968079 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed2278-eb2f-4900-b165-5c084ad0d13d None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:11.968384 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed2278-eb2f-4900-b165-5c084ad0d13d None admin] PATH_INFO: `/v3/groups/295d31655af149ad9194a8bf56aa128a` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:11.973358 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed2278-eb2f-4900-b165-5c084ad0d13d None admin] RBAC: Authorizing `identity:get_group(group_id=295d31655af149ad9194a8bf56aa128a)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:11.974861 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed2278-eb2f-4900-b165-5c084ad0d13d None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:11.977040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 208/409] 10.222.0.71 () {56 vars in 1180 bytes} [Mon May 16 20:11:11 2022] GET /identity/v3/groups/295d31655af149ad9194a8bf56aa128a => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:11.984015 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed2278-eb2f-4900-b165-5c084ad0d13d None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:12.003314 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32951561-3e12-4fe0-a199-b3dcf3518734 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:12.053372 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8a9f7-c9f0-4cbb-9941-80b9d13f94cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:12.054053 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8a9f7-c9f0-4cbb-9941-80b9d13f94cf None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:12.054331 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8a9f7-c9f0-4cbb-9941-80b9d13f94cf None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:12.054603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8a9f7-c9f0-4cbb-9941-80b9d13f94cf None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:12.055524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8a9f7-c9f0-4cbb-9941-80b9d13f94cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:12.055722 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8a9f7-c9f0-4cbb-9941-80b9d13f94cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:12.057148 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8a9f7-c9f0-4cbb-9941-80b9d13f94cf None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:12.072437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 202/410] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:11:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:11:12.077683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8a9f7-c9f0-4cbb-9941-80b9d13f94cf None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:12.116211 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed2278-eb2f-4900-b165-5c084ad0d13d None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:12.161200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31321ac8-9832-4b8e-a33a-175e22b36159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:12.163164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31321ac8-9832-4b8e-a33a-175e22b36159 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:12.165153 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31321ac8-9832-4b8e-a33a-175e22b36159 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:12.166934 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31321ac8-9832-4b8e-a33a-175e22b36159 None admin] PATH_INFO: `/v3/projects/ff00118a162648a38b9438404dd67916` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:12.169585 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31321ac8-9832-4b8e-a33a-175e22b36159 None admin] RBAC: Authorizing `identity:get_project(project_id=ff00118a162648a38b9438404dd67916)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:12.176600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31321ac8-9832-4b8e-a33a-175e22b36159 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:12.181810 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 209/411] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:11:11 2022] GET /identity/v3/projects/ff00118a162648a38b9438404dd67916 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:12.192529 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31321ac8-9832-4b8e-a33a-175e22b36159 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:12.284580 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8a9f7-c9f0-4cbb-9941-80b9d13f94cf None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:12.329372 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d9cef-13b8-4034-a367-3aef4bb56dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:12.330307 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d9cef-13b8-4034-a367-3aef4bb56dc2 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:12.330588 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d9cef-13b8-4034-a367-3aef4bb56dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:12.330858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d9cef-13b8-4034-a367-3aef4bb56dc2 None admin] PATH_INFO: `/v3/groups/529408c6d66342e394412eafee179f1b` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:12.333893 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d9cef-13b8-4034-a367-3aef4bb56dc2 None admin] RBAC: Authorizing `identity:get_group(group_id=529408c6d66342e394412eafee179f1b)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:12.335499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d9cef-13b8-4034-a367-3aef4bb56dc2 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:12.338893 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 203/412] 10.222.0.71 () {56 vars in 1180 bytes} [Mon May 16 20:11:12 2022] GET /identity/v3/groups/529408c6d66342e394412eafee179f1b => generated 229 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:12.343245 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d9cef-13b8-4034-a367-3aef4bb56dc2 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:12.450580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31321ac8-9832-4b8e-a33a-175e22b36159 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:12.487739 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d9cef-13b8-4034-a367-3aef4bb56dc2 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:12.521543 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c1058-455e-4064-bed6-90e72b76d143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:12.522491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c1058-455e-4064-bed6-90e72b76d143 None admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:12.522776 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c1058-455e-4064-bed6-90e72b76d143 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:12.523047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c1058-455e-4064-bed6-90e72b76d143 None admin] PATH_INFO: `/v3/projects/ff00118a162648a38b9438404dd67916/groups/295d31655af149ad9194a8bf56aa128a/roles/140f30ce618745eea43e96b91df3bbab` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:12.527950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c1058-455e-4064-bed6-90e72b76d143 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff00118a162648a38b9438404dd67916, group_id=295d31655af149ad9194a8bf56aa128a, role_id=140f30ce618745eea43e96b91df3bbab)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:12.529520 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c1058-455e-4064-bed6-90e72b76d143 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:12.552080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 210/413] 10.222.0.71 () {58 vars in 1442 bytes} [Mon May 16 20:11:12 2022] PUT /identity/v3/projects/ff00118a162648a38b9438404dd67916/groups/295d31655af149ad9194a8bf56aa128a/roles/140f30ce618745eea43e96b91df3bbab => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:11:12.552844 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581cd54-631d-4a16-b551-344992bd672c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:12.553778 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581cd54-631d-4a16-b551-344992bd672c None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:12.554061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581cd54-631d-4a16-b551-344992bd672c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:12.554333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581cd54-631d-4a16-b551-344992bd672c None admin] PATH_INFO: `/v3/projects/8a002d9ef0e2477e8031bd7bef5cfc65` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:12.555626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581cd54-631d-4a16-b551-344992bd672c None admin] RBAC: Authorizing `identity:get_project(project_id=8a002d9ef0e2477e8031bd7bef5cfc65)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:12.557316 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581cd54-631d-4a16-b551-344992bd672c None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:12.559582 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 204/414] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:11:12 2022] GET /identity/v3/projects/8a002d9ef0e2477e8031bd7bef5cfc65 => generated 344 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:11:12.565313 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c1058-455e-4064-bed6-90e72b76d143 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:12.724043 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c1058-455e-4064-bed6-90e72b76d143 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:12.781989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7f280-e61e-40bd-8374-add5372e33aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:12.783228 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7f280-e61e-40bd-8374-add5372e33aa None admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:12.783691 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7f280-e61e-40bd-8374-add5372e33aa None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:12.784700 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7f280-e61e-40bd-8374-add5372e33aa None admin] PATH_INFO: `/v3/projects/8a002d9ef0e2477e8031bd7bef5cfc65/groups/529408c6d66342e394412eafee179f1b/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:12.787111 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7f280-e61e-40bd-8374-add5372e33aa None admin] RBAC: Authorizing `identity:create_grant(project_id=8a002d9ef0e2477e8031bd7bef5cfc65, group_id=529408c6d66342e394412eafee179f1b, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:12.788872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7f280-e61e-40bd-8374-add5372e33aa None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:12.812525 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 211/415] 10.222.0.71 () {58 vars in 1442 bytes} [Mon May 16 20:11:12 2022] PUT /identity/v3/projects/8a002d9ef0e2477e8031bd7bef5cfc65/groups/529408c6d66342e394412eafee179f1b/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:11:13.884650 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd2275-74fb-4813-87b1-c575c42877b2 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:13.885940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd2275-74fb-4813-87b1-c575c42877b2 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:13.886429 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd2275-74fb-4813-87b1-c575c42877b2 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:13.888482 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 205/416] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:13.895729 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8cb4c-17cb-4663-b9c4-51e86f2f626a None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:13.896740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8cb4c-17cb-4663-b9c4-51e86f2f626a None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:13.897239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8cb4c-17cb-4663-b9c4-51e86f2f626a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:13.916485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-e4a8cb4c-17cb-4663-b9c4-51e86f2f626a None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:13.918075 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-e4a8cb4c-17cb-4663-b9c4-51e86f2f626a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:13.956476 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3017c6e-55bd-4d70-90b4-017cd0f6b5a0 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:13.956955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3017c6e-55bd-4d70-90b4-017cd0f6b5a0 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:13.957468 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3017c6e-55bd-4d70-90b4-017cd0f6b5a0 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:13.964792 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 206/417] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:13 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:13.970327 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cb7b9-a791-4f84-a9f2-30e0dab2f686 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:13.970637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cb7b9-a791-4f84-a9f2-30e0dab2f686 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:13.970894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cb7b9-a791-4f84-a9f2-30e0dab2f686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:13.999840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 212/418] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:14.025455 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-a09cb7b9-a791-4f84-a9f2-30e0dab2f686 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:14.026708 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-a09cb7b9-a791-4f84-a9f2-30e0dab2f686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:14.043130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8cb4c-17cb-4663-b9c4-51e86f2f626a None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:14.195022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 207/419] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:14.237336 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09cb7b9-a791-4f84-a9f2-30e0dab2f686 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:14.238465 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8cb4c-17cb-4663-b9c4-51e86f2f626a None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:14.290215 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19c9c4-a2d6-4f46-b0d4-2859f443b0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:14.291029 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19c9c4-a2d6-4f46-b0d4-2859f443b0b3 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:14.291332 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19c9c4-a2d6-4f46-b0d4-2859f443b0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:14.291608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19c9c4-a2d6-4f46-b0d4-2859f443b0b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:14.316953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19c9c4-a2d6-4f46-b0d4-2859f443b0b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:14.332116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-bf19c9c4-a2d6-4f46-b0d4-2859f443b0b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:11:14.332116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:14.332116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:14.332116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:14.332116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:14.332116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:14.332116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:14.332116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:14.332116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:14.332116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:14.332116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:14.332116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:14.332116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:14.332116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:14.332116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:14.332116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:14.333116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:14.333116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:14.333116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:14.333116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:14.333116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:14.333116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:14.333116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:14.333116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:14.333116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:14.333116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:14.333116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:14.333116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:14.333116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:14.333116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:14.333116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:14.333116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:14.333898 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:14.333898 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:14.333898 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:14.333898 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:14.333898 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:14.333898 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:14.333898 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:14.333898 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:14.333898 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:14.333898 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:14.333898 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:11:14.333898 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:14.333898 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 213/420] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:11:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:11:14.342920 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19c9c4-a2d6-4f46-b0d4-2859f443b0b3 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:14.466097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09cb7b9-a791-4f84-a9f2-30e0dab2f686 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:14.540761 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db17724-7a34-45e5-a183-b0b2d8b0b396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:14.541666 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db17724-7a34-45e5-a183-b0b2d8b0b396 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:14.541963 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db17724-7a34-45e5-a183-b0b2d8b0b396 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:14.542204 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db17724-7a34-45e5-a183-b0b2d8b0b396 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:14.544843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19c9c4-a2d6-4f46-b0d4-2859f443b0b3 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:14.570911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db17724-7a34-45e5-a183-b0b2d8b0b396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:14.587282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-1db17724-7a34-45e5-a183-b0b2d8b0b396 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:11:14.587282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:14.587282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:14.587282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:14.587282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:14.587282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:14.587282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:14.587282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:14.587282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:14.587282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:14.587282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:14.587282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:14.587282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:14.587282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:14.587282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:14.587282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:14.589117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:14.589117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:14.589117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:14.589117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:14.589117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:14.589117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:14.589117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:14.589117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:14.589117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:14.589117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:14.589117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:14.589117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:14.589117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:14.589117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:14.589117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:14.589117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:14.590721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:14.590721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:14.590721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:14.590721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:14.590721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:14.590721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:14.590721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:14.590721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:14.590721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:14.590721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:14.590721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:11:14.590721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:14.591899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a4bbe-6ecb-4e05-9bb3-ca6b7805e210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:14.592063 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a4bbe-6ecb-4e05-9bb3-ca6b7805e210 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:14.593093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a4bbe-6ecb-4e05-9bb3-ca6b7805e210 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:14.593093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a4bbe-6ecb-4e05-9bb3-ca6b7805e210 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:14.593439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a4bbe-6ecb-4e05-9bb3-ca6b7805e210 None admin] RBAC: Adding query filter params (name=member) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:14.593666 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a4bbe-6ecb-4e05-9bb3-ca6b7805e210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:14.595082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a4bbe-6ecb-4e05-9bb3-ca6b7805e210 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:14.597772 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 208/421] 10.222.0.71 () {56 vars in 1114 bytes} [Mon May 16 20:11:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:14.600811 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c32a6-ae26-4da0-9709-b5b8f2b6ae80 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:14.601689 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c32a6-ae26-4da0-9709-b5b8f2b6ae80 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:14.602414 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c32a6-ae26-4da0-9709-b5b8f2b6ae80 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:14.605414 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 209/422] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:14.611089 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 214/423] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:11:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:14.611920 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a4bbe-6ecb-4e05-9bb3-ca6b7805e210 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:14.616307 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de873f92-1f70-460c-b931-60c920ead51a None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:14.617224 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de873f92-1f70-460c-b931-60c920ead51a None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:14.618023 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de873f92-1f70-460c-b931-60c920ead51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:14.644465 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-de873f92-1f70-460c-b931-60c920ead51a None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:14.645845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-de873f92-1f70-460c-b931-60c920ead51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:14.749782 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 210/424] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:14.749782 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de873f92-1f70-460c-b931-60c920ead51a None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:14.825690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a4bbe-6ecb-4e05-9bb3-ca6b7805e210 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:14.900398 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e54259-c428-42a1-bec0-5c0dc671c665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:14.902812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e54259-c428-42a1-bec0-5c0dc671c665 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:14.903558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e54259-c428-42a1-bec0-5c0dc671c665 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:14.904337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e54259-c428-42a1-bec0-5c0dc671c665 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:14.906209 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e54259-c428-42a1-bec0-5c0dc671c665 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:14.907079 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e54259-c428-42a1-bec0-5c0dc671c665 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:14.911651 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e54259-c428-42a1-bec0-5c0dc671c665 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:14.929198 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 215/425] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:14.931101 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e54259-c428-42a1-bec0-5c0dc671c665 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:14.974513 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de873f92-1f70-460c-b931-60c920ead51a None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:15.036716 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c91cd0-f716-4939-8add-daf9f463a3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:15.038059 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c91cd0-f716-4939-8add-daf9f463a3a1 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:15.038731 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c91cd0-f716-4939-8add-daf9f463a3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:15.039382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c91cd0-f716-4939-8add-daf9f463a3a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:15.146125 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e54259-c428-42a1-bec0-5c0dc671c665 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:15.166843 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c91cd0-f716-4939-8add-daf9f463a3a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:15.170541 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c91cd0-f716-4939-8add-daf9f463a3a1 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:15.207586 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19c654-876b-41d2-abc3-cdad182a1354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:15.208916 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19c654-876b-41d2-abc3-cdad182a1354 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:15.209416 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19c654-876b-41d2-abc3-cdad182a1354 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:15.209912 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19c654-876b-41d2-abc3-cdad182a1354 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:15.232080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19c654-876b-41d2-abc3-cdad182a1354 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:15.243981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-4b19c654-876b-41d2-abc3-cdad182a1354 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 20:11:15.243981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:15.243981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:15.243981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:15.243981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:15.243981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:15.243981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:15.243981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:15.243981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:15.243981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:15.243981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:15.243981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:15.243981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:15.243981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:15.243981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:15.243981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:15.245857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:15.245857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:15.245857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:15.245857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:15.245857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:15.245857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:15.245857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:15.245857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:15.245857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:15.245857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:15.245857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:15.245857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:15.245857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:15.245857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:15.245857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:15.245857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:15.247479 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:15.247479 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:15.247479 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:15.247479 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:15.247479 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:15.247479 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:15.247479 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:15.247479 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:15.247479 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:15.247479 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:15.247479 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 20:11:15.247479 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:15.252661 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 216/426] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:11:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:15.255460 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19c654-876b-41d2-abc3-cdad182a1354 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:15.411158 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 211/427] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:11:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:11:15.413395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c91cd0-f716-4939-8add-daf9f463a3a1 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:15.436694 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19c654-876b-41d2-abc3-cdad182a1354 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:15.489388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ca944-a5bf-4626-86d6-3bb5a1fca50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:15.490061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ca944-a5bf-4626-86d6-3bb5a1fca50a None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:15.490345 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ca944-a5bf-4626-86d6-3bb5a1fca50a None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:15.491300 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ca944-a5bf-4626-86d6-3bb5a1fca50a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:15.558852 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c91cd0-f716-4939-8add-daf9f463a3a1 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:15.589605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ca944-a5bf-4626-86d6-3bb5a1fca50a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:15.591129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ca944-a5bf-4626-86d6-3bb5a1fca50a None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:15.606925 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f88b1-bb67-44f0-9255-43365a38b7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:15.607778 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f88b1-bb67-44f0-9255-43365a38b7ab None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:15.608536 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f88b1-bb67-44f0-9255-43365a38b7ab None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:15.608819 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f88b1-bb67-44f0-9255-43365a38b7ab None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:15.609891 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f88b1-bb67-44f0-9255-43365a38b7ab None admin] RBAC: Adding query filter params (name=member) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:15.610198 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f88b1-bb67-44f0-9255-43365a38b7ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:15.612948 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f88b1-bb67-44f0-9255-43365a38b7ab None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:15.625683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 212/428] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:11:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:15.626639 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f88b1-bb67-44f0-9255-43365a38b7ab None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:15.729574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 217/429] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:11:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:11:15.730459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ca944-a5bf-4626-86d6-3bb5a1fca50a None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:15.762957 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f88b1-bb67-44f0-9255-43365a38b7ab None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:15.802848 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffd498-89e0-4dd8-b6c3-05a88e48ad87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:15.803714 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffd498-89e0-4dd8-b6c3-05a88e48ad87 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:15.803985 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffd498-89e0-4dd8-b6c3-05a88e48ad87 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:15.804317 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffd498-89e0-4dd8-b6c3-05a88e48ad87 None admin] PATH_INFO: `/v3/projects/ff00118a162648a38b9438404dd67916` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:15.805603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ffd498-89e0-4dd8-b6c3-05a88e48ad87 None admin] RBAC: Authorizing `identity:get_project(project_id=ff00118a162648a38b9438404dd67916)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:15.807083 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ffd498-89e0-4dd8-b6c3-05a88e48ad87 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:15.816026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 213/430] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:11:15 2022] GET /identity/v3/projects/ff00118a162648a38b9438404dd67916 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:15.816026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20275413-c41e-456a-b263-2c2e3f5c8766 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:15.816026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20275413-c41e-456a-b263-2c2e3f5c8766 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:15.816026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20275413-c41e-456a-b263-2c2e3f5c8766 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:15.816026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 214/431] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:15.816026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20275413-c41e-456a-b263-2c2e3f5c8766 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:15.864978 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ca944-a5bf-4626-86d6-3bb5a1fca50a None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:15.919932 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf6c14-1b49-4967-bc66-70c08d0a5f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:15.920820 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf6c14-1b49-4967-bc66-70c08d0a5f11 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:15.921054 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf6c14-1b49-4967-bc66-70c08d0a5f11 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:15.921435 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf6c14-1b49-4967-bc66-70c08d0a5f11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:15.979064 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20275413-c41e-456a-b263-2c2e3f5c8766 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:16.007692 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf6c14-1b49-4967-bc66-70c08d0a5f11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:16.009152 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf6c14-1b49-4967-bc66-70c08d0a5f11 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:16.039504 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e26f83-7859-467a-b741-25f4f7b63b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:16.040521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e26f83-7859-467a-b741-25f4f7b63b7b None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:16.041008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e26f83-7859-467a-b741-25f4f7b63b7b None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:16.041485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e26f83-7859-467a-b741-25f4f7b63b7b None admin] PATH_INFO: `/v3/projects/e66c9a82caa04ffb8ac50780877086d0` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:16.043715 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e26f83-7859-467a-b741-25f4f7b63b7b None admin] RBAC: Authorizing `identity:get_project(project_id=e66c9a82caa04ffb8ac50780877086d0)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:16.046523 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e26f83-7859-467a-b741-25f4f7b63b7b None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:16.050661 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 215/432] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:11:15 2022] GET /identity/v3/projects/e66c9a82caa04ffb8ac50780877086d0 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:16.052107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e26f83-7859-467a-b741-25f4f7b63b7b None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:16.123925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 218/433] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:11:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:11:16.125928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2898d00-f017-483b-8673-361868c1504a None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:16.126440 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2898d00-f017-483b-8673-361868c1504a None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:16.126939 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2898d00-f017-483b-8673-361868c1504a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:16.157165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-c2898d00-f017-483b-8673-361868c1504a None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:16.159453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-c2898d00-f017-483b-8673-361868c1504a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:16.192795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e26f83-7859-467a-b741-25f4f7b63b7b None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:16.230776 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e849b75-74f3-4271-a166-50a3aca7ada2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:16.230985 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e849b75-74f3-4271-a166-50a3aca7ada2 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:16.231455 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e849b75-74f3-4271-a166-50a3aca7ada2 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:16.231914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e849b75-74f3-4271-a166-50a3aca7ada2 None admin] PATH_INFO: `/v3/groups/295d31655af149ad9194a8bf56aa128a` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:16.234421 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e849b75-74f3-4271-a166-50a3aca7ada2 None admin] RBAC: Authorizing `identity:get_group(group_id=295d31655af149ad9194a8bf56aa128a)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:16.237119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e849b75-74f3-4271-a166-50a3aca7ada2 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:16.240217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 216/434] 10.222.0.71 () {56 vars in 1180 bytes} [Mon May 16 20:11:16 2022] GET /identity/v3/groups/295d31655af149ad9194a8bf56aa128a => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:16.242359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da700f4-5af6-4e35-b8bc-f5e916bf19d5 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:16.242788 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da700f4-5af6-4e35-b8bc-f5e916bf19d5 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:16.243071 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da700f4-5af6-4e35-b8bc-f5e916bf19d5 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:16.245197 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 217/435] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:16.245668 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da700f4-5af6-4e35-b8bc-f5e916bf19d5 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:16.255208 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 219/436] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:16.256070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2898d00-f017-483b-8673-361868c1504a None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:16.370975 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da700f4-5af6-4e35-b8bc-f5e916bf19d5 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:16.383826 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2898d00-f017-483b-8673-361868c1504a None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:16.414210 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f0ffd-8759-4e6a-814d-e7e3ea896721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:16.415594 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f0ffd-8759-4e6a-814d-e7e3ea896721 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:16.416043 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f0ffd-8759-4e6a-814d-e7e3ea896721 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:16.416535 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f0ffd-8759-4e6a-814d-e7e3ea896721 None admin] PATH_INFO: `/v3/groups/295d31655af149ad9194a8bf56aa128a` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:16.418373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f0ffd-8759-4e6a-814d-e7e3ea896721 None admin] RBAC: Authorizing `identity:get_group(group_id=295d31655af149ad9194a8bf56aa128a)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:16.420254 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f0ffd-8759-4e6a-814d-e7e3ea896721 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:16.422163 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 218/437] 10.222.0.71 () {56 vars in 1180 bytes} [Mon May 16 20:11:16 2022] GET /identity/v3/groups/295d31655af149ad9194a8bf56aa128a => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:16.422929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f0ffd-8759-4e6a-814d-e7e3ea896721 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:16.428780 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f863c-056e-41de-b7d6-17997c9c8519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:16.429631 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f863c-056e-41de-b7d6-17997c9c8519 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:16.429907 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f863c-056e-41de-b7d6-17997c9c8519 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:16.430172 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f863c-056e-41de-b7d6-17997c9c8519 None admin] PATH_INFO: `/v3/projects/e66c9a82caa04ffb8ac50780877086d0` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:16.431378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f863c-056e-41de-b7d6-17997c9c8519 None admin] RBAC: Authorizing `identity:get_project(project_id=e66c9a82caa04ffb8ac50780877086d0)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:16.432876 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f863c-056e-41de-b7d6-17997c9c8519 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:16.434606 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 220/438] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:11:16 2022] GET /identity/v3/projects/e66c9a82caa04ffb8ac50780877086d0 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:16.435810 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08e8e5-5551-46b3-8885-95c1b46eb945 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:16.436093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08e8e5-5551-46b3-8885-95c1b46eb945 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:16.436395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08e8e5-5551-46b3-8885-95c1b46eb945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:16.457791 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-dc08e8e5-5551-46b3-8885-95c1b46eb945 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:16.459027 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-dc08e8e5-5551-46b3-8885-95c1b46eb945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:16.532396 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f0ffd-8759-4e6a-814d-e7e3ea896721 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:16.535674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 221/439] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:16.537025 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08e8e5-5551-46b3-8885-95c1b46eb945 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:16.571044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d87b3-3ff0-4e91-92c8-0bb280d9f182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:16.571695 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d87b3-3ff0-4e91-92c8-0bb280d9f182 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:16.571982 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d87b3-3ff0-4e91-92c8-0bb280d9f182 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:16.572268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d87b3-3ff0-4e91-92c8-0bb280d9f182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:16.573113 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d87b3-3ff0-4e91-92c8-0bb280d9f182 None admin] RBAC: Adding query filter params (group.id=295d31655af149ad9194a8bf56aa128a, role.id=99462c05ed484212893d40128c99f47c, scope.project.id=ff00118a162648a38b9438404dd67916) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:16.573435 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d87b3-3ff0-4e91-92c8-0bb280d9f182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:16.574989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d87b3-3ff0-4e91-92c8-0bb280d9f182 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:16.582697 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 219/440] 10.222.0.71 () {56 vars in 1376 bytes} [Mon May 16 20:11:16 2022] GET /identity/v3/role_assignments?group.id=295d31655af149ad9194a8bf56aa128a&scope.project.id=ff00118a162648a38b9438404dd67916&role.id=99462c05ed484212893d40128c99f47c => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:16.583575 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d87b3-3ff0-4e91-92c8-0bb280d9f182 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:16.676200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08e8e5-5551-46b3-8885-95c1b46eb945 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:16.720852 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360bbe3-cc2a-4c37-821b-429a284fd146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:16.722027 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360bbe3-cc2a-4c37-821b-429a284fd146 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:16.722318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360bbe3-cc2a-4c37-821b-429a284fd146 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:16.722603 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360bbe3-cc2a-4c37-821b-429a284fd146 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:16.732416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d87b3-3ff0-4e91-92c8-0bb280d9f182 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:16.738568 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360bbe3-cc2a-4c37-821b-429a284fd146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:16.749291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-0360bbe3-cc2a-4c37-821b-429a284fd146 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:11:16.749291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:16.749291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:16.749291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:16.749291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:16.749291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:16.749291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:16.749291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:16.749291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:16.749291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:16.749291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:16.749291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:16.749291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:16.749291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:16.749291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:16.749291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:16.750271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:16.750271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:16.750271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:16.750271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:16.750271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:16.750271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:16.750271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:16.750271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:16.750271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:16.750271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:16.750271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:16.750271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:16.750271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:16.750271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:16.750271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:16.750271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:16.751088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:16.751088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:16.751088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:16.751088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:16.751088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:16.751088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:16.751088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:16.751088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:16.751088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:16.751088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:16.751088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:11:16.751088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:16.751088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 222/441] 10.222.0.71 () {56 vars in 1114 bytes} [Mon May 16 20:11:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:16.751766 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360bbe3-cc2a-4c37-821b-429a284fd146 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:16.778298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd454f-d415-4a8c-baf3-4a2bd103f693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:16.778954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd454f-d415-4a8c-baf3-4a2bd103f693 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:16.779235 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd454f-d415-4a8c-baf3-4a2bd103f693 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:16.779510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd454f-d415-4a8c-baf3-4a2bd103f693 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:16.780413 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd454f-d415-4a8c-baf3-4a2bd103f693 None admin] RBAC: Adding query filter params (group.id=295d31655af149ad9194a8bf56aa128a, role.id=140f30ce618745eea43e96b91df3bbab, scope.project.id=e66c9a82caa04ffb8ac50780877086d0) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:16.780726 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd454f-d415-4a8c-baf3-4a2bd103f693 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:16.782168 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd454f-d415-4a8c-baf3-4a2bd103f693 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:16.788488 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 220/442] 10.222.0.71 () {56 vars in 1376 bytes} [Mon May 16 20:11:16 2022] GET /identity/v3/role_assignments?group.id=295d31655af149ad9194a8bf56aa128a&scope.project.id=e66c9a82caa04ffb8ac50780877086d0&role.id=140f30ce618745eea43e96b91df3bbab => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:16.789295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd454f-d415-4a8c-baf3-4a2bd103f693 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:16.889023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360bbe3-cc2a-4c37-821b-429a284fd146 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:16.915960 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd454f-d415-4a8c-baf3-4a2bd103f693 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:16.925226 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94657989-342f-49d6-866e-e500bc6b6ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:16.926485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94657989-342f-49d6-866e-e500bc6b6ecf None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:16.926720 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94657989-342f-49d6-866e-e500bc6b6ecf None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:16.926997 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94657989-342f-49d6-866e-e500bc6b6ecf None admin] PATH_INFO: `/v3/groups/295d31655af149ad9194a8bf56aa128a` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:16.928306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94657989-342f-49d6-866e-e500bc6b6ecf None admin] RBAC: Authorizing `identity:get_group(group_id=295d31655af149ad9194a8bf56aa128a)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:16.929808 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94657989-342f-49d6-866e-e500bc6b6ecf None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:16.936463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 223/443] 10.222.0.71 () {56 vars in 1180 bytes} [Mon May 16 20:11:16 2022] GET /identity/v3/groups/295d31655af149ad9194a8bf56aa128a => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:16.936463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94657989-342f-49d6-866e-e500bc6b6ecf None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:16.952721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138123ca-f03e-4cbc-8be4-17d23c1b1fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:16.953521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138123ca-f03e-4cbc-8be4-17d23c1b1fde None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:16.953800 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138123ca-f03e-4cbc-8be4-17d23c1b1fde None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:16.954067 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138123ca-f03e-4cbc-8be4-17d23c1b1fde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:16.966450 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138123ca-f03e-4cbc-8be4-17d23c1b1fde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:16.975765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-138123ca-f03e-4cbc-8be4-17d23c1b1fde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:11:16.975765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:16.975765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:16.975765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:16.975765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:16.975765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:16.975765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:16.975765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:16.975765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:16.975765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:16.975765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:16.975765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:16.975765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:16.975765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:16.975765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:16.975765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:16.976748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:16.976748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:16.976748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:16.976748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:16.976748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:16.976748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:16.976748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:16.976748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:16.976748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:16.976748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:16.976748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:16.976748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:16.976748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:16.976748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:16.976748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:16.976748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:16.977507 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:16.977507 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:16.977507 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:16.977507 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:16.977507 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:16.977507 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:16.977507 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:16.977507 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:16.977507 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:16.977507 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:16.977507 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:11:16.977507 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:16.982932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 221/444] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:11:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:16.983855 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138123ca-f03e-4cbc-8be4-17d23c1b1fde None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:17.048494 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94657989-342f-49d6-866e-e500bc6b6ecf None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:17.082824 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d44eb7-e1e7-4c92-807d-8c8bcce7506c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:17.083494 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d44eb7-e1e7-4c92-807d-8c8bcce7506c None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:17.083776 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d44eb7-e1e7-4c92-807d-8c8bcce7506c None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:17.084050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d44eb7-e1e7-4c92-807d-8c8bcce7506c None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:17.084828 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d44eb7-e1e7-4c92-807d-8c8bcce7506c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:17.085137 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d44eb7-e1e7-4c92-807d-8c8bcce7506c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:17.086515 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d44eb7-e1e7-4c92-807d-8c8bcce7506c None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:17.094592 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 224/445] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:17.095254 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138123ca-f03e-4cbc-8be4-17d23c1b1fde None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:17.095463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d44eb7-e1e7-4c92-807d-8c8bcce7506c None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:17.131530 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bc88e-2ded-4797-a80e-bea879f439f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:17.132209 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bc88e-2ded-4797-a80e-bea879f439f8 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:17.132491 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bc88e-2ded-4797-a80e-bea879f439f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:17.132768 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bc88e-2ded-4797-a80e-bea879f439f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:17.133604 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bc88e-2ded-4797-a80e-bea879f439f8 None admin] RBAC: Adding query filter params (group.id=295d31655af149ad9194a8bf56aa128a, role.id=99462c05ed484212893d40128c99f47c, scope.project.id=e66c9a82caa04ffb8ac50780877086d0) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:17.133913 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bc88e-2ded-4797-a80e-bea879f439f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:17.135375 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bc88e-2ded-4797-a80e-bea879f439f8 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:17.142271 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 222/446] 10.222.0.71 () {56 vars in 1376 bytes} [Mon May 16 20:11:16 2022] GET /identity/v3/role_assignments?group.id=295d31655af149ad9194a8bf56aa128a&scope.project.id=e66c9a82caa04ffb8ac50780877086d0&role.id=99462c05ed484212893d40128c99f47c => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:17.143116 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bc88e-2ded-4797-a80e-bea879f439f8 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:17.217800 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d44eb7-e1e7-4c92-807d-8c8bcce7506c None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:17.262876 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cbad6-a187-466e-8abb-826bb596c348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:17.263651 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cbad6-a187-466e-8abb-826bb596c348 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:17.263970 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cbad6-a187-466e-8abb-826bb596c348 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:17.264243 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cbad6-a187-466e-8abb-826bb596c348 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:17.265013 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cbad6-a187-466e-8abb-826bb596c348 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:17.265574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cbad6-a187-466e-8abb-826bb596c348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:17.267024 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cbad6-a187-466e-8abb-826bb596c348 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:17.276672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 225/447] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:11:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:17.283328 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cbad6-a187-466e-8abb-826bb596c348 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:17.288877 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bc88e-2ded-4797-a80e-bea879f439f8 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:17.334441 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9537a6-e05a-41bf-894c-76a87a49a177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:17.335511 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9537a6-e05a-41bf-894c-76a87a49a177 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:17.336021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9537a6-e05a-41bf-894c-76a87a49a177 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:17.336563 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9537a6-e05a-41bf-894c-76a87a49a177 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:17.432074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cbad6-a187-466e-8abb-826bb596c348 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:17.459516 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9537a6-e05a-41bf-894c-76a87a49a177 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:17.461114 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9537a6-e05a-41bf-894c-76a87a49a177 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:17.488994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6fc23-5734-484f-b597-53c02e875cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:17.490432 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6fc23-5734-484f-b597-53c02e875cd7 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:17.491180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6fc23-5734-484f-b597-53c02e875cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:17.491913 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6fc23-5734-484f-b597-53c02e875cd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:17.593194 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6fc23-5734-484f-b597-53c02e875cd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:17.595160 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 223/448] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:11:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:11:17.595868 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6fc23-5734-484f-b597-53c02e875cd7 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:17.601911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9537a6-e05a-41bf-894c-76a87a49a177 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:17.736501 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 226/449] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:11:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 20:11:17.742965 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6fc23-5734-484f-b597-53c02e875cd7 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:17.751107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9537a6-e05a-41bf-894c-76a87a49a177 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:17.795082 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3fd21-f7a6-4885-b3aa-f8cf776dbbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:17.795978 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3fd21-f7a6-4885-b3aa-f8cf776dbbde None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:17.796294 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3fd21-f7a6-4885-b3aa-f8cf776dbbde None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:17.796570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3fd21-f7a6-4885-b3aa-f8cf776dbbde None admin] PATH_INFO: `/v3/projects/ff00118a162648a38b9438404dd67916` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:17.797888 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3fd21-f7a6-4885-b3aa-f8cf776dbbde None admin] RBAC: Authorizing `identity:get_project(project_id=ff00118a162648a38b9438404dd67916)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:17.799380 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3fd21-f7a6-4885-b3aa-f8cf776dbbde None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:17.802386 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 224/450] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:11:17 2022] GET /identity/v3/projects/ff00118a162648a38b9438404dd67916 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:11:17.808747 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3fd21-f7a6-4885-b3aa-f8cf776dbbde None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:17.897661 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6fc23-5734-484f-b597-53c02e875cd7 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:17.941838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3fd21-f7a6-4885-b3aa-f8cf776dbbde None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:17.943936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02513d25-2242-48b7-b333-7b29d9574b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:17.944863 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02513d25-2242-48b7-b333-7b29d9574b5a None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:17.945147 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02513d25-2242-48b7-b333-7b29d9574b5a None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:17.945423 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02513d25-2242-48b7-b333-7b29d9574b5a None admin] PATH_INFO: `/v3/projects/8a002d9ef0e2477e8031bd7bef5cfc65` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:17.946788 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02513d25-2242-48b7-b333-7b29d9574b5a None admin] RBAC: Authorizing `identity:get_project(project_id=8a002d9ef0e2477e8031bd7bef5cfc65)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:17.948325 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02513d25-2242-48b7-b333-7b29d9574b5a None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:17.950466 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 227/451] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:11:17 2022] GET /identity/v3/projects/8a002d9ef0e2477e8031bd7bef5cfc65 => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:11:17.955842 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02513d25-2242-48b7-b333-7b29d9574b5a None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:17.983585 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab47d0-a0f0-4979-bf71-1a134cf23122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:17.984487 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab47d0-a0f0-4979-bf71-1a134cf23122 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:17.984767 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab47d0-a0f0-4979-bf71-1a134cf23122 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:17.985138 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab47d0-a0f0-4979-bf71-1a134cf23122 None admin] PATH_INFO: `/v3/groups/295d31655af149ad9194a8bf56aa128a` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:17.986714 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab47d0-a0f0-4979-bf71-1a134cf23122 None admin] RBAC: Authorizing `identity:get_group(group_id=295d31655af149ad9194a8bf56aa128a)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:17.989542 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab47d0-a0f0-4979-bf71-1a134cf23122 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:17.991281 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 225/452] 10.222.0.71 () {56 vars in 1180 bytes} [Mon May 16 20:11:17 2022] GET /identity/v3/groups/295d31655af149ad9194a8bf56aa128a => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:17.997254 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab47d0-a0f0-4979-bf71-1a134cf23122 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:18.061544 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02513d25-2242-48b7-b333-7b29d9574b5a None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:18.096058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06af7b-c91e-4aa4-9114-62b7ab0fb903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:18.097461 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06af7b-c91e-4aa4-9114-62b7ab0fb903 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:18.097831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06af7b-c91e-4aa4-9114-62b7ab0fb903 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:18.098108 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06af7b-c91e-4aa4-9114-62b7ab0fb903 None admin] PATH_INFO: `/v3/groups/529408c6d66342e394412eafee179f1b` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:18.099311 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06af7b-c91e-4aa4-9114-62b7ab0fb903 None admin] RBAC: Authorizing `identity:get_group(group_id=529408c6d66342e394412eafee179f1b)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:18.100025 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab47d0-a0f0-4979-bf71-1a134cf23122 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:18.100810 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06af7b-c91e-4aa4-9114-62b7ab0fb903 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:18.102605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 228/453] 10.222.0.71 () {56 vars in 1180 bytes} [Mon May 16 20:11:17 2022] GET /identity/v3/groups/529408c6d66342e394412eafee179f1b => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:11:18.108227 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06af7b-c91e-4aa4-9114-62b7ab0fb903 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:18.135229 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c2bd0-c6b5-43a5-b65f-12a0971a1c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:18.136043 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c2bd0-c6b5-43a5-b65f-12a0971a1c1b None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:18.136425 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c2bd0-c6b5-43a5-b65f-12a0971a1c1b None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:18.136812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c2bd0-c6b5-43a5-b65f-12a0971a1c1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:18.138216 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c2bd0-c6b5-43a5-b65f-12a0971a1c1b None admin] RBAC: Adding query filter params (group.id=295d31655af149ad9194a8bf56aa128a, role.id=140f30ce618745eea43e96b91df3bbab, scope.project.id=ff00118a162648a38b9438404dd67916) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:18.138539 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c2bd0-c6b5-43a5-b65f-12a0971a1c1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:18.140396 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c2bd0-c6b5-43a5-b65f-12a0971a1c1b None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:18.147192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 226/454] 10.222.0.71 () {56 vars in 1376 bytes} [Mon May 16 20:11:17 2022] GET /identity/v3/role_assignments?group.id=295d31655af149ad9194a8bf56aa128a&scope.project.id=ff00118a162648a38b9438404dd67916&role.id=140f30ce618745eea43e96b91df3bbab => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:11:18.216641 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06af7b-c91e-4aa4-9114-62b7ab0fb903 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:18.253561 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d7099-d780-4281-9ea0-11d363a86dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:18.254161 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d7099-d780-4281-9ea0-11d363a86dd4 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:18.254411 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d7099-d780-4281-9ea0-11d363a86dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:18.254680 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d7099-d780-4281-9ea0-11d363a86dd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:18.255552 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d7099-d780-4281-9ea0-11d363a86dd4 None admin] RBAC: Adding query filter params (group.id=529408c6d66342e394412eafee179f1b, role.id=6576d9225a0946de877f527e3d15db05, scope.project.id=8a002d9ef0e2477e8031bd7bef5cfc65) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:18.255855 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d7099-d780-4281-9ea0-11d363a86dd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:18.257356 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d7099-d780-4281-9ea0-11d363a86dd4 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:18.264085 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 229/455] 10.222.0.71 () {56 vars in 1376 bytes} [Mon May 16 20:11:18 2022] GET /identity/v3/role_assignments?group.id=529408c6d66342e394412eafee179f1b&scope.project.id=8a002d9ef0e2477e8031bd7bef5cfc65&role.id=6576d9225a0946de877f527e3d15db05 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:11:21.425876 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341c486-b415-40da-bc41-3a776ad27142 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:21.426436 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341c486-b415-40da-bc41-3a776ad27142 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:21.426436 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341c486-b415-40da-bc41-3a776ad27142 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:21.428218 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 227/456] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:21.434293 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a57717-8928-4a89-9f5e-3d8444a7ec0d None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:21.434806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a57717-8928-4a89-9f5e-3d8444a7ec0d None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:21.434909 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a57717-8928-4a89-9f5e-3d8444a7ec0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:21.454098 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-13a57717-8928-4a89-9f5e-3d8444a7ec0d None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:21.455455 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-13a57717-8928-4a89-9f5e-3d8444a7ec0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:21.550332 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 230/457] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:11:21.581915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821ec6a-ff14-4fd0-aa0f-68fbc2c83676 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:21.582566 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821ec6a-ff14-4fd0-aa0f-68fbc2c83676 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:21.583035 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821ec6a-ff14-4fd0-aa0f-68fbc2c83676 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:21.586230 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 228/458] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:21.591468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26140be-ecb7-445b-9421-778bb4f8c38c None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:21.592082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26140be-ecb7-445b-9421-778bb4f8c38c None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:21.592599 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26140be-ecb7-445b-9421-778bb4f8c38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:21.597924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821ec6a-ff14-4fd0-aa0f-68fbc2c83676 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:21.622543 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-b26140be-ecb7-445b-9421-778bb4f8c38c None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:21.625392 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-b26140be-ecb7-445b-9421-778bb4f8c38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:21.774961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821ec6a-ff14-4fd0-aa0f-68fbc2c83676 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:21.798122 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 231/459] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:21.816628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f506184-eb93-40c0-9885-64993eb41096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:21.817803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f506184-eb93-40c0-9885-64993eb41096 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:21.818287 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f506184-eb93-40c0-9885-64993eb41096 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:21.818760 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f506184-eb93-40c0-9885-64993eb41096 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:21.830635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f506184-eb93-40c0-9885-64993eb41096 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:21.833749 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f506184-eb93-40c0-9885-64993eb41096 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:21.842476 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26140be-ecb7-445b-9421-778bb4f8c38c None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:21.855359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-4f506184-eb93-40c0-9885-64993eb41096 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:21.855359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:21.855359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:21.855359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:21.855359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:21.855359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:21.855359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:21.855359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:21.855359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:21.855359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:21.855359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:21.855359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:21.855359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:21.855359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:21.855359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:21.856325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:21.856325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:21.856325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:21.856325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:21.856325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:21.856325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:21.856325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:21.856325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:21.856325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:21.856325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:21.856325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:21.856325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:21.856325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:21.856325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:21.856325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:21.856325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:21.856325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:21.857245 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:21.857245 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:21.857245 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:21.857245 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:21.859216 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 229/460] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:21.860811 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48866ba1-de9b-4a88-8e76-d516cfd7083b None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:21.861361 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48866ba1-de9b-4a88-8e76-d516cfd7083b None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:21.861799 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48866ba1-de9b-4a88-8e76-d516cfd7083b None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:21.864652 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 230/461] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:21.871144 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0681d-c540-40fe-9a8a-d7972dfc69da None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:21.871144 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0681d-c540-40fe-9a8a-d7972dfc69da None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:21.871144 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0681d-c540-40fe-9a8a-d7972dfc69da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:21.893125 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-48f0681d-c540-40fe-9a8a-d7972dfc69da None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:21.895228 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-48f0681d-c540-40fe-9a8a-d7972dfc69da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:21.984437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 231/462] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:21.985956 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0681d-c540-40fe-9a8a-d7972dfc69da None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:22.030353 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26140be-ecb7-445b-9421-778bb4f8c38c None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:22.078743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bd776-4f30-47ec-8a48-530d82429b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:22.079531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bd776-4f30-47ec-8a48-530d82429b24 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:22.079812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bd776-4f30-47ec-8a48-530d82429b24 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:22.080088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bd776-4f30-47ec-8a48-530d82429b24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:22.092858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bd776-4f30-47ec-8a48-530d82429b24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:22.094395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bd776-4f30-47ec-8a48-530d82429b24 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:22.116120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-880bd776-4f30-47ec-8a48-530d82429b24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:22.116120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:22.116120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:22.116120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:22.116120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:22.116120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:22.116120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:22.116120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:22.116120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:22.116120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:22.116120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:22.116120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:22.116120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:22.116120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:22.116120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:22.117903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:22.117903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:22.117903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:22.117903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:22.117903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:22.117903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:22.117903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:22.117903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:22.117903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:22.117903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:22.117903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:22.117903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:22.117903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:22.117903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:22.117903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:22.117903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:22.117903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:22.119790 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:22.119790 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:22.119790 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:22.119790 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:22.122719 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 232/463] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:11:22.123729 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bd776-4f30-47ec-8a48-530d82429b24 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:22.191353 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0681d-c540-40fe-9a8a-d7972dfc69da None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:22.264738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98c29c-e2b0-42a1-a861-5c4a9a8b9c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:22.266519 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98c29c-e2b0-42a1-a861-5c4a9a8b9c03 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:22.267115 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98c29c-e2b0-42a1-a861-5c4a9a8b9c03 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:22.267632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98c29c-e2b0-42a1-a861-5c4a9a8b9c03 None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:22.270725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98c29c-e2b0-42a1-a861-5c4a9a8b9c03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:22.271603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98c29c-e2b0-42a1-a861-5c4a9a8b9c03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:22.275239 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98c29c-e2b0-42a1-a861-5c4a9a8b9c03 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:22.297895 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bd776-4f30-47ec-8a48-530d82429b24 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:22.312127 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 232/464] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:22.312127 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98c29c-e2b0-42a1-a861-5c4a9a8b9c03 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:22.370156 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf31692-4227-40f4-966b-45669cfe94a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:22.370835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf31692-4227-40f4-966b-45669cfe94a9 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:22.371117 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf31692-4227-40f4-966b-45669cfe94a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:22.371389 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf31692-4227-40f4-966b-45669cfe94a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:22.385112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf31692-4227-40f4-966b-45669cfe94a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:22.387053 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf31692-4227-40f4-966b-45669cfe94a9 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:22.409026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-ebf31692-4227-40f4-966b-45669cfe94a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:22.409026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:22.409026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:22.409026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:22.409026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:22.409026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:22.409026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:22.409026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:22.409026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:22.409026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:22.409026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:22.409026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:22.409026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:22.409026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:22.409026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:22.410688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:22.410688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:22.410688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:22.410688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:22.410688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:22.410688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:22.410688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:22.410688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:22.410688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:22.410688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:22.410688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:22.410688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:22.410688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:22.410688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:22.410688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:22.410688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:22.410688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:22.413050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:22.413050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:22.413050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:22.413050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:22.413050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 233/465] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:22.413050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf31692-4227-40f4-966b-45669cfe94a9 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:22.492569 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98c29c-e2b0-42a1-a861-5c4a9a8b9c03 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:22.534814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb63cfa-6a4a-4c88-bb73-e6888d60cbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:22.535501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb63cfa-6a4a-4c88-bb73-e6888d60cbd0 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:22.535778 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb63cfa-6a4a-4c88-bb73-e6888d60cbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:22.536039 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb63cfa-6a4a-4c88-bb73-e6888d60cbd0 None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:22.536828 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb63cfa-6a4a-4c88-bb73-e6888d60cbd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:22.537133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb63cfa-6a4a-4c88-bb73-e6888d60cbd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:22.538582 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb63cfa-6a4a-4c88-bb73-e6888d60cbd0 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:22.557538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 233/466] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:22.557538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee2c13-8b47-4918-80ca-3a7916294425 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:22.557538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee2c13-8b47-4918-80ca-3a7916294425 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:22.557538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee2c13-8b47-4918-80ca-3a7916294425 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:22.560561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 234/467] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:22.561363 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee2c13-8b47-4918-80ca-3a7916294425 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:22.590891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf31692-4227-40f4-966b-45669cfe94a9 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:22.634755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf770696-d29e-423f-9a1e-e5ae8292bb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:22.635350 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf770696-d29e-423f-9a1e-e5ae8292bb2a None admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:22.635630 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf770696-d29e-423f-9a1e-e5ae8292bb2a None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:22.635903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf770696-d29e-423f-9a1e-e5ae8292bb2a None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:22.636697 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf770696-d29e-423f-9a1e-e5ae8292bb2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:22.638226 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf770696-d29e-423f-9a1e-e5ae8292bb2a None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:22.670509 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 234/468] 10.222.0.71 () {60 vars in 1132 bytes} [Mon May 16 20:11:22 2022] POST /identity/v3/users => generated 248 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:11:22.672491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf770696-d29e-423f-9a1e-e5ae8292bb2a None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:22.750673 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee2c13-8b47-4918-80ca-3a7916294425 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:22.824730 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521157b-b806-47bb-8494-44d809e56eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:22.826643 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521157b-b806-47bb-8494-44d809e56eb0 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:22.827562 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521157b-b806-47bb-8494-44d809e56eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:22.828329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521157b-b806-47bb-8494-44d809e56eb0 None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:22.830607 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521157b-b806-47bb-8494-44d809e56eb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:22.831964 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521157b-b806-47bb-8494-44d809e56eb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:22.836681 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521157b-b806-47bb-8494-44d809e56eb0 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:22.859776 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 235/469] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:22.862799 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fccfd-a9d8-4fe0-86fb-a0a9dbdb4b27 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:22.863659 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fccfd-a9d8-4fe0-86fb-a0a9dbdb4b27 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:22.864447 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fccfd-a9d8-4fe0-86fb-a0a9dbdb4b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:22.884272 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf770696-d29e-423f-9a1e-e5ae8292bb2a None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:22.893812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-345fccfd-a9d8-4fe0-86fb-a0a9dbdb4b27 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:22.895832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-345fccfd-a9d8-4fe0-86fb-a0a9dbdb4b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:22.942179 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cdd1c-c110-48d2-8543-8aee2974f2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:22.943356 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cdd1c-c110-48d2-8543-8aee2974f2fd None admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:22.943717 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cdd1c-c110-48d2-8543-8aee2974f2fd None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:22.943998 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cdd1c-c110-48d2-8543-8aee2974f2fd None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:22.945343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cdd1c-c110-48d2-8543-8aee2974f2fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:22.948241 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cdd1c-c110-48d2-8543-8aee2974f2fd None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:22.981990 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 235/470] 10.222.0.71 () {60 vars in 1132 bytes} [Mon May 16 20:11:22 2022] POST /identity/v3/users => generated 248 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:11:22.984550 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba2d35-14ea-49aa-aa72-270ea9a8fd3c None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:22.985060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba2d35-14ea-49aa-aa72-270ea9a8fd3c None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:22.985546 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba2d35-14ea-49aa-aa72-270ea9a8fd3c None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:22.988305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 236/471] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:22.989780 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba2d35-14ea-49aa-aa72-270ea9a8fd3c None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:23.009749 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 236/472] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:23.009749 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ab033-9100-4266-8f28-7eac2c96a2c9 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:23.009749 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ab033-9100-4266-8f28-7eac2c96a2c9 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:23.009749 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ab033-9100-4266-8f28-7eac2c96a2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:23.037758 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-8c5ab033-9100-4266-8f28-7eac2c96a2c9 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:23.039552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8c5ab033-9100-4266-8f28-7eac2c96a2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:23.146756 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 237/473] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:23.148044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ab033-9100-4266-8f28-7eac2c96a2c9 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:23.182610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba2d35-14ea-49aa-aa72-270ea9a8fd3c None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:23.224076 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc6879-bfa1-4ff4-bb17-59023a1cf796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:23.224807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc6879-bfa1-4ff4-bb17-59023a1cf796 None admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:23.225093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc6879-bfa1-4ff4-bb17-59023a1cf796 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:23.225405 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc6879-bfa1-4ff4-bb17-59023a1cf796 None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:23.226127 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc6879-bfa1-4ff4-bb17-59023a1cf796 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:23.227653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc6879-bfa1-4ff4-bb17-59023a1cf796 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:23.259250 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 237/474] 10.222.0.71 () {60 vars in 1132 bytes} [Mon May 16 20:11:22 2022] POST /identity/v3/users => generated 246 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:11:23.264352 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc6879-bfa1-4ff4-bb17-59023a1cf796 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:23.311451 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ab033-9100-4266-8f28-7eac2c96a2c9 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:23.355179 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c2be3-334a-4620-ada7-eb28af4ba19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:23.356544 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c2be3-334a-4620-ada7-eb28af4ba19a None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:23.357040 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c2be3-334a-4620-ada7-eb28af4ba19a None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:23.357511 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c2be3-334a-4620-ada7-eb28af4ba19a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:23.371741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c2be3-334a-4620-ada7-eb28af4ba19a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:23.373779 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c2be3-334a-4620-ada7-eb28af4ba19a None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:23.389980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc6879-bfa1-4ff4-bb17-59023a1cf796 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:23.396987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-870c2be3-334a-4620-ada7-eb28af4ba19a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:23.396987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:23.396987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:23.396987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:23.396987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:23.396987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:23.396987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:23.396987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:23.396987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:23.396987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:23.396987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:23.396987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:23.396987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:23.396987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:23.396987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:23.397878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:23.397878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:23.397878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:23.397878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:23.397878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:23.397878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:23.397878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:23.397878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:23.397878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:23.397878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:23.397878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:23.397878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:23.397878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:23.397878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:23.397878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:23.397878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:23.397878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:23.398740 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:23.398740 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:23.398740 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:23.398740 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:23.401257 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 238/475] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:23.408091 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c2be3-334a-4620-ada7-eb28af4ba19a None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:23.434052 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ed1cc-8d6b-4680-a799-d88e04dc9154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:23.434754 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ed1cc-8d6b-4680-a799-d88e04dc9154 None admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:23.435040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ed1cc-8d6b-4680-a799-d88e04dc9154 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:23.435321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ed1cc-8d6b-4680-a799-d88e04dc9154 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:23.436117 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ed1cc-8d6b-4680-a799-d88e04dc9154 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:23.438130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ed1cc-8d6b-4680-a799-d88e04dc9154 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:23.447304 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.sql.core [None req-d19ed1cc-8d6b-4680-a799-d88e04dc9154 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 20:11:23.447304 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 16 20:11:23.447304 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [parameters: {'id': 'a5bf0ddb420a4dad8847e5f9624da74c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 16 20:11:23.447304 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79934) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 20:11:23.466681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-d19ed1cc-8d6b-4680-a799-d88e04dc9154 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 16 20:11:23.466681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:23.466681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 20:11:23.466681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 20:11:23.466681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 20:11:23.466681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 20:11:23.466681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 20:11:23.466681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application result = self._query(query) May 16 20:11:23.466681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 20:11:23.466681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application conn.query(q) May 16 20:11:23.466681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 20:11:23.466681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 20:11:23.466681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 20:11:23.466681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application result.read() May 16 20:11:23.466681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 20:11:23.467652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 20:11:23.467652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 20:11:23.467652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 20:11:23.467652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 20:11:23.467652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 20:11:23.467652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 20:11:23.467652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 20:11:23.467652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 20:11:23.467652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:23.467652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 20:11:23.467652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:23.467652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:23.467652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 20:11:23.467652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 20:11:23.467652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 16 20:11:23.467652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return ref.to_dict() May 16 20:11:23.467652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 20:11:23.467652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application next(self.gen) May 16 20:11:23.468610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 20:11:23.468610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application yield resource May 16 20:11:23.468610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 20:11:23.468610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application next(self.gen) May 16 20:11:23.468610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 20:11:23.468610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self.session.rollback() May 16 20:11:23.468610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 20:11:23.468610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self.force_reraise() May 16 20:11:23.468610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 20:11:23.468610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise self.value May 16 20:11:23.468610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 20:11:23.468610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 20:11:23.468610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 20:11:23.468610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application session.commit() May 16 20:11:23.468610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 20:11:23.468610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 20:11:23.468610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 20:11:23.469489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._prepare_impl() May 16 20:11:23.469489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 20:11:23.469489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self.session.flush() May 16 20:11:23.469489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 20:11:23.469489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._flush(objects) May 16 20:11:23.469489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 20:11:23.469489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 20:11:23.469489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 20:11:23.469489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application compat.raise_( May 16 20:11:23.469489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 20:11:23.469489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception May 16 20:11:23.469489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 20:11:23.469489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application flush_context.execute() May 16 20:11:23.469489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 20:11:23.469489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rec.execute(self) May 16 20:11:23.469489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 20:11:23.469489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 20:11:23.470375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 20:11:23.470375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 20:11:23.470375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 16 20:11:23.470375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application c = connection._execute_20( May 16 20:11:23.470375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 20:11:23.470375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 20:11:23.470375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 20:11:23.470375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 20:11:23.470375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 20:11:23.470375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 20:11:23.470375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 20:11:23.470375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 20:11:23.470375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 20:11:23.470375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 20:11:23.470375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 20:11:23.470375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception May 16 20:11:23.471367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 20:11:23.471367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 20:11:23.471367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 20:11:23.471367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 20:11:23.471367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 20:11:23.471367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application result = self._query(query) May 16 20:11:23.471367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 20:11:23.471367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application conn.query(q) May 16 20:11:23.471367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 20:11:23.471367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 20:11:23.471367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 20:11:23.471367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application result.read() May 16 20:11:23.471367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 20:11:23.471367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 20:11:23.471367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 20:11:23.471367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 20:11:23.472682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 20:11:23.472682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 20:11:23.472682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 20:11:23.472682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 20:11:23.472682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 20:11:23.472682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 16 20:11:23.472682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [parameters: {'id': 'a5bf0ddb420a4dad8847e5f9624da74c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 16 20:11:23.472682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 20:11:23.472682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:23.472682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:11:23.472682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:23.472682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:23.472682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:23.472682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:23.472682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:23.472682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:23.473649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:23.473649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:23.473649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:23.473649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:23.473649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:23.473649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:23.473649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 16 20:11:23.473649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 16 20:11:23.473649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:23.473649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:23.473649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 16 20:11:23.473649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 16 20:11:23.473649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 20:11:23.473649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 20:11:23.473649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 16 20:11:23.473649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:23.474500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 238/476] 10.222.0.71 () {60 vars in 1131 bytes} [Mon May 16 20:11:23 2022] POST /identity/v3/roles => generated 144 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:23.475947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ed1cc-8d6b-4680-a799-d88e04dc9154 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:23.545776 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c2be3-334a-4620-ada7-eb28af4ba19a None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:23.586200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb05b9-1548-4b00-b7ac-ce294e602369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:23.587324 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb05b9-1548-4b00-b7ac-ce294e602369 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:23.587819 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb05b9-1548-4b00-b7ac-ce294e602369 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:23.588350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb05b9-1548-4b00-b7ac-ce294e602369 None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:23.589353 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb05b9-1548-4b00-b7ac-ce294e602369 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:23.589876 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb05b9-1548-4b00-b7ac-ce294e602369 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:23.591535 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb05b9-1548-4b00-b7ac-ce294e602369 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:23.604585 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ed1cc-8d6b-4680-a799-d88e04dc9154 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:23.606508 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 239/477] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:23.612523 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb05b9-1548-4b00-b7ac-ce294e602369 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:23.648726 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695c615-312f-48a8-be69-184726b68a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:23.649478 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695c615-312f-48a8-be69-184726b68a0f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:23.649792 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695c615-312f-48a8-be69-184726b68a0f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:23.650073 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695c615-312f-48a8-be69-184726b68a0f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:23.674004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695c615-312f-48a8-be69-184726b68a0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:23.691321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-8695c615-312f-48a8-be69-184726b68a0f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:11:23.691321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:23.691321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:23.691321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:23.691321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:23.691321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:23.691321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:23.691321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:23.691321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:23.691321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:23.691321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:23.691321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:23.691321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:23.691321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:23.691321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:23.691321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:23.692475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:23.692475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:23.692475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:23.692475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:23.692475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:23.692475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:23.692475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:23.692475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:23.692475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:23.692475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:23.692475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:23.692475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:23.692475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:23.692475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:23.692475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:23.692475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:23.693287 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:23.693287 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:23.693287 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:23.693287 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:23.693287 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:23.693287 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:23.693287 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:23.693287 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:23.693287 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:23.693287 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:23.693287 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 20:11:23.693287 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:23.696316 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 239/478] 10.222.0.71 () {56 vars in 1114 bytes} [Mon May 16 20:11:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:23.703563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695c615-312f-48a8-be69-184726b68a0f None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:23.734637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb05b9-1548-4b00-b7ac-ce294e602369 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:23.776966 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7109e-34e3-4497-bd55-3e1586a40336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:23.777658 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7109e-34e3-4497-bd55-3e1586a40336 None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:23.777942 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7109e-34e3-4497-bd55-3e1586a40336 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:23.778217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7109e-34e3-4497-bd55-3e1586a40336 None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:23.778957 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7109e-34e3-4497-bd55-3e1586a40336 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:23.780506 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7109e-34e3-4497-bd55-3e1586a40336 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:23.806683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 240/479] 10.222.0.71 () {60 vars in 1132 bytes} [Mon May 16 20:11:23 2022] POST /identity/v3/users => generated 249 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:11:23.940349 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695c615-312f-48a8-be69-184726b68a0f None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:24.022192 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0c70e-e22b-4754-97c8-b9671b3f7870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:24.023706 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0c70e-e22b-4754-97c8-b9671b3f7870 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:24.024449 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0c70e-e22b-4754-97c8-b9671b3f7870 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:24.025132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0c70e-e22b-4754-97c8-b9671b3f7870 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:24.026835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0c70e-e22b-4754-97c8-b9671b3f7870 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:24.027643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0c70e-e22b-4754-97c8-b9671b3f7870 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:24.030776 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0c70e-e22b-4754-97c8-b9671b3f7870 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:24.059678 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 240/480] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:26.547983 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09bee3-9f48-4948-aa48-71b9c26ebbcb None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:26.550086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09bee3-9f48-4948-aa48-71b9c26ebbcb None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:26.550854 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09bee3-9f48-4948-aa48-71b9c26ebbcb None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:26.554239 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 241/481] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:26.561057 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2724e8-56a2-4318-ad63-c2e51171bdac None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:26.562505 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2724e8-56a2-4318-ad63-c2e51171bdac None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:26.563175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2724e8-56a2-4318-ad63-c2e51171bdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:26.600090 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-ea2724e8-56a2-4318-ad63-c2e51171bdac None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:26.604199 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d5a9b-5cf4-4b06-b968-ae0069ac1c2f None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:26.605097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d5a9b-5cf4-4b06-b968-ae0069ac1c2f None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:26.605817 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d5a9b-5cf4-4b06-b968-ae0069ac1c2f None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:26.608969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 242/482] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:26.610556 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-ea2724e8-56a2-4318-ad63-c2e51171bdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:26.614945 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde56814-8ea0-43f3-bb74-c29c9cc9f684 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:26.615325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde56814-8ea0-43f3-bb74-c29c9cc9f684 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:26.615621 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde56814-8ea0-43f3-bb74-c29c9cc9f684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:26.634167 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-cde56814-8ea0-43f3-bb74-c29c9cc9f684 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:26.635375 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-cde56814-8ea0-43f3-bb74-c29c9cc9f684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:26.711466 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 243/483] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:11:26.735257 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde56814-8ea0-43f3-bb74-c29c9cc9f684 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:26.782576 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 241/484] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:26.847363 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2724e8-56a2-4318-ad63-c2e51171bdac None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:26.918459 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde56814-8ea0-43f3-bb74-c29c9cc9f684 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:26.969687 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2724e8-56a2-4318-ad63-c2e51171bdac None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:26.975667 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124687c7-a97d-4f7b-8b2c-ebf9cc7316d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:26.976904 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124687c7-a97d-4f7b-8b2c-ebf9cc7316d1 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:26.977377 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124687c7-a97d-4f7b-8b2c-ebf9cc7316d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:26.977912 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124687c7-a97d-4f7b-8b2c-ebf9cc7316d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:26.999416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124687c7-a97d-4f7b-8b2c-ebf9cc7316d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:27.016557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-124687c7-a97d-4f7b-8b2c-ebf9cc7316d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:27.016557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:27.016557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:27.016557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:27.016557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:27.016557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:27.016557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:27.016557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:27.016557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:27.016557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:27.016557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:27.016557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:27.016557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:27.016557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:27.016557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:27.016557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:27.018533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:27.018533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:27.018533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:27.018533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:27.018533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:27.018533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:27.018533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:27.018533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:27.018533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:27.018533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:27.018533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:27.018533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:27.018533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:27.018533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:27.018533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:27.018533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:27.020112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:27.020112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:27.020112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:27.020112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:27.020112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:27.020112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:27.020112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:27.020112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:27.020112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:27.020112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:27.020112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:27.020112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:27.022405 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 244/485] 10.222.0.71 () {56 vars in 1102 bytes} [Mon May 16 20:11:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:11:27.022646 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e357f-e0f2-4141-a014-c2cc3e1e8649 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:27.022959 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e357f-e0f2-4141-a014-c2cc3e1e8649 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:27.023432 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e357f-e0f2-4141-a014-c2cc3e1e8649 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:27.025898 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 245/486] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:27.027027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e357f-e0f2-4141-a014-c2cc3e1e8649 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:27.029047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650340b-9680-4cd7-b020-87b615f4e192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:27.030724 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650340b-9680-4cd7-b020-87b615f4e192 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:27.031464 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650340b-9680-4cd7-b020-87b615f4e192 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:27.032110 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650340b-9680-4cd7-b020-87b615f4e192 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:27.051720 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650340b-9680-4cd7-b020-87b615f4e192 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:27.067618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-d650340b-9680-4cd7-b020-87b615f4e192 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:27.067618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:27.067618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:27.067618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:27.067618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:27.067618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:27.067618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:27.067618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:27.067618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:27.067618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:27.067618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:27.067618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:27.067618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:27.067618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:27.067618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:27.067618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:27.069249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:27.069249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:27.069249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:27.069249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:27.069249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:27.069249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:27.069249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:27.069249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:27.069249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:27.069249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:27.069249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:27.069249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:27.069249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:27.069249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:27.069249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:27.069249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:27.070628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:27.070628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:27.070628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:27.070628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:27.070628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:27.070628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:27.070628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:27.070628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:27.070628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:27.070628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:27.070628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:27.070628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:27.075085 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 242/487] 10.222.0.71 () {56 vars in 1102 bytes} [Mon May 16 20:11:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:11:27.077535 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fc011-ef42-4ab0-96a1-7f263d6f626d None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:27.078312 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fc011-ef42-4ab0-96a1-7f263d6f626d None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:27.078968 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fc011-ef42-4ab0-96a1-7f263d6f626d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:27.101311 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-713fc011-ef42-4ab0-96a1-7f263d6f626d None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:27.102442 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-713fc011-ef42-4ab0-96a1-7f263d6f626d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:27.166279 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e357f-e0f2-4141-a014-c2cc3e1e8649 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:27.181722 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 243/488] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:27.183721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851cb9a-89d9-433a-958e-817dc77cea48 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:27.184087 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851cb9a-89d9-433a-958e-817dc77cea48 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:27.184621 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851cb9a-89d9-433a-958e-817dc77cea48 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:27.186880 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 244/489] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:27.194101 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851cb9a-89d9-433a-958e-817dc77cea48 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:27.215439 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d1eaf-b417-499b-bf96-c2916f6931e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:27.216502 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d1eaf-b417-499b-bf96-c2916f6931e7 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:27.216982 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d1eaf-b417-499b-bf96-c2916f6931e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:27.217477 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d1eaf-b417-499b-bf96-c2916f6931e7 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:27.218452 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d1eaf-b417-499b-bf96-c2916f6931e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:27.218760 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d1eaf-b417-499b-bf96-c2916f6931e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:27.220183 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d1eaf-b417-499b-bf96-c2916f6931e7 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:27.234242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 246/490] 10.222.0.71 () {56 vars in 1103 bytes} [Mon May 16 20:11:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:27.234242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fe127-fa6d-454d-b5ac-fd200246d9cf None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:27.234242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fe127-fa6d-454d-b5ac-fd200246d9cf None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:27.234242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fe127-fa6d-454d-b5ac-fd200246d9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:27.253009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-733fe127-fa6d-454d-b5ac-fd200246d9cf None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:27.254411 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-733fe127-fa6d-454d-b5ac-fd200246d9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:27.324330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851cb9a-89d9-433a-958e-817dc77cea48 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:27.343699 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 247/491] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:27.344973 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fe127-fa6d-454d-b5ac-fd200246d9cf None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:27.367095 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0e90d-9c6e-479e-b865-8b3b83ac8d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:27.368735 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0e90d-9c6e-479e-b865-8b3b83ac8d2a None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:27.369171 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0e90d-9c6e-479e-b865-8b3b83ac8d2a None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:27.369578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0e90d-9c6e-479e-b865-8b3b83ac8d2a None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:27.370352 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0e90d-9c6e-479e-b865-8b3b83ac8d2a None admin] RBAC: Adding query filter params (name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:27.370657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0e90d-9c6e-479e-b865-8b3b83ac8d2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:27.372054 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0e90d-9c6e-479e-b865-8b3b83ac8d2a None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:27.381318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 245/492] 10.222.0.71 () {56 vars in 1103 bytes} [Mon May 16 20:11:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:27.382172 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0e90d-9c6e-479e-b865-8b3b83ac8d2a None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:27.482229 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fe127-fa6d-454d-b5ac-fd200246d9cf None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:27.505479 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0e90d-9c6e-479e-b865-8b3b83ac8d2a None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:27.522460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec76734-61ff-4ddc-bf53-fc0662b594d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:27.523653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec76734-61ff-4ddc-bf53-fc0662b594d3 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:27.524118 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec76734-61ff-4ddc-bf53-fc0662b594d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:27.524611 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec76734-61ff-4ddc-bf53-fc0662b594d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:27.536768 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec76734-61ff-4ddc-bf53-fc0662b594d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:27.545692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-5ec76734-61ff-4ddc-bf53-fc0662b594d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:27.545692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:27.545692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:27.545692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:27.545692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:27.545692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:27.545692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:27.545692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:27.545692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:27.545692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:27.545692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:27.545692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:27.545692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:27.545692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:27.545692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:27.545692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:27.546754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:27.546754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:27.546754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:27.546754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:27.546754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:27.546754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:27.546754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:27.546754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:27.546754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:27.546754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:27.546754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:27.546754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:27.546754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:27.546754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:27.546754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:27.546754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:27.547548 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:27.547548 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:27.547548 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:27.547548 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:27.547548 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:27.547548 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:27.547548 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:27.547548 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:27.547548 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:27.547548 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:27.547548 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:27.547548 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:27.548884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 248/493] 10.222.0.71 () {56 vars in 1102 bytes} [Mon May 16 20:11:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:27.550699 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec76734-61ff-4ddc-bf53-fc0662b594d3 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:27.553631 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ed039-26ff-47d5-ad3a-76a04b5438b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:27.555081 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ed039-26ff-47d5-ad3a-76a04b5438b1 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:27.555534 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ed039-26ff-47d5-ad3a-76a04b5438b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:27.556014 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ed039-26ff-47d5-ad3a-76a04b5438b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:27.573980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ed039-26ff-47d5-ad3a-76a04b5438b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:27.576751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ed039-26ff-47d5-ad3a-76a04b5438b1 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:27.598310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-422ed039-26ff-47d5-ad3a-76a04b5438b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:27.598310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:27.598310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:27.598310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:27.598310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:27.598310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:27.598310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:27.598310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:27.598310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:27.598310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:27.598310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:27.598310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:27.598310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:27.598310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:27.598310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:27.600047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:27.600047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:27.600047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:27.600047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:27.600047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:27.600047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:27.600047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:27.600047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:27.600047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:27.600047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:27.600047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:27.600047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:27.600047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:27.600047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:27.600047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:27.600047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:27.600047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:27.601751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:27.601751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:27.601751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:27.601751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:27.601751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 246/494] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:27.601751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ed039-26ff-47d5-ad3a-76a04b5438b1 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:27.680732 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec76734-61ff-4ddc-bf53-fc0662b594d3 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:27.718715 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd98bc8-17ae-4664-8709-58de02e0395c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:27.719513 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd98bc8-17ae-4664-8709-58de02e0395c None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:27.719788 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd98bc8-17ae-4664-8709-58de02e0395c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:27.720059 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd98bc8-17ae-4664-8709-58de02e0395c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:27.732750 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd98bc8-17ae-4664-8709-58de02e0395c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:27.746969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-6bd98bc8-17ae-4664-8709-58de02e0395c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:27.746969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:27.746969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:27.746969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:27.746969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:27.746969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:27.746969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:27.746969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:27.746969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:27.746969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:27.746969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:27.746969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:27.746969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:27.746969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:27.746969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:27.746969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:27.747941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:27.747941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:27.747941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:27.747941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:27.747941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:27.747941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:27.747941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:27.747941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:27.747941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:27.747941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:27.747941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:27.747941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:27.747941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:27.747941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:27.747941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:27.747941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:27.748797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:27.748797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:27.748797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:27.748797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:27.748797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:27.748797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:27.748797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:27.748797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:27.748797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:27.748797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:27.748797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:27.748797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:27.749415 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 249/495] 10.222.0.71 () {56 vars in 1102 bytes} [Mon May 16 20:11:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:27.750756 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6189e-7cf8-42e4-a212-5641dcd8446d None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:27.751116 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6189e-7cf8-42e4-a212-5641dcd8446d None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:27.751458 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6189e-7cf8-42e4-a212-5641dcd8446d None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:27.753319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 250/496] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:27.754858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6189e-7cf8-42e4-a212-5641dcd8446d None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:27.767567 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ed039-26ff-47d5-ad3a-76a04b5438b1 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:27.804170 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc2c70-a10e-46bb-8be5-75961344e732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:27.805044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc2c70-a10e-46bb-8be5-75961344e732 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:27.805351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc2c70-a10e-46bb-8be5-75961344e732 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:27.805659 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc2c70-a10e-46bb-8be5-75961344e732 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:27.818288 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc2c70-a10e-46bb-8be5-75961344e732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:27.819762 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc2c70-a10e-46bb-8be5-75961344e732 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:27.838672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-a3bc2c70-a10e-46bb-8be5-75961344e732 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:27.838672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:27.838672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:27.838672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:27.838672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:27.838672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:27.838672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:27.838672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:27.838672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:27.838672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:27.838672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:27.838672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:27.838672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:27.838672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:27.838672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:27.839801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:27.839801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:27.839801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:27.839801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:27.839801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:27.839801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:27.839801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:27.839801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:27.839801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:27.839801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:27.839801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:27.839801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:27.839801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:27.839801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:27.839801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:27.839801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:27.839801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:27.841373 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:27.841373 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:27.841373 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:27.841373 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:27.841373 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 247/497] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:27.841373 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc2c70-a10e-46bb-8be5-75961344e732 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:27.896900 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6189e-7cf8-42e4-a212-5641dcd8446d None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:27.953033 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc2c70-a10e-46bb-8be5-75961344e732 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:27.955828 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52384095-e833-4339-814c-c382feeb056b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:27.957413 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52384095-e833-4339-814c-c382feeb056b None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:27.957874 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52384095-e833-4339-814c-c382feeb056b None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:27.958345 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52384095-e833-4339-814c-c382feeb056b None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:27.959348 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52384095-e833-4339-814c-c382feeb056b None admin] RBAC: Adding query filter params (name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:27.959860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52384095-e833-4339-814c-c382feeb056b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:27.962300 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52384095-e833-4339-814c-c382feeb056b None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:27.975525 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 251/498] 10.222.0.71 () {56 vars in 1103 bytes} [Mon May 16 20:11:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:27.977171 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52384095-e833-4339-814c-c382feeb056b None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:27.999936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af713a-8285-479d-b6d6-ea3c6199b3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:28.000869 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af713a-8285-479d-b6d6-ea3c6199b3df None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:28.001151 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af713a-8285-479d-b6d6-ea3c6199b3df None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:28.001427 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af713a-8285-479d-b6d6-ea3c6199b3df None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:28.002740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af713a-8285-479d-b6d6-ea3c6199b3df None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:28.003050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af713a-8285-479d-b6d6-ea3c6199b3df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:28.004555 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af713a-8285-479d-b6d6-ea3c6199b3df None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:28.024226 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 248/499] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:28.025616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232ffa1-4861-4d56-9bcf-03eacc71eab2 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:28.026235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232ffa1-4861-4d56-9bcf-03eacc71eab2 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:28.026235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232ffa1-4861-4d56-9bcf-03eacc71eab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:28.050933 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-f232ffa1-4861-4d56-9bcf-03eacc71eab2 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:28.052683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f232ffa1-4861-4d56-9bcf-03eacc71eab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:28.099906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52384095-e833-4339-814c-c382feeb056b None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:28.130759 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 249/500] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:28.132343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232ffa1-4861-4d56-9bcf-03eacc71eab2 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:28.151025 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbae0e-0ee9-47dc-a400-0ce06107a39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:28.152422 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbae0e-0ee9-47dc-a400-0ce06107a39e None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:28.153126 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbae0e-0ee9-47dc-a400-0ce06107a39e None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:28.153836 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbae0e-0ee9-47dc-a400-0ce06107a39e None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:28.155267 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbae0e-0ee9-47dc-a400-0ce06107a39e None admin] RBAC: Adding query filter params (name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:28.155775 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbae0e-0ee9-47dc-a400-0ce06107a39e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:28.158119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbae0e-0ee9-47dc-a400-0ce06107a39e None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:28.169696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 252/501] 10.222.0.71 () {56 vars in 1103 bytes} [Mon May 16 20:11:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:28.171213 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbae0e-0ee9-47dc-a400-0ce06107a39e None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:28.252242 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232ffa1-4861-4d56-9bcf-03eacc71eab2 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:28.286486 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6761ce-850f-4c6e-ba26-7891da88c8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:28.287157 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6761ce-850f-4c6e-ba26-7891da88c8f9 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:28.287434 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6761ce-850f-4c6e-ba26-7891da88c8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:28.287705 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6761ce-850f-4c6e-ba26-7891da88c8f9 None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:28.288461 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6761ce-850f-4c6e-ba26-7891da88c8f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:28.288766 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6761ce-850f-4c6e-ba26-7891da88c8f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:28.290147 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6761ce-850f-4c6e-ba26-7891da88c8f9 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:28.302445 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 250/502] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:28.303315 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6761ce-850f-4c6e-ba26-7891da88c8f9 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:28.313479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbae0e-0ee9-47dc-a400-0ce06107a39e None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:28.358170 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817009ea-1c45-419a-8033-ea07d44a0f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:28.359409 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817009ea-1c45-419a-8033-ea07d44a0f62 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:28.359852 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817009ea-1c45-419a-8033-ea07d44a0f62 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:28.360324 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817009ea-1c45-419a-8033-ea07d44a0f62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:28.374162 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817009ea-1c45-419a-8033-ea07d44a0f62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:28.375738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817009ea-1c45-419a-8033-ea07d44a0f62 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:28.398846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-817009ea-1c45-419a-8033-ea07d44a0f62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:28.398846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:28.398846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:28.398846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:28.398846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:28.398846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:28.398846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:28.398846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:28.398846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:28.398846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:28.398846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:28.398846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:28.398846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:28.398846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:28.398846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:28.404200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:28.404200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:28.404200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:28.404200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:28.404200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:28.404200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:28.404200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:28.404200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:28.404200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:28.404200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:28.404200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:28.404200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:28.404200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:28.404200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:28.404200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:28.404200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:28.404200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:28.405092 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:28.405092 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:28.405092 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:28.405092 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:28.405092 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 253/503] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:28.405092 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817009ea-1c45-419a-8033-ea07d44a0f62 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:28.428482 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6761ce-850f-4c6e-ba26-7891da88c8f9 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:28.470844 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58afba-3ff2-469d-a163-78988ea763f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:28.472271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58afba-3ff2-469d-a163-78988ea763f5 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:28.472728 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58afba-3ff2-469d-a163-78988ea763f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:28.473181 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58afba-3ff2-469d-a163-78988ea763f5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:28.482160 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58afba-3ff2-469d-a163-78988ea763f5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:28.483699 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58afba-3ff2-469d-a163-78988ea763f5 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:28.501212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-4f58afba-3ff2-469d-a163-78988ea763f5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 20:11:28.501212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:28.501212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:28.501212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:28.501212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:28.501212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:28.501212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:28.501212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:28.501212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:28.501212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:28.501212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:28.501212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:28.501212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:11:28.501212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:11:28.501212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:11:28.501212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:11:28.503627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:28.503627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:28.503627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:11:28.503627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:28.503627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:11:28.503627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:28.503627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:28.503627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:28.503627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:28.503627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:28.503627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:28.503627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:28.503627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:28.503627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:28.503627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:28.503627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:28.503627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:28.503627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:28.505336 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:28.505336 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:28.505336 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:11:28.505336 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:11:28.505336 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:11:28.505336 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:11:28.505336 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:11:28.505336 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:11:28.505336 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 20:11:28.505336 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:28.505336 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 251/504] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:11:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:28.505336 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58afba-3ff2-469d-a163-78988ea763f5 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:28.533269 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817009ea-1c45-419a-8033-ea07d44a0f62 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:28.586794 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee699be4-0d3e-4a6e-8cf7-466f31d40429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:28.588037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee699be4-0d3e-4a6e-8cf7-466f31d40429 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:28.588533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee699be4-0d3e-4a6e-8cf7-466f31d40429 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:28.588931 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee699be4-0d3e-4a6e-8cf7-466f31d40429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:28.607002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee699be4-0d3e-4a6e-8cf7-466f31d40429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:28.609603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee699be4-0d3e-4a6e-8cf7-466f31d40429 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:28.638925 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-ee699be4-0d3e-4a6e-8cf7-466f31d40429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:28.638925 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:28.638925 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:28.638925 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:28.638925 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:28.638925 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:28.638925 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:28.638925 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:28.638925 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:28.638925 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:28.638925 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:28.638925 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:28.638925 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:28.638925 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:28.638925 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:28.640635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:28.640635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:28.640635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:28.640635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:28.640635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:28.640635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:28.640635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:28.640635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:28.640635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:28.640635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:28.640635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:28.640635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:28.640635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:28.640635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:28.640635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:28.640635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:28.640635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:28.641878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:28.641878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:28.641878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:28.641878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:28.641878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 254/505] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:28.642369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee699be4-0d3e-4a6e-8cf7-466f31d40429 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:28.657771 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58afba-3ff2-469d-a163-78988ea763f5 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:28.717013 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f04a8-8f25-4774-8584-8d2fa57cb6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:28.718354 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f04a8-8f25-4774-8584-8d2fa57cb6a9 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:28.718844 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f04a8-8f25-4774-8584-8d2fa57cb6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:28.719331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f04a8-8f25-4774-8584-8d2fa57cb6a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:28.741646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f04a8-8f25-4774-8584-8d2fa57cb6a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:28.744408 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f04a8-8f25-4774-8584-8d2fa57cb6a9 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:28.778268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee699be4-0d3e-4a6e-8cf7-466f31d40429 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:28.782575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-5c6f04a8-8f25-4774-8584-8d2fa57cb6a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:28.782575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:28.782575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:28.782575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:28.782575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:28.782575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:28.782575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:28.782575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:28.782575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:28.782575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:28.782575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:28.782575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:28.782575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:28.782575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:28.782575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:28.783640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:28.783640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:28.783640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:28.783640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:28.783640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:28.783640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:28.783640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:28.783640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:28.783640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:28.783640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:28.783640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:28.783640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:28.783640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:28.783640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:28.783640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:28.783640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:28.783640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:28.784998 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:28.784998 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:28.784998 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:28.784998 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:28.784998 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 252/506] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:28.786415 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f04a8-8f25-4774-8584-8d2fa57cb6a9 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:28.815948 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2e5d5-3ca9-4fcb-9af6-cea4831fa44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:28.816928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2e5d5-3ca9-4fcb-9af6-cea4831fa44c None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:28.817214 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2e5d5-3ca9-4fcb-9af6-cea4831fa44c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:28.817489 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2e5d5-3ca9-4fcb-9af6-cea4831fa44c None admin] PATH_INFO: `/v3/users/nova` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:28.825861 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2e5d5-3ca9-4fcb-9af6-cea4831fa44c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:28.827358 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2e5d5-3ca9-4fcb-9af6-cea4831fa44c None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:28.844892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-94b2e5d5-3ca9-4fcb-9af6-cea4831fa44c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 20:11:28.844892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:28.844892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:28.844892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:28.844892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:28.844892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:28.844892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:28.844892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:28.844892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:28.844892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:28.844892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:28.844892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:28.844892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:11:28.844892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:11:28.844892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:11:28.844892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:11:28.846329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:28.846329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:28.846329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:11:28.846329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:28.846329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:11:28.846329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:28.846329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:28.846329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:28.846329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:28.846329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:28.846329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:28.846329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:28.846329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:28.846329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:28.846329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:28.846329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:28.846329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:28.846329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:28.848055 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:28.848055 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:28.848055 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:11:28.848055 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:11:28.848055 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:11:28.848055 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:11:28.848055 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:11:28.848055 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:11:28.848055 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 20:11:28.848055 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:28.848055 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 255/507] 10.222.0.71 () {56 vars in 1093 bytes} [Mon May 16 20:11:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:28.848055 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2e5d5-3ca9-4fcb-9af6-cea4831fa44c None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:28.973363 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f04a8-8f25-4774-8584-8d2fa57cb6a9 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:29.006023 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2e5d5-3ca9-4fcb-9af6-cea4831fa44c None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:29.016005 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78f2b2-5d52-42e2-97a5-0870efb4a05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:29.016723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78f2b2-5d52-42e2-97a5-0870efb4a05e None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:29.017005 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78f2b2-5d52-42e2-97a5-0870efb4a05e None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:29.017278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78f2b2-5d52-42e2-97a5-0870efb4a05e None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:29.018058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78f2b2-5d52-42e2-97a5-0870efb4a05e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:29.018363 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78f2b2-5d52-42e2-97a5-0870efb4a05e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:29.020025 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78f2b2-5d52-42e2-97a5-0870efb4a05e None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:29.033307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 253/508] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:29.037062 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78f2b2-5d52-42e2-97a5-0870efb4a05e None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:29.059328 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc1b64-cddb-43f3-8247-0fa6ee09f60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:29.060400 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc1b64-cddb-43f3-8247-0fa6ee09f60b None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:29.060861 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc1b64-cddb-43f3-8247-0fa6ee09f60b None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:29.061280 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc1b64-cddb-43f3-8247-0fa6ee09f60b None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:29.062780 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc1b64-cddb-43f3-8247-0fa6ee09f60b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:29.063283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc1b64-cddb-43f3-8247-0fa6ee09f60b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:29.065845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc1b64-cddb-43f3-8247-0fa6ee09f60b None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:29.138527 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 256/509] 10.222.0.71 () {56 vars in 1137 bytes} [Mon May 16 20:11:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:29.138527 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc1b64-cddb-43f3-8247-0fa6ee09f60b None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:29.217948 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78f2b2-5d52-42e2-97a5-0870efb4a05e None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:29.271235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e85c9-450e-42ab-b0a8-7e3e02661862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:29.272383 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e85c9-450e-42ab-b0a8-7e3e02661862 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:29.272904 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e85c9-450e-42ab-b0a8-7e3e02661862 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:29.273459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e85c9-450e-42ab-b0a8-7e3e02661862 None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:29.275093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e85c9-450e-42ab-b0a8-7e3e02661862 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:29.275702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e85c9-450e-42ab-b0a8-7e3e02661862 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:29.277818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e85c9-450e-42ab-b0a8-7e3e02661862 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:29.292875 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 254/510] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:29.294018 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e85c9-450e-42ab-b0a8-7e3e02661862 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:29.308649 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc1b64-cddb-43f3-8247-0fa6ee09f60b None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:29.362470 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591545a2-a9bd-4c2a-b64c-414131f2f356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:29.363540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591545a2-a9bd-4c2a-b64c-414131f2f356 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:29.363985 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591545a2-a9bd-4c2a-b64c-414131f2f356 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:29.364416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591545a2-a9bd-4c2a-b64c-414131f2f356 None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:29.365419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591545a2-a9bd-4c2a-b64c-414131f2f356 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:29.365875 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591545a2-a9bd-4c2a-b64c-414131f2f356 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:29.367519 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591545a2-a9bd-4c2a-b64c-414131f2f356 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:29.386126 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 257/511] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:29.387452 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591545a2-a9bd-4c2a-b64c-414131f2f356 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:29.441745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e85c9-450e-42ab-b0a8-7e3e02661862 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:29.507351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccdda4-bede-42c6-ba53-b14e35f03224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:29.508585 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccdda4-bede-42c6-ba53-b14e35f03224 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:29.509097 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccdda4-bede-42c6-ba53-b14e35f03224 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:29.509582 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccdda4-bede-42c6-ba53-b14e35f03224 None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:29.511052 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccdda4-bede-42c6-ba53-b14e35f03224 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:29.511616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccdda4-bede-42c6-ba53-b14e35f03224 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:29.514417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccdda4-bede-42c6-ba53-b14e35f03224 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:29.560684 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591545a2-a9bd-4c2a-b64c-414131f2f356 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:29.585631 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 255/512] 10.222.0.71 () {56 vars in 1133 bytes} [Mon May 16 20:11:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:29.587274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccdda4-bede-42c6-ba53-b14e35f03224 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:29.608953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f1440-2a75-4853-9780-e05841acedd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:29.610206 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f1440-2a75-4853-9780-e05841acedd2 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:29.610659 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f1440-2a75-4853-9780-e05841acedd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:29.611120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f1440-2a75-4853-9780-e05841acedd2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:29.621127 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f1440-2a75-4853-9780-e05841acedd2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:29.623114 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f1440-2a75-4853-9780-e05841acedd2 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:29.640856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-4a2f1440-2a75-4853-9780-e05841acedd2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 20:11:29.640856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:29.640856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:29.640856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:29.640856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:29.640856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:29.640856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:29.640856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:29.640856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:29.640856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:29.640856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:29.640856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:29.640856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:11:29.640856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:11:29.640856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:11:29.640856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:11:29.641835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:29.641835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:29.641835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:11:29.641835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:29.641835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:11:29.641835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:29.641835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:29.641835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:29.641835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:29.641835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:29.641835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:29.641835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:29.641835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:29.641835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:29.641835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:29.641835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:29.641835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:29.641835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:29.642711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:29.642711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:29.642711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:11:29.642711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:11:29.642711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:11:29.642711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:11:29.642711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:11:29.642711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:11:29.642711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 20:11:29.642711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:29.642711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 258/513] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:11:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:29.643441 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f1440-2a75-4853-9780-e05841acedd2 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:29.730535 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccdda4-bede-42c6-ba53-b14e35f03224 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:29.777342 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece089d-b340-411b-9fe3-6db44ee107e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:29.778191 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece089d-b340-411b-9fe3-6db44ee107e8 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:29.778555 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece089d-b340-411b-9fe3-6db44ee107e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:29.779021 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece089d-b340-411b-9fe3-6db44ee107e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:29.781909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f1440-2a75-4853-9780-e05841acedd2 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:29.831962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58b516-7921-4092-865c-1debc8f36613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:29.833073 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58b516-7921-4092-865c-1debc8f36613 None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:29.833502 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58b516-7921-4092-865c-1debc8f36613 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:29.833928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58b516-7921-4092-865c-1debc8f36613 None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:29.835142 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58b516-7921-4092-865c-1debc8f36613 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:29.837678 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58b516-7921-4092-865c-1debc8f36613 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:29.863547 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 259/514] 10.222.0.71 () {60 vars in 1132 bytes} [Mon May 16 20:11:29 2022] POST /identity/v3/users => generated 247 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:11:29.864137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58b516-7921-4092-865c-1debc8f36613 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:29.871290 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece089d-b340-411b-9fe3-6db44ee107e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:29.874310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece089d-b340-411b-9fe3-6db44ee107e8 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:30.001583 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58b516-7921-4092-865c-1debc8f36613 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:30.041930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826922d-3564-4046-808c-8ade64d67c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:30.043176 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826922d-3564-4046-808c-8ade64d67c7e None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:30.043683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826922d-3564-4046-808c-8ade64d67c7e None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:30.044194 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826922d-3564-4046-808c-8ade64d67c7e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:30.045068 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 256/515] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:11:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:11:30.046415 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece089d-b340-411b-9fe3-6db44ee107e8 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:30.059298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826922d-3564-4046-808c-8ade64d67c7e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:30.061300 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826922d-3564-4046-808c-8ade64d67c7e None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:30.077883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-8826922d-3564-4046-808c-8ade64d67c7e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 20:11:30.077883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:30.077883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:30.077883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:30.077883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:30.077883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:30.077883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:30.077883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:30.077883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:30.077883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:30.077883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:30.077883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:30.077883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:11:30.077883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:11:30.077883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:11:30.077883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:11:30.078999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:30.078999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:30.078999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:11:30.078999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:30.078999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:11:30.078999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:30.078999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:30.078999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:30.078999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:30.078999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:30.078999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:30.078999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:30.078999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:30.078999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:30.078999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:30.078999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:30.078999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:30.078999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:30.079877 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:30.079877 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:30.079877 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:11:30.079877 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:11:30.079877 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:11:30.079877 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:11:30.079877 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:11:30.079877 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:11:30.079877 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 20:11:30.079877 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:30.084290 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 260/516] 10.222.0.71 () {56 vars in 1102 bytes} [Mon May 16 20:11:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:30.085202 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826922d-3564-4046-808c-8ade64d67c7e None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:30.182378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece089d-b340-411b-9fe3-6db44ee107e8 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:30.216828 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826922d-3564-4046-808c-8ade64d67c7e None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:30.251273 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb21154-1549-4d4f-9095-169ba20fa5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:30.252996 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb21154-1549-4d4f-9095-169ba20fa5a7 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:30.253499 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb21154-1549-4d4f-9095-169ba20fa5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:30.253971 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb21154-1549-4d4f-9095-169ba20fa5a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:30.279648 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfaea2-c58c-45ea-90cf-6af3c649d06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:30.280878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfaea2-c58c-45ea-90cf-6af3c649d06b None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:30.281414 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfaea2-c58c-45ea-90cf-6af3c649d06b None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:30.281863 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfaea2-c58c-45ea-90cf-6af3c649d06b None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:30.283781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dfaea2-c58c-45ea-90cf-6af3c649d06b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:30.284235 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dfaea2-c58c-45ea-90cf-6af3c649d06b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:30.286941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dfaea2-c58c-45ea-90cf-6af3c649d06b None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:30.313399 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 261/517] 10.222.0.71 () {56 vars in 1137 bytes} [Mon May 16 20:11:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:30.314356 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfaea2-c58c-45ea-90cf-6af3c649d06b None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:30.356576 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb21154-1549-4d4f-9095-169ba20fa5a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:30.358383 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb21154-1549-4d4f-9095-169ba20fa5a7 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:30.471944 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfaea2-c58c-45ea-90cf-6af3c649d06b None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:30.486300 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 257/518] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:11:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:11:30.488570 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb21154-1549-4d4f-9095-169ba20fa5a7 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:30.532780 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f3ccb-9ab5-43f7-9a8f-b8d3ca3025d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:30.534824 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f3ccb-9ab5-43f7-9a8f-b8d3ca3025d7 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:30.535333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f3ccb-9ab5-43f7-9a8f-b8d3ca3025d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:30.535826 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f3ccb-9ab5-43f7-9a8f-b8d3ca3025d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:30.555731 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f3ccb-9ab5-43f7-9a8f-b8d3ca3025d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:30.557837 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f3ccb-9ab5-43f7-9a8f-b8d3ca3025d7 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:30.588832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-173f3ccb-9ab5-43f7-9a8f-b8d3ca3025d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:30.588832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:30.588832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:30.588832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:30.588832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:30.588832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:30.588832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:30.588832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:30.588832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:30.588832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:30.588832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:30.588832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:30.588832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:30.588832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:30.588832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:30.589812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:30.589812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:30.589812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:30.589812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:30.589812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:30.589812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:30.589812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:30.589812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:30.589812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:30.589812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:30.589812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:30.589812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:30.589812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:30.589812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:30.589812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:30.589812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:30.589812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:30.590641 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:30.590641 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:30.590641 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:30.590641 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:30.592340 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 262/519] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:30.593482 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f3ccb-9ab5-43f7-9a8f-b8d3ca3025d7 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:30.622773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb21154-1549-4d4f-9095-169ba20fa5a7 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:30.683231 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43d4b4-d5c4-491c-a12c-6b959d3c4181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:30.683231 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43d4b4-d5c4-491c-a12c-6b959d3c4181 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:30.683231 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43d4b4-d5c4-491c-a12c-6b959d3c4181 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:30.684020 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43d4b4-d5c4-491c-a12c-6b959d3c4181 None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:30.685061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43d4b4-d5c4-491c-a12c-6b959d3c4181 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:30.685614 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43d4b4-d5c4-491c-a12c-6b959d3c4181 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:30.688302 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43d4b4-d5c4-491c-a12c-6b959d3c4181 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:30.718287 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 258/520] 10.222.0.71 () {56 vars in 1139 bytes} [Mon May 16 20:11:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:30.718488 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f3ccb-9ab5-43f7-9a8f-b8d3ca3025d7 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:30.718927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43d4b4-d5c4-491c-a12c-6b959d3c4181 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:30.790678 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b8318-7b17-4d77-8786-e3ad94208096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:30.791828 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b8318-7b17-4d77-8786-e3ad94208096 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:30.792373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b8318-7b17-4d77-8786-e3ad94208096 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:30.793393 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b8318-7b17-4d77-8786-e3ad94208096 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:30.871643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43d4b4-d5c4-491c-a12c-6b959d3c4181 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:30.889689 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b8318-7b17-4d77-8786-e3ad94208096 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:30.891847 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b8318-7b17-4d77-8786-e3ad94208096 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:30.920679 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a47203-90e8-4b6e-bcef-b0159248a964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:30.921390 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a47203-90e8-4b6e-bcef-b0159248a964 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:30.921672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a47203-90e8-4b6e-bcef-b0159248a964 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:30.921947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a47203-90e8-4b6e-bcef-b0159248a964 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:30.938885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a47203-90e8-4b6e-bcef-b0159248a964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:30.942339 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a47203-90e8-4b6e-bcef-b0159248a964 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:30.973463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-a4a47203-90e8-4b6e-bcef-b0159248a964 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:30.973463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:30.973463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:30.973463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:30.973463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:30.973463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:30.973463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:30.973463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:30.973463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:30.973463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:30.973463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:30.973463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:30.973463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:30.973463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:30.973463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:30.975021 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:30.975021 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:30.975021 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:30.975021 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:30.975021 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:30.975021 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:30.975021 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:30.975021 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:30.975021 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:30.975021 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:30.975021 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:30.975021 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:30.975021 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:30.975021 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:30.975021 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:30.975021 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:30.975021 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:30.975857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:30.975857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:30.975857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:30.975857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:30.975857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 259/521] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:30.977505 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a47203-90e8-4b6e-bcef-b0159248a964 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:31.042425 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 263/522] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:11:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:11:31.042425 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b8318-7b17-4d77-8786-e3ad94208096 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:31.123684 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a47203-90e8-4b6e-bcef-b0159248a964 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:31.162798 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b8318-7b17-4d77-8786-e3ad94208096 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:31.167380 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c69f3-b8cc-4fa4-ae9e-e5b83562dd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:31.168044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c69f3-b8cc-4fa4-ae9e-e5b83562dd1b None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:31.168369 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c69f3-b8cc-4fa4-ae9e-e5b83562dd1b None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:31.168654 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c69f3-b8cc-4fa4-ae9e-e5b83562dd1b None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:31.169390 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c69f3-b8cc-4fa4-ae9e-e5b83562dd1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:31.169698 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c69f3-b8cc-4fa4-ae9e-e5b83562dd1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:31.171120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c69f3-b8cc-4fa4-ae9e-e5b83562dd1b None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:31.189898 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 260/523] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:31.191217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c69f3-b8cc-4fa4-ae9e-e5b83562dd1b None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:31.215141 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bca33d-4241-4000-bf0c-94a0735cb12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:31.216005 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bca33d-4241-4000-bf0c-94a0735cb12f None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:31.216451 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bca33d-4241-4000-bf0c-94a0735cb12f None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:31.216858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bca33d-4241-4000-bf0c-94a0735cb12f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:31.315348 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c69f3-b8cc-4fa4-ae9e-e5b83562dd1b None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:31.336107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bca33d-4241-4000-bf0c-94a0735cb12f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:31.338923 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bca33d-4241-4000-bf0c-94a0735cb12f None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:31.357718 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644baa3-c3d8-45eb-bd26-a0ab0bf4f81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:31.358393 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644baa3-c3d8-45eb-bd26-a0ab0bf4f81d None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:31.358673 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644baa3-c3d8-45eb-bd26-a0ab0bf4f81d None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:31.358947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644baa3-c3d8-45eb-bd26-a0ab0bf4f81d None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:31.359674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644baa3-c3d8-45eb-bd26-a0ab0bf4f81d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:31.359979 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644baa3-c3d8-45eb-bd26-a0ab0bf4f81d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:31.361406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644baa3-c3d8-45eb-bd26-a0ab0bf4f81d None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:31.373968 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 261/524] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:31.375190 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644baa3-c3d8-45eb-bd26-a0ab0bf4f81d None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:31.478830 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 264/525] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:11:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:11:31.480766 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bca33d-4241-4000-bf0c-94a0735cb12f None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:31.489278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644baa3-c3d8-45eb-bd26-a0ab0bf4f81d None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:31.525950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbf42c-b124-431c-b406-28787499a398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:31.526789 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbf42c-b124-431c-b406-28787499a398 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:31.527071 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbf42c-b124-431c-b406-28787499a398 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:31.527344 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbf42c-b124-431c-b406-28787499a398 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:31.539418 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbf42c-b124-431c-b406-28787499a398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:31.540910 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbf42c-b124-431c-b406-28787499a398 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:31.559372 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-8ebbf42c-b124-431c-b406-28787499a398 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:31.559372 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:31.559372 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:31.559372 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:31.559372 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:31.559372 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:31.559372 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:31.559372 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:31.559372 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:31.559372 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:31.559372 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:31.559372 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:31.559372 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:31.559372 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:31.559372 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:31.561132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:31.561132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:31.561132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:31.561132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:31.561132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:31.561132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:31.561132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:31.561132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:31.561132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:31.561132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:31.561132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:31.561132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:31.561132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:31.561132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:31.561132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:31.561132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:31.561132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:31.562900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:31.562900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:31.562900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:31.562900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:31.567253 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 262/526] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:31.567253 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbf42c-b124-431c-b406-28787499a398 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:31.639862 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bca33d-4241-4000-bf0c-94a0735cb12f None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:31.693440 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec19bb5-d143-4d7d-aa06-0559f14ed9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:31.694973 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec19bb5-d143-4d7d-aa06-0559f14ed9e9 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:31.694973 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec19bb5-d143-4d7d-aa06-0559f14ed9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:31.695387 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec19bb5-d143-4d7d-aa06-0559f14ed9e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:31.703980 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec19bb5-d143-4d7d-aa06-0559f14ed9e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:31.706502 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec19bb5-d143-4d7d-aa06-0559f14ed9e9 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:31.715536 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbf42c-b124-431c-b406-28787499a398 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:31.724131 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-7ec19bb5-d143-4d7d-aa06-0559f14ed9e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:31.724131 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:31.724131 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:31.724131 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:31.724131 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:31.724131 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:31.724131 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:31.724131 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:31.724131 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:31.724131 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:31.724131 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:31.724131 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:31.724131 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:11:31.724131 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:11:31.724131 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:11:31.725423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:11:31.725423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:31.725423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:31.725423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:31.725423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:31.725423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:31.725423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:31.725423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:31.725423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:31.725423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:31.725423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:31.725423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:31.725423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:31.725423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:31.725423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:31.725423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:31.725423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:31.726565 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:11:31.726565 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:11:31.726565 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:11:31.726565 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:11:31.726565 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:11:31.726565 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:11:31.726565 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:31.726565 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:31.726565 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 265/527] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:31.728911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec19bb5-d143-4d7d-aa06-0559f14ed9e9 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:31.769349 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495768eb-cc23-4d81-8c90-0e807b4fb805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:31.769713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495768eb-cc23-4d81-8c90-0e807b4fb805 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:31.769865 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495768eb-cc23-4d81-8c90-0e807b4fb805 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:31.770154 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495768eb-cc23-4d81-8c90-0e807b4fb805 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:31.777995 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495768eb-cc23-4d81-8c90-0e807b4fb805 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:31.779467 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495768eb-cc23-4d81-8c90-0e807b4fb805 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:31.795439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-495768eb-cc23-4d81-8c90-0e807b4fb805 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:31.795439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:31.795439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:31.795439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:31.795439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:31.795439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:31.795439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:31.795439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:31.795439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:31.795439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:31.795439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:31.795439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:31.795439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:11:31.795439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:11:31.795439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:11:31.804628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:11:31.804628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:31.804628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:31.804628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:31.804628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:31.804628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:31.804628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:31.804628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:31.804628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:31.804628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:31.804628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:31.804628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:31.804628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:31.804628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:31.804628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:31.804628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:31.804628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:31.805469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:11:31.805469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:11:31.805469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:11:31.805469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:11:31.805469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:11:31.805469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:11:31.805469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:31.805469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:31.805469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 263/528] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:31.805469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495768eb-cc23-4d81-8c90-0e807b4fb805 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:31.899457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec19bb5-d143-4d7d-aa06-0559f14ed9e9 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:31.955054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a7be5-0ae7-4f05-841e-ab37b4f4884e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:31.957111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a7be5-0ae7-4f05-841e-ab37b4f4884e None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:31.957471 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a7be5-0ae7-4f05-841e-ab37b4f4884e None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:31.957757 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a7be5-0ae7-4f05-841e-ab37b4f4884e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:31.965828 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495768eb-cc23-4d81-8c90-0e807b4fb805 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:31.977033 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a7be5-0ae7-4f05-841e-ab37b4f4884e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:31.980542 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a7be5-0ae7-4f05-841e-ab37b4f4884e None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:32.005762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-319a7be5-0ae7-4f05-841e-ab37b4f4884e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:32.005762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:32.005762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:32.005762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:32.005762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:32.005762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:32.005762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:32.005762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:32.005762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:32.005762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:32.005762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:32.005762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:32.005762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:32.005762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:32.005762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:32.007424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:32.007424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:32.007424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:32.007424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:32.007424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:32.007424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:32.007424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:32.007424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:32.007424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:32.007424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:32.007424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:32.007424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:32.007424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:32.007424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:32.007424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:32.007424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:32.007424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:32.009665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:32.009665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:32.009665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:32.009665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:32.009665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 266/529] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:32.009665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a7be5-0ae7-4f05-841e-ab37b4f4884e None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:32.014249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe174f5-3fbe-41a1-b97f-05e392fe0016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:32.014865 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe174f5-3fbe-41a1-b97f-05e392fe0016 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:32.015416 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe174f5-3fbe-41a1-b97f-05e392fe0016 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:32.015676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe174f5-3fbe-41a1-b97f-05e392fe0016 None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:32.016485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe174f5-3fbe-41a1-b97f-05e392fe0016 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:32.016735 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe174f5-3fbe-41a1-b97f-05e392fe0016 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:32.018954 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe174f5-3fbe-41a1-b97f-05e392fe0016 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:32.039523 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 264/530] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:32.039523 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe174f5-3fbe-41a1-b97f-05e392fe0016 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:32.155102 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a7be5-0ae7-4f05-841e-ab37b4f4884e None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:32.191939 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe174f5-3fbe-41a1-b97f-05e392fe0016 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:32.198633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925a5b5-1a8c-4fd4-9cf4-785f4ecb99d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:32.199711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925a5b5-1a8c-4fd4-9cf4-785f4ecb99d0 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:32.200207 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925a5b5-1a8c-4fd4-9cf4-785f4ecb99d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:32.200653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925a5b5-1a8c-4fd4-9cf4-785f4ecb99d0 None admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:32.202134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925a5b5-1a8c-4fd4-9cf4-785f4ecb99d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:32.202682 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925a5b5-1a8c-4fd4-9cf4-785f4ecb99d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:32.206147 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925a5b5-1a8c-4fd4-9cf4-785f4ecb99d0 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:32.240255 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 267/531] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:11:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:32.241188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925a5b5-1a8c-4fd4-9cf4-785f4ecb99d0 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:32.246831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152d5b0-ac68-4065-8b5e-142f9a966798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:32.248120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152d5b0-ac68-4065-8b5e-142f9a966798 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:32.248813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152d5b0-ac68-4065-8b5e-142f9a966798 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:32.249440 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152d5b0-ac68-4065-8b5e-142f9a966798 None admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:32.250956 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152d5b0-ac68-4065-8b5e-142f9a966798 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:32.251588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152d5b0-ac68-4065-8b5e-142f9a966798 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:32.254677 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152d5b0-ac68-4065-8b5e-142f9a966798 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:32.294028 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 265/532] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:11:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:32.295692 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152d5b0-ac68-4065-8b5e-142f9a966798 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:32.380613 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925a5b5-1a8c-4fd4-9cf4-785f4ecb99d0 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:32.423588 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75f0db-00a0-4c86-a274-22a7f58e2d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:32.424762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75f0db-00a0-4c86-a274-22a7f58e2d69 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:32.425273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75f0db-00a0-4c86-a274-22a7f58e2d69 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:32.425763 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75f0db-00a0-4c86-a274-22a7f58e2d69 None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:32.427117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75f0db-00a0-4c86-a274-22a7f58e2d69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:32.427666 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75f0db-00a0-4c86-a274-22a7f58e2d69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:32.433327 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75f0db-00a0-4c86-a274-22a7f58e2d69 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:32.437497 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152d5b0-ac68-4065-8b5e-142f9a966798 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:32.448140 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 268/533] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:32.449374 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75f0db-00a0-4c86-a274-22a7f58e2d69 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:32.475256 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd02799-ebaf-474b-92ce-507cbf78bf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:32.476257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd02799-ebaf-474b-92ce-507cbf78bf65 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:32.476645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd02799-ebaf-474b-92ce-507cbf78bf65 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:32.476994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd02799-ebaf-474b-92ce-507cbf78bf65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:32.484888 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd02799-ebaf-474b-92ce-507cbf78bf65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:32.487696 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd02799-ebaf-474b-92ce-507cbf78bf65 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:32.513130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-cdd02799-ebaf-474b-92ce-507cbf78bf65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:32.513130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:32.513130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:32.513130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:32.513130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:32.513130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:32.513130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:32.513130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:32.513130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:32.513130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:32.513130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:32.513130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:32.513130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:11:32.513130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:11:32.513130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:11:32.514248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:11:32.514248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:32.514248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:32.514248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:32.514248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:32.514248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:32.514248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:32.514248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:32.514248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:32.514248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:32.514248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:32.514248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:32.514248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:32.514248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:32.514248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:32.514248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:32.514248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:32.515516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:11:32.515516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:11:32.515516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:11:32.515516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:11:32.515516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:11:32.515516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:11:32.515516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:32.515516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:32.516016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 266/534] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:32.517075 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd02799-ebaf-474b-92ce-507cbf78bf65 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:32.576887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75f0db-00a0-4c86-a274-22a7f58e2d69 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:32.613317 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451b15d-b771-465b-a420-261366eae333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:32.614041 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451b15d-b771-465b-a420-261366eae333 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:32.614271 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451b15d-b771-465b-a420-261366eae333 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:32.614552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451b15d-b771-465b-a420-261366eae333 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:32.615815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451b15d-b771-465b-a420-261366eae333 None admin] RBAC: Adding query filter params (role.id=bd4b3497427646f48a7c4d949e498ebc, scope.project.id=121ed31a143d49b3a16ac6c5c6b28955, user.id=89f45690463c48ad8e95c167be6fc9fc) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:32.615815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451b15d-b771-465b-a420-261366eae333 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:32.617371 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451b15d-b771-465b-a420-261366eae333 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:32.625000 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 269/535] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:11:32 2022] GET /identity/v3/role_assignments?user.id=89f45690463c48ad8e95c167be6fc9fc&scope.project.id=121ed31a143d49b3a16ac6c5c6b28955&role.id=bd4b3497427646f48a7c4d949e498ebc => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:32.626209 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451b15d-b771-465b-a420-261366eae333 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:32.626796 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd02799-ebaf-474b-92ce-507cbf78bf65 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:32.678505 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e507e4e-0a34-42d5-98cc-656a8b23efe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:32.679277 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e507e4e-0a34-42d5-98cc-656a8b23efe4 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:32.679464 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e507e4e-0a34-42d5-98cc-656a8b23efe4 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:32.679732 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e507e4e-0a34-42d5-98cc-656a8b23efe4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:32.680615 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e507e4e-0a34-42d5-98cc-656a8b23efe4 None admin] RBAC: Adding query filter params (role.id=bd4b3497427646f48a7c4d949e498ebc, scope.project.id=121ed31a143d49b3a16ac6c5c6b28955, user.id=242d4f9634a74013af05f50981280864) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:32.680933 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e507e4e-0a34-42d5-98cc-656a8b23efe4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:32.682396 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e507e4e-0a34-42d5-98cc-656a8b23efe4 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:32.692644 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 267/536] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:11:32 2022] GET /identity/v3/role_assignments?user.id=242d4f9634a74013af05f50981280864&scope.project.id=121ed31a143d49b3a16ac6c5c6b28955&role.id=bd4b3497427646f48a7c4d949e498ebc => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:32.694698 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a74e77-dc2d-4a64-bbbe-1420506daa5d None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:32.695653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a74e77-dc2d-4a64-bbbe-1420506daa5d None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:32.696504 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a74e77-dc2d-4a64-bbbe-1420506daa5d None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:32.699454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 268/537] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:32.701104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a74e77-dc2d-4a64-bbbe-1420506daa5d None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:32.760489 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451b15d-b771-465b-a420-261366eae333 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:32.807572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054121e-8cad-4575-8c83-34fdc6a32036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:32.808520 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054121e-8cad-4575-8c83-34fdc6a32036 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:32.808716 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054121e-8cad-4575-8c83-34fdc6a32036 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:32.808984 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054121e-8cad-4575-8c83-34fdc6a32036 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:32.818690 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054121e-8cad-4575-8c83-34fdc6a32036 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:32.820508 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054121e-8cad-4575-8c83-34fdc6a32036 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:32.839445 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-b054121e-8cad-4575-8c83-34fdc6a32036 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:32.839445 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:32.839445 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:32.839445 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:32.839445 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:32.839445 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:32.839445 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:32.839445 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:32.839445 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:32.839445 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:32.839445 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:32.839445 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:32.839445 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:11:32.839445 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:11:32.839445 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:11:32.841090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:11:32.841090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:32.841090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:32.841090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:32.841090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:32.841090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:32.841090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:32.841090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:32.841090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:32.841090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:32.841090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:32.841090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:32.841090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:32.841090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:32.841090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:32.841090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:32.841090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:32.843303 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:11:32.843303 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:11:32.843303 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:11:32.843303 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:11:32.843303 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:11:32.843303 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:11:32.843303 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:32.843303 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:32.846143 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 270/538] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:32.847665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df4f4b-6ecc-4236-8d9b-835cae265e8e None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:32.847947 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df4f4b-6ecc-4236-8d9b-835cae265e8e None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:32.848250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df4f4b-6ecc-4236-8d9b-835cae265e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:32.871232 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-f8df4f4b-6ecc-4236-8d9b-835cae265e8e None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:32.872682 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f8df4f4b-6ecc-4236-8d9b-835cae265e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:32.896209 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a74e77-dc2d-4a64-bbbe-1420506daa5d None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:32.945947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60503b7-d55f-46c9-98fb-dad515e383ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:32.946628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60503b7-d55f-46c9-98fb-dad515e383ba None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:32.946916 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60503b7-d55f-46c9-98fb-dad515e383ba None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:32.947199 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60503b7-d55f-46c9-98fb-dad515e383ba None admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:32.948078 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60503b7-d55f-46c9-98fb-dad515e383ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:32.948666 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60503b7-d55f-46c9-98fb-dad515e383ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:32.951246 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60503b7-d55f-46c9-98fb-dad515e383ba None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:32.972320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 269/539] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:11:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:32.974876 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60503b7-d55f-46c9-98fb-dad515e383ba None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:33.028278 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 271/540] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:33.028278 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df4f4b-6ecc-4236-8d9b-835cae265e8e None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:33.159931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60503b7-d55f-46c9-98fb-dad515e383ba None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:33.165148 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df4f4b-6ecc-4236-8d9b-835cae265e8e None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:33.206131 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c8f2a-d991-42f4-86cb-4a91d79743e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:33.206801 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c8f2a-d991-42f4-86cb-4a91d79743e4 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:33.207082 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c8f2a-d991-42f4-86cb-4a91d79743e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:33.207336 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c8f2a-d991-42f4-86cb-4a91d79743e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:33.208225 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c8f2a-d991-42f4-86cb-4a91d79743e4 None admin] RBAC: Adding query filter params (role.id=bd4b3497427646f48a7c4d949e498ebc, scope.project.id=121ed31a143d49b3a16ac6c5c6b28955, user.id=3c62c3f9351a4181a4fc2930570171b5) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:33.208534 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c8f2a-d991-42f4-86cb-4a91d79743e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:33.210008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c8f2a-d991-42f4-86cb-4a91d79743e4 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:33.216652 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 272/541] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:11:33 2022] GET /identity/v3/role_assignments?user.id=3c62c3f9351a4181a4fc2930570171b5&scope.project.id=121ed31a143d49b3a16ac6c5c6b28955&role.id=bd4b3497427646f48a7c4d949e498ebc => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:33.217525 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c8f2a-d991-42f4-86cb-4a91d79743e4 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:33.244002 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463533a-7139-46ae-b8d8-02eb36536a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:33.244744 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463533a-7139-46ae-b8d8-02eb36536a66 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:33.245070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463533a-7139-46ae-b8d8-02eb36536a66 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:33.245294 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463533a-7139-46ae-b8d8-02eb36536a66 None admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:33.248219 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463533a-7139-46ae-b8d8-02eb36536a66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:33.248219 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463533a-7139-46ae-b8d8-02eb36536a66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:33.248219 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463533a-7139-46ae-b8d8-02eb36536a66 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:33.280336 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 270/542] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:11:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:33.288736 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463533a-7139-46ae-b8d8-02eb36536a66 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:33.397448 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c8f2a-d991-42f4-86cb-4a91d79743e4 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:33.476908 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505eb41-c9ea-4bd5-8c9e-ca637920f45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:33.478760 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505eb41-c9ea-4bd5-8c9e-ca637920f45e None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:33.479500 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505eb41-c9ea-4bd5-8c9e-ca637920f45e None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:33.480045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505eb41-c9ea-4bd5-8c9e-ca637920f45e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:33.510996 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505eb41-c9ea-4bd5-8c9e-ca637920f45e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:33.517969 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463533a-7139-46ae-b8d8-02eb36536a66 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:33.542943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-d505eb41-c9ea-4bd5-8c9e-ca637920f45e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:33.542943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:33.542943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:33.542943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:33.542943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:33.542943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:33.542943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:33.542943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:33.542943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:33.542943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:33.542943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:33.542943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:33.542943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:33.542943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:33.542943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:33.542943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:33.543954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:33.543954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:33.543954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:33.543954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:33.543954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:33.543954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:33.543954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:33.543954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:33.543954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:33.543954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:33.543954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:33.543954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:33.543954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:33.543954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:33.543954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:33.543954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:33.544789 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:33.544789 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:33.544789 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:33.544789 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:33.544789 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:33.544789 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:33.544789 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:33.544789 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:33.544789 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:33.544789 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:33.544789 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:33.544789 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:33.546960 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 273/543] 10.222.0.71 () {56 vars in 1102 bytes} [Mon May 16 20:11:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:33.554986 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505eb41-c9ea-4bd5-8c9e-ca637920f45e None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:33.618025 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccb953-8c14-442f-8614-f0b84368ba0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:33.619204 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccb953-8c14-442f-8614-f0b84368ba0e None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:33.619664 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccb953-8c14-442f-8614-f0b84368ba0e None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:33.620201 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccb953-8c14-442f-8614-f0b84368ba0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:33.621746 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccb953-8c14-442f-8614-f0b84368ba0e None admin] RBAC: Adding query filter params (role.id=bd4b3497427646f48a7c4d949e498ebc, scope.project.id=121ed31a143d49b3a16ac6c5c6b28955, user.id=eedc173e2cdc48b489ac40f3d9dccb7a) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:33.622391 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccb953-8c14-442f-8614-f0b84368ba0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:33.625227 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccb953-8c14-442f-8614-f0b84368ba0e None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:33.645101 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 271/544] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:11:33 2022] GET /identity/v3/role_assignments?user.id=eedc173e2cdc48b489ac40f3d9dccb7a&scope.project.id=121ed31a143d49b3a16ac6c5c6b28955&role.id=bd4b3497427646f48a7c4d949e498ebc => generated 259 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:33.730224 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505eb41-c9ea-4bd5-8c9e-ca637920f45e None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:33.771830 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dd201-5a11-4ed8-80be-594fdb74a3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:33.772537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dd201-5a11-4ed8-80be-594fdb74a3a9 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:33.772809 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dd201-5a11-4ed8-80be-594fdb74a3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:33.773082 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dd201-5a11-4ed8-80be-594fdb74a3a9 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:33.773836 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744dd201-5a11-4ed8-80be-594fdb74a3a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:33.774133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744dd201-5a11-4ed8-80be-594fdb74a3a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:33.775521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744dd201-5a11-4ed8-80be-594fdb74a3a9 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:33.789784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 274/545] 10.222.0.71 () {56 vars in 1103 bytes} [Mon May 16 20:11:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:11:33.794069 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccb953-8c14-442f-8614-f0b84368ba0e None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:34.000577 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccb953-8c14-442f-8614-f0b84368ba0e None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:34.072914 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774716e-621f-4abf-8d56-a8d4d1060873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:34.073722 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774716e-621f-4abf-8d56-a8d4d1060873 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:34.074001 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774716e-621f-4abf-8d56-a8d4d1060873 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:34.074270 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774716e-621f-4abf-8d56-a8d4d1060873 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:34.089361 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774716e-621f-4abf-8d56-a8d4d1060873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:34.090834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774716e-621f-4abf-8d56-a8d4d1060873 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:34.111274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-0774716e-621f-4abf-8d56-a8d4d1060873 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:34.111274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:34.111274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:34.111274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:34.111274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:34.111274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:34.111274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:34.111274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:34.111274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:34.111274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:34.111274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:34.111274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:34.111274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:34.111274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:34.111274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:34.113447 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:34.113447 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:34.113447 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:34.113447 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:34.113447 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:34.113447 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:34.113447 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:34.113447 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:34.113447 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:34.113447 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:34.113447 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:34.113447 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:34.113447 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:34.113447 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:34.113447 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:34.113447 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:34.113447 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:34.115992 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:34.115992 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:34.115992 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:34.115992 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:34.115992 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 272/546] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:34.125336 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dd201-5a11-4ed8-80be-594fdb74a3a9 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:34.280752 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dd201-5a11-4ed8-80be-594fdb74a3a9 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:34.324344 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c02bc-a076-4777-87ec-ef473cc3f9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:34.324932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c02bc-a076-4777-87ec-ef473cc3f9e8 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:34.325207 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c02bc-a076-4777-87ec-ef473cc3f9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:34.325472 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c02bc-a076-4777-87ec-ef473cc3f9e8 None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:34.326213 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c02bc-a076-4777-87ec-ef473cc3f9e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:34.326555 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c02bc-a076-4777-87ec-ef473cc3f9e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:34.327994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c02bc-a076-4777-87ec-ef473cc3f9e8 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:34.342902 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 275/547] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:34.350122 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774716e-621f-4abf-8d56-a8d4d1060873 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:34.511749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774716e-621f-4abf-8d56-a8d4d1060873 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:34.555268 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa4023-9281-48a5-8f70-4f08d5cc3602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:34.556099 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa4023-9281-48a5-8f70-4f08d5cc3602 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:34.556459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa4023-9281-48a5-8f70-4f08d5cc3602 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:34.556933 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa4023-9281-48a5-8f70-4f08d5cc3602 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:34.566822 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa4023-9281-48a5-8f70-4f08d5cc3602 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:34.568363 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa4023-9281-48a5-8f70-4f08d5cc3602 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:34.586937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-36aa4023-9281-48a5-8f70-4f08d5cc3602 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 20:11:34.586937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:34.586937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:34.586937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:34.586937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:34.586937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:34.586937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:34.586937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:34.586937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:34.586937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:34.586937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:34.586937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:34.586937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:11:34.586937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:11:34.586937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:11:34.586937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:11:34.589165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:34.589165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:34.589165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:11:34.589165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:34.589165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:11:34.589165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:34.589165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:34.589165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:34.589165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:34.589165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:34.589165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:34.589165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:34.589165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:34.589165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:34.589165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:34.589165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:34.589165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:34.589165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:34.591438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:34.591438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:34.591438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:11:34.591438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:11:34.591438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:11:34.591438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:11:34.591438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:11:34.591438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:11:34.591438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 20:11:34.591438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:34.592695 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 273/548] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:11:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:34.596201 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c02bc-a076-4777-87ec-ef473cc3f9e8 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:34.702215 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c02bc-a076-4777-87ec-ef473cc3f9e8 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:34.743447 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c749d-c58f-4d54-8ec4-a011404db560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:34.744118 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c749d-c58f-4d54-8ec4-a011404db560 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:34.744417 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c749d-c58f-4d54-8ec4-a011404db560 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:34.744686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c749d-c58f-4d54-8ec4-a011404db560 None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:34.745525 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c749d-c58f-4d54-8ec4-a011404db560 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:34.745827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c749d-c58f-4d54-8ec4-a011404db560 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:34.747365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c749d-c58f-4d54-8ec4-a011404db560 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:34.775050 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 276/549] 10.222.0.71 () {56 vars in 1135 bytes} [Mon May 16 20:11:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:34.781415 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa4023-9281-48a5-8f70-4f08d5cc3602 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:34.918096 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa4023-9281-48a5-8f70-4f08d5cc3602 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:34.958863 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351d17a-3c78-4a19-bdd6-56c15cdbf034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:34.959979 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351d17a-3c78-4a19-bdd6-56c15cdbf034 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:34.960518 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351d17a-3c78-4a19-bdd6-56c15cdbf034 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:34.961006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351d17a-3c78-4a19-bdd6-56c15cdbf034 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:35.045006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351d17a-3c78-4a19-bdd6-56c15cdbf034 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:35.046480 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351d17a-3c78-4a19-bdd6-56c15cdbf034 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:35.166990 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 274/550] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:11:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:11:35.172313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c749d-c58f-4d54-8ec4-a011404db560 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:35.300555 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e3c99-b8c3-485f-b38a-0808978f23ff None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:35.300873 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e3c99-b8c3-485f-b38a-0808978f23ff None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:35.301125 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e3c99-b8c3-485f-b38a-0808978f23ff None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:35.302781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 275/551] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:35.318194 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e49a17-fbad-471b-b958-dc9a8ad7ffeb None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:35.318377 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e49a17-fbad-471b-b958-dc9a8ad7ffeb None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:35.318612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e49a17-fbad-471b-b958-dc9a8ad7ffeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:35.326939 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c749d-c58f-4d54-8ec4-a011404db560 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:35.350061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-d6e49a17-fbad-471b-b958-dc9a8ad7ffeb None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:35.351312 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-d6e49a17-fbad-471b-b958-dc9a8ad7ffeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:35.373834 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb7410-7378-4eb4-8a54-c82878e171ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:35.374631 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb7410-7378-4eb4-8a54-c82878e171ce None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:35.374904 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb7410-7378-4eb4-8a54-c82878e171ce None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:35.375173 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb7410-7378-4eb4-8a54-c82878e171ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:35.387854 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb7410-7378-4eb4-8a54-c82878e171ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:35.389422 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb7410-7378-4eb4-8a54-c82878e171ce None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:35.407845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-06fb7410-7378-4eb4-8a54-c82878e171ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:35.407845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:35.407845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:35.407845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:35.407845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:35.407845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:35.407845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:35.407845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:35.407845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:35.407845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:35.407845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:35.407845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:35.407845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:35.407845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:35.407845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:35.409132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:35.409132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:35.409132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:35.409132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:35.409132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:35.409132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:35.409132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:35.409132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:35.409132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:35.409132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:35.409132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:35.409132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:35.409132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:35.409132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:35.409132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:35.409132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:35.409132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:35.409961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:35.409961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:35.409961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:35.409961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:35.413809 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 277/552] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:35.415000 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb7410-7378-4eb4-8a54-c82878e171ce None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:35.497998 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 276/553] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:11:35.524956 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17082a7-092f-407c-afa6-1e4da75d9400 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:35.525616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17082a7-092f-407c-afa6-1e4da75d9400 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:35.526125 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17082a7-092f-407c-afa6-1e4da75d9400 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:35.527953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 277/554] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:11:35.532458 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb7410-7378-4eb4-8a54-c82878e171ce None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:35.539333 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17082a7-092f-407c-afa6-1e4da75d9400 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:35.570134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa053e-5873-44f1-91f6-e3be28958036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:35.571354 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa053e-5873-44f1-91f6-e3be28958036 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:35.571697 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa053e-5873-44f1-91f6-e3be28958036 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:35.571973 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa053e-5873-44f1-91f6-e3be28958036 None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:35.573043 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa053e-5873-44f1-91f6-e3be28958036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:35.573393 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa053e-5873-44f1-91f6-e3be28958036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:35.575309 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa053e-5873-44f1-91f6-e3be28958036 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:35.590256 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 278/555] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:35.591939 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688a986-902e-404a-b2b0-ad36d5a7afa4 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:35.592476 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688a986-902e-404a-b2b0-ad36d5a7afa4 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:35.592979 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688a986-902e-404a-b2b0-ad36d5a7afa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:35.618960 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-3688a986-902e-404a-b2b0-ad36d5a7afa4 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:35.620870 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-3688a986-902e-404a-b2b0-ad36d5a7afa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:35.682297 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17082a7-092f-407c-afa6-1e4da75d9400 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:35.704177 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 279/556] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:35.704177 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688a986-902e-404a-b2b0-ad36d5a7afa4 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:35.740049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b2885-58db-4c27-9d77-cbb6504ca019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:35.740884 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b2885-58db-4c27-9d77-cbb6504ca019 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:35.741217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b2885-58db-4c27-9d77-cbb6504ca019 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:35.741489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b2885-58db-4c27-9d77-cbb6504ca019 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:35.753098 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b2885-58db-4c27-9d77-cbb6504ca019 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:35.761074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-ac5b2885-58db-4c27-9d77-cbb6504ca019 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:35.761074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:35.761074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:35.761074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:35.761074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:35.761074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:35.761074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:35.761074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:35.761074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:35.761074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:35.761074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:35.761074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:35.761074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:35.761074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:35.761074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:35.761074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:35.761991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:35.761991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:35.761991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:35.761991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:35.761991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:35.761991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:35.761991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:35.761991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:35.761991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:35.761991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:35.761991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:35.761991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:35.761991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:35.761991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:35.761991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:35.761991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:35.762812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:35.762812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:35.762812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:35.762812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:35.762812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:35.762812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:35.762812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:35.762812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:35.762812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:35.762812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:35.762812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:35.762812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:35.762812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 278/557] 10.222.0.71 () {56 vars in 1102 bytes} [Mon May 16 20:11:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:11:35.764106 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b2885-58db-4c27-9d77-cbb6504ca019 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:35.813755 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688a986-902e-404a-b2b0-ad36d5a7afa4 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:35.848568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec1bd5-f956-456f-97ca-e2ae042aa2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:35.849357 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec1bd5-f956-456f-97ca-e2ae042aa2eb None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:35.849636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec1bd5-f956-456f-97ca-e2ae042aa2eb None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:35.849905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec1bd5-f956-456f-97ca-e2ae042aa2eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:35.857056 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec1bd5-f956-456f-97ca-e2ae042aa2eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:35.858684 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec1bd5-f956-456f-97ca-e2ae042aa2eb None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:35.865799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b2885-58db-4c27-9d77-cbb6504ca019 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:35.873654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-26ec1bd5-f956-456f-97ca-e2ae042aa2eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:35.873654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:35.873654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:35.873654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:35.873654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:35.873654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:35.873654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:35.873654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:35.873654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:35.873654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:35.873654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:35.873654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:35.873654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:11:35.873654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:11:35.873654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:11:35.874509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:11:35.874509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:35.874509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:35.874509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:35.874509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:35.874509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:35.874509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:35.874509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:35.874509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:35.874509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:35.874509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:35.874509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:35.874509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:35.874509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:35.874509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:35.874509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:35.874509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:35.875328 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:11:35.875328 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:11:35.875328 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:11:35.875328 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:11:35.875328 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:11:35.875328 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:11:35.875328 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:35.875328 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:35.880219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 280/558] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:35.881147 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec1bd5-f956-456f-97ca-e2ae042aa2eb None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:35.899905 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d23f3f-773a-4e0f-a3ca-9f58b70ad9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:35.900727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d23f3f-773a-4e0f-a3ca-9f58b70ad9ac None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:35.901007 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d23f3f-773a-4e0f-a3ca-9f58b70ad9ac None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:35.901279 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d23f3f-773a-4e0f-a3ca-9f58b70ad9ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:35.911795 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d23f3f-773a-4e0f-a3ca-9f58b70ad9ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:35.919672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-b4d23f3f-773a-4e0f-a3ca-9f58b70ad9ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:35.919672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:35.919672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:35.919672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:35.919672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:35.919672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:35.919672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:35.919672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:35.919672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:35.919672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:35.919672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:35.919672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:35.919672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:35.919672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:35.919672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:35.919672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:35.921833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:35.921833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:35.921833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:35.921833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:35.921833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:35.921833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:35.921833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:35.921833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:35.921833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:35.921833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:35.921833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:35.921833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:35.921833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:35.921833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:35.921833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:35.921833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:35.924453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:35.924453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:35.924453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:35.924453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:35.924453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:35.924453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:35.924453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:35.924453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:35.924453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:35.924453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:35.924453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:35.924453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:35.924453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 279/559] 10.222.0.71 () {56 vars in 1102 bytes} [Mon May 16 20:11:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:35.924453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d23f3f-773a-4e0f-a3ca-9f58b70ad9ac None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:35.985933 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec1bd5-f956-456f-97ca-e2ae042aa2eb None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:36.030102 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d23f3f-773a-4e0f-a3ca-9f58b70ad9ac None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:36.036198 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f4df0-281c-4908-902b-0abcbfbe88d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:36.037343 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f4df0-281c-4908-902b-0abcbfbe88d7 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:36.037713 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f4df0-281c-4908-902b-0abcbfbe88d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:36.037992 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f4df0-281c-4908-902b-0abcbfbe88d7 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:36.044459 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f4df0-281c-4908-902b-0abcbfbe88d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:36.044459 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f4df0-281c-4908-902b-0abcbfbe88d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:36.044459 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f4df0-281c-4908-902b-0abcbfbe88d7 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:36.053002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 281/560] 10.222.0.71 () {56 vars in 1103 bytes} [Mon May 16 20:11:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:36.053988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f4df0-281c-4908-902b-0abcbfbe88d7 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:36.070642 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b74f3-f1a1-4ccb-84cd-935b2eb7092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:36.071305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b74f3-f1a1-4ccb-84cd-935b2eb7092d None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:36.071579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b74f3-f1a1-4ccb-84cd-935b2eb7092d None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:36.071857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b74f3-f1a1-4ccb-84cd-935b2eb7092d None admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:36.072687 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b74f3-f1a1-4ccb-84cd-935b2eb7092d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:36.072998 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b74f3-f1a1-4ccb-84cd-935b2eb7092d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:36.074478 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b74f3-f1a1-4ccb-84cd-935b2eb7092d None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:36.088413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 280/561] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:11:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:36.089295 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b74f3-f1a1-4ccb-84cd-935b2eb7092d None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:36.174950 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f4df0-281c-4908-902b-0abcbfbe88d7 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:36.202361 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b74f3-f1a1-4ccb-84cd-935b2eb7092d None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:36.224796 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e25c07-74f4-46fc-844a-edda172656ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:36.225460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e25c07-74f4-46fc-844a-edda172656ae None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:36.225736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e25c07-74f4-46fc-844a-edda172656ae None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:36.226002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e25c07-74f4-46fc-844a-edda172656ae None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:36.226744 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e25c07-74f4-46fc-844a-edda172656ae None admin] RBAC: Adding query filter params (name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:36.227041 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e25c07-74f4-46fc-844a-edda172656ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:36.233689 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e25c07-74f4-46fc-844a-edda172656ae None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:36.237098 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a81d48-355d-4dfa-8466-355680ba9206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:36.238045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a81d48-355d-4dfa-8466-355680ba9206 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:36.238329 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a81d48-355d-4dfa-8466-355680ba9206 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:36.238604 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a81d48-355d-4dfa-8466-355680ba9206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:36.243849 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 282/562] 10.222.0.71 () {56 vars in 1103 bytes} [Mon May 16 20:11:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:36.245153 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e25c07-74f4-46fc-844a-edda172656ae None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:36.249850 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a81d48-355d-4dfa-8466-355680ba9206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:36.251256 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a81d48-355d-4dfa-8466-355680ba9206 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:36.271281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-42a81d48-355d-4dfa-8466-355680ba9206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:36.271281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:36.271281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:36.271281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:36.271281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:36.271281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:36.271281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:36.271281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:36.271281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:36.271281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:36.271281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:36.271281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:36.271281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:36.271281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:36.271281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:36.272257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:36.272257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:36.272257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:36.272257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:36.272257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:36.272257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:36.272257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:36.272257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:36.272257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:36.272257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:36.272257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:36.272257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:36.272257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:36.272257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:36.272257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:36.272257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:36.272257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:36.273738 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:36.273738 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:36.273738 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:36.273738 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:36.273738 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 281/563] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:36.274019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a81d48-355d-4dfa-8466-355680ba9206 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:36.354548 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e25c07-74f4-46fc-844a-edda172656ae None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:36.376422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a81d48-355d-4dfa-8466-355680ba9206 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:36.389146 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745f9d7-47c5-4248-ba7c-753d00512c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:36.389807 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745f9d7-47c5-4248-ba7c-753d00512c46 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:36.390342 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745f9d7-47c5-4248-ba7c-753d00512c46 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:36.390616 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745f9d7-47c5-4248-ba7c-753d00512c46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:36.391446 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745f9d7-47c5-4248-ba7c-753d00512c46 None admin] RBAC: Adding query filter params (role.id=bd4b3497427646f48a7c4d949e498ebc, scope.project.id=121ed31a143d49b3a16ac6c5c6b28955, user.id=7e701cf55d13410aa259ec72578ed27a) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:36.391756 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745f9d7-47c5-4248-ba7c-753d00512c46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:36.393263 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745f9d7-47c5-4248-ba7c-753d00512c46 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:36.404103 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 283/564] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:11:36 2022] GET /identity/v3/role_assignments?user.id=7e701cf55d13410aa259ec72578ed27a&scope.project.id=121ed31a143d49b3a16ac6c5c6b28955&role.id=bd4b3497427646f48a7c4d949e498ebc => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:36.404103 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745f9d7-47c5-4248-ba7c-753d00512c46 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:36.424790 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85d0a3-074a-4fdc-8984-662227973f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:36.426333 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85d0a3-074a-4fdc-8984-662227973f42 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:36.426997 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85d0a3-074a-4fdc-8984-662227973f42 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:36.427916 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85d0a3-074a-4fdc-8984-662227973f42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:36.443099 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85d0a3-074a-4fdc-8984-662227973f42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:36.445610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85d0a3-074a-4fdc-8984-662227973f42 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:36.472124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-fc85d0a3-074a-4fdc-8984-662227973f42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:36.472124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:36.472124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:36.472124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:36.472124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:36.472124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:36.472124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:36.472124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:36.472124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:36.472124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:36.472124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:36.472124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:36.472124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:36.472124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:36.472124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:36.473230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:36.473230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:36.473230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:36.473230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:36.473230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:36.473230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:36.473230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:36.473230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:36.473230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:36.473230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:36.473230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:36.473230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:36.473230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:36.473230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:36.473230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:36.473230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:36.473230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:36.474089 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:36.474089 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:36.474089 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:36.474089 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:36.476711 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 282/565] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:36.478295 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c8944-caa7-4c9a-91c4-d8d7f8dc08bd None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:36.478696 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c8944-caa7-4c9a-91c4-d8d7f8dc08bd None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:36.479114 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c8944-caa7-4c9a-91c4-d8d7f8dc08bd None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:36.484794 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 283/566] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:36.485950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c8944-caa7-4c9a-91c4-d8d7f8dc08bd None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:36.522943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745f9d7-47c5-4248-ba7c-753d00512c46 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:36.570918 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a6a93-7e50-4b27-8413-e75f0904bdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:36.572425 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a6a93-7e50-4b27-8413-e75f0904bdba None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:36.572902 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a6a93-7e50-4b27-8413-e75f0904bdba None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:36.573328 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a6a93-7e50-4b27-8413-e75f0904bdba None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:36.574885 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a6a93-7e50-4b27-8413-e75f0904bdba None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:36.575487 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a6a93-7e50-4b27-8413-e75f0904bdba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:36.577366 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a6a93-7e50-4b27-8413-e75f0904bdba None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:36.604783 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 284/567] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:36.606380 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75106b-a7a9-4369-8bab-2809ec189b28 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:36.606820 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75106b-a7a9-4369-8bab-2809ec189b28 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:36.607225 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75106b-a7a9-4369-8bab-2809ec189b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:36.611210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c8944-caa7-4c9a-91c4-d8d7f8dc08bd None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:36.628959 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-3a75106b-a7a9-4369-8bab-2809ec189b28 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:36.630557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-3a75106b-a7a9-4369-8bab-2809ec189b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:36.649014 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df4617-a95c-40bf-831e-7e8aca2f854b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:36.649941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df4617-a95c-40bf-831e-7e8aca2f854b None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:36.650372 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df4617-a95c-40bf-831e-7e8aca2f854b None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:36.650790 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df4617-a95c-40bf-831e-7e8aca2f854b None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:36.651646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df4617-a95c-40bf-831e-7e8aca2f854b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:36.652114 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df4617-a95c-40bf-831e-7e8aca2f854b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:36.653654 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df4617-a95c-40bf-831e-7e8aca2f854b None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:36.665152 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 284/568] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:36.666234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df4617-a95c-40bf-831e-7e8aca2f854b None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:36.734353 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 285/569] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:36.737173 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75106b-a7a9-4369-8bab-2809ec189b28 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:36.793110 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df4617-a95c-40bf-831e-7e8aca2f854b None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:36.833371 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9ecde-5bfb-4ce8-b764-3336bdeb51f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:36.834182 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9ecde-5bfb-4ce8-b764-3336bdeb51f9 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:36.834464 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9ecde-5bfb-4ce8-b764-3336bdeb51f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:36.834755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9ecde-5bfb-4ce8-b764-3336bdeb51f9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:36.843616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9ecde-5bfb-4ce8-b764-3336bdeb51f9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:36.845046 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9ecde-5bfb-4ce8-b764-3336bdeb51f9 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:36.861374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-7bf9ecde-5bfb-4ce8-b764-3336bdeb51f9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 20:11:36.861374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:36.861374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:36.861374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:36.861374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:36.861374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:36.861374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:36.861374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:36.861374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:36.861374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:36.861374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:36.861374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:36.861374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:11:36.861374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:11:36.861374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:11:36.861374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:11:36.862899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:36.862899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:36.862899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:11:36.862899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:36.862899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:11:36.862899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:36.862899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:36.862899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:36.862899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:36.862899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:36.862899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:36.862899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:36.862899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:36.862899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:36.862899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:36.862899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:36.862899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:36.862899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:36.863867 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:36.863867 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:36.863867 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:11:36.863867 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:11:36.863867 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:11:36.863867 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:11:36.863867 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:11:36.863867 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:11:36.863867 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 20:11:36.863867 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:36.863867 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 285/570] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:11:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:36.865374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9ecde-5bfb-4ce8-b764-3336bdeb51f9 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:36.877366 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75106b-a7a9-4369-8bab-2809ec189b28 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:36.915570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7144146-f0c7-4d92-b5c1-c9209c4e6486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:36.916390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7144146-f0c7-4d92-b5c1-c9209c4e6486 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:36.916721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7144146-f0c7-4d92-b5c1-c9209c4e6486 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:36.916930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7144146-f0c7-4d92-b5c1-c9209c4e6486 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:36.926691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7144146-f0c7-4d92-b5c1-c9209c4e6486 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:36.928204 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7144146-f0c7-4d92-b5c1-c9209c4e6486 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:36.943552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-b7144146-f0c7-4d92-b5c1-c9209c4e6486 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 20:11:36.943552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:36.943552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:36.943552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:36.943552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:36.943552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:36.943552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:36.943552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:36.943552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:36.943552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:36.943552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:36.943552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:36.943552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:11:36.943552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:11:36.943552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:11:36.943552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:11:36.944623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:36.944623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:36.944623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:11:36.944623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:36.944623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:11:36.944623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:36.944623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:36.944623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:36.944623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:36.944623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:36.944623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:36.944623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:36.944623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:36.944623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:36.944623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:36.944623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:36.944623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:36.944623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:36.946027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:36.946027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:36.946027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:11:36.946027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:11:36.946027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:11:36.946027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:11:36.946027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:11:36.946027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:11:36.946027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 20:11:36.946027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:36.946027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 286/571] 10.222.0.71 () {56 vars in 1093 bytes} [Mon May 16 20:11:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:36.946027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a789b64-bc58-41ae-ae74-80e1515dbd28 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:36.946650 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a789b64-bc58-41ae-ae74-80e1515dbd28 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:36.946650 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a789b64-bc58-41ae-ae74-80e1515dbd28 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:36.947835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 287/572] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:36.952398 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a789b64-bc58-41ae-ae74-80e1515dbd28 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:36.982736 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9ecde-5bfb-4ce8-b764-3336bdeb51f9 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:37.017149 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f70ff-de27-4682-a77b-12fc2b0ed1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:37.019067 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f70ff-de27-4682-a77b-12fc2b0ed1b9 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:37.019363 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f70ff-de27-4682-a77b-12fc2b0ed1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:37.019641 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f70ff-de27-4682-a77b-12fc2b0ed1b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:37.029807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f70ff-de27-4682-a77b-12fc2b0ed1b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:37.038186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-590f70ff-de27-4682-a77b-12fc2b0ed1b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:37.038186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:37.038186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:37.038186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:37.038186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:37.038186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:37.038186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:37.038186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:37.038186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:37.038186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:37.038186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:37.038186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:37.038186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:37.038186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:37.038186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:37.038186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:37.039112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:37.039112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:37.039112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:37.039112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:37.039112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:37.039112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:37.039112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:37.039112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:37.039112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:37.039112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:37.039112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:37.039112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:37.039112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:37.039112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:37.039112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:37.039112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:37.040070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:37.040070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:37.040070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:37.040070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:37.040070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:37.040070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:37.040070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:37.040070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:37.040070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:37.040070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:37.040070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:37.040070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:37.040070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 286/573] 10.222.0.71 () {56 vars in 1102 bytes} [Mon May 16 20:11:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:37.041335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f70ff-de27-4682-a77b-12fc2b0ed1b9 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:37.059837 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a789b64-bc58-41ae-ae74-80e1515dbd28 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:37.094538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914b570-ff2e-4cb7-8110-de5cce1124ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:37.095198 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914b570-ff2e-4cb7-8110-de5cce1124ec None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:37.095471 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914b570-ff2e-4cb7-8110-de5cce1124ec None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:37.095835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914b570-ff2e-4cb7-8110-de5cce1124ec None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:37.096695 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914b570-ff2e-4cb7-8110-de5cce1124ec None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:37.096995 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914b570-ff2e-4cb7-8110-de5cce1124ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:37.098425 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914b570-ff2e-4cb7-8110-de5cce1124ec None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:37.119373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 288/574] 10.222.0.71 () {56 vars in 1137 bytes} [Mon May 16 20:11:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:37.119373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65824d-2e03-4ea1-a978-0f0a73bdcbd3 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:37.119373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65824d-2e03-4ea1-a978-0f0a73bdcbd3 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:37.119373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65824d-2e03-4ea1-a978-0f0a73bdcbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:37.133042 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-1f65824d-2e03-4ea1-a978-0f0a73bdcbd3 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:37.134226 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-1f65824d-2e03-4ea1-a978-0f0a73bdcbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:37.147044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f70ff-de27-4682-a77b-12fc2b0ed1b9 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:37.183058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0151772-10dd-49dd-bd64-901d93cf7c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:37.183704 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0151772-10dd-49dd-bd64-901d93cf7c8a None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:37.183983 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0151772-10dd-49dd-bd64-901d93cf7c8a None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:37.184290 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0151772-10dd-49dd-bd64-901d93cf7c8a None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:37.185117 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0151772-10dd-49dd-bd64-901d93cf7c8a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:37.185421 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0151772-10dd-49dd-bd64-901d93cf7c8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:37.186841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0151772-10dd-49dd-bd64-901d93cf7c8a None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:37.204433 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 289/575] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:37.204433 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65824d-2e03-4ea1-a978-0f0a73bdcbd3 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:37.221934 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 287/576] 10.222.0.71 () {56 vars in 1133 bytes} [Mon May 16 20:11:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:37.223237 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0151772-10dd-49dd-bd64-901d93cf7c8a None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:37.317471 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65824d-2e03-4ea1-a978-0f0a73bdcbd3 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:37.357425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0151772-10dd-49dd-bd64-901d93cf7c8a None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:37.359691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4077c9-4f45-4da7-b95c-89d4bb97a06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:37.360791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4077c9-4f45-4da7-b95c-89d4bb97a06e None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:37.361304 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4077c9-4f45-4da7-b95c-89d4bb97a06e None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:37.361812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4077c9-4f45-4da7-b95c-89d4bb97a06e None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:37.362718 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4077c9-4f45-4da7-b95c-89d4bb97a06e None admin] RBAC: Adding query filter params (name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:37.363156 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4077c9-4f45-4da7-b95c-89d4bb97a06e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:37.364729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4077c9-4f45-4da7-b95c-89d4bb97a06e None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:37.374218 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 290/577] 10.222.0.71 () {56 vars in 1103 bytes} [Mon May 16 20:11:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:37.375377 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4077c9-4f45-4da7-b95c-89d4bb97a06e None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:37.402177 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ec691-da50-4002-b42b-41c1a26ce4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:37.403383 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ec691-da50-4002-b42b-41c1a26ce4f9 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:37.403383 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ec691-da50-4002-b42b-41c1a26ce4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:37.403595 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ec691-da50-4002-b42b-41c1a26ce4f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:37.415353 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ec691-da50-4002-b42b-41c1a26ce4f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:37.416862 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ec691-da50-4002-b42b-41c1a26ce4f9 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:37.437144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-ae9ec691-da50-4002-b42b-41c1a26ce4f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:37.437144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:37.437144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:37.437144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:37.437144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:37.437144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:37.437144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:37.437144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:37.437144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:37.437144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:37.437144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:37.437144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:37.437144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:37.437144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:37.437144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:37.438236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:37.438236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:37.438236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:37.438236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:37.438236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:37.438236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:37.438236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:37.438236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:37.438236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:37.438236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:37.438236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:37.438236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:37.438236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:37.438236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:37.438236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:37.438236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:37.438236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:37.439150 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:37.439150 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:37.439150 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:37.439150 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:37.439150 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 288/578] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:37.439876 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ec691-da50-4002-b42b-41c1a26ce4f9 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:37.497949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4077c9-4f45-4da7-b95c-89d4bb97a06e None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:37.542100 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a613b5-32c0-4129-baf0-4dccb85c716f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:37.543169 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a613b5-32c0-4129-baf0-4dccb85c716f None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:37.543450 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a613b5-32c0-4129-baf0-4dccb85c716f None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:37.543723 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a613b5-32c0-4129-baf0-4dccb85c716f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:37.544258 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ec691-da50-4002-b42b-41c1a26ce4f9 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:37.558638 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a613b5-32c0-4129-baf0-4dccb85c716f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:37.560577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a613b5-32c0-4129-baf0-4dccb85c716f None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:37.584022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-59a613b5-32c0-4129-baf0-4dccb85c716f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:37.584022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:37.584022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:37.584022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:37.584022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:37.584022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:37.584022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:37.584022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:37.584022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:37.584022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:37.584022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:37.584022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:37.584022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:37.584022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:37.584022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:37.585099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:37.585099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:37.585099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:37.585099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:37.585099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:37.585099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:37.585099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:37.585099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:37.585099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:37.585099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:37.585099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:37.585099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:37.585099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:37.585099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:37.585099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:37.585099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:37.585099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:37.586113 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:37.586113 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:37.586113 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:37.586113 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:37.586113 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 291/579] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:37.587859 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a99f85-29dc-426e-9775-9452287ed7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:37.588768 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a99f85-29dc-426e-9775-9452287ed7a4 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:37.589048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a99f85-29dc-426e-9775-9452287ed7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:37.589319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a99f85-29dc-426e-9775-9452287ed7a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:37.593485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a613b5-32c0-4129-baf0-4dccb85c716f None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:37.603398 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a99f85-29dc-426e-9775-9452287ed7a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:37.611945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-b6a99f85-29dc-426e-9775-9452287ed7a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:37.611945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:37.611945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:37.611945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:37.611945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:37.611945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:37.611945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:37.611945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:37.611945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:37.611945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:37.611945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:37.611945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:37.611945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:37.611945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:37.611945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:37.611945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:37.613223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:37.613223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:37.613223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:37.613223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:37.613223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:37.613223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:37.613223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:37.613223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:37.613223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:37.613223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:37.613223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:37.613223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:37.613223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:37.613223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:37.613223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:37.613223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:37.614217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:37.614217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:37.614217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:37.614217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:37.614217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:37.614217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:37.614217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:37.614217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:37.614217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:37.614217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:37.614217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:37.614217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:37.616478 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 289/580] 10.222.0.71 () {56 vars in 1102 bytes} [Mon May 16 20:11:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:37.617684 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a99f85-29dc-426e-9775-9452287ed7a4 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:37.712812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a613b5-32c0-4129-baf0-4dccb85c716f None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:37.748686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a99f85-29dc-426e-9775-9452287ed7a4 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:37.756636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633d511-180d-42e2-b710-86c99a46c734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:37.758533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633d511-180d-42e2-b710-86c99a46c734 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:37.759775 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633d511-180d-42e2-b710-86c99a46c734 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:37.761233 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633d511-180d-42e2-b710-86c99a46c734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:37.776912 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633d511-180d-42e2-b710-86c99a46c734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:37.778803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633d511-180d-42e2-b710-86c99a46c734 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:37.787974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbec9a6-d71e-4cc0-9448-ae51dd8a41ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:37.788667 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbec9a6-d71e-4cc0-9448-ae51dd8a41ce None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:37.788973 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbec9a6-d71e-4cc0-9448-ae51dd8a41ce None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:37.789253 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbec9a6-d71e-4cc0-9448-ae51dd8a41ce None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:37.790053 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbec9a6-d71e-4cc0-9448-ae51dd8a41ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:37.790368 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbec9a6-d71e-4cc0-9448-ae51dd8a41ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:37.791827 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbec9a6-d71e-4cc0-9448-ae51dd8a41ce None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:37.812605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 290/581] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:37.812605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbec9a6-d71e-4cc0-9448-ae51dd8a41ce None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:37.812997 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-1633d511-180d-42e2-b710-86c99a46c734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:37.812997 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:37.812997 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:37.812997 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:37.812997 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:37.812997 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:37.812997 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:37.812997 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:37.812997 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:37.812997 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:37.812997 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:37.812997 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:37.812997 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:37.812997 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:37.812997 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:37.815293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:37.815293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:37.815293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:37.815293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:37.815293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:37.815293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:37.815293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:37.815293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:37.815293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:37.815293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:37.815293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:37.815293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:37.815293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:37.815293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:37.815293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:37.815293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:37.815293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:37.819137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:37.819137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:37.819137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:37.819137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:37.822827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 292/582] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:37.822827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633d511-180d-42e2-b710-86c99a46c734 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:37.920108 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbec9a6-d71e-4cc0-9448-ae51dd8a41ce None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:37.928873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633d511-180d-42e2-b710-86c99a46c734 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:37.955562 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08115e-6cf0-4254-ba6f-e922c945a786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:37.956112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08115e-6cf0-4254-ba6f-e922c945a786 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:37.956525 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08115e-6cf0-4254-ba6f-e922c945a786 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:37.956703 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08115e-6cf0-4254-ba6f-e922c945a786 None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:37.958076 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad08115e-6cf0-4254-ba6f-e922c945a786 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:37.958076 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad08115e-6cf0-4254-ba6f-e922c945a786 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:37.959061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad08115e-6cf0-4254-ba6f-e922c945a786 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:37.965958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2e1b8-a7b5-4531-a732-4242e57211b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:37.966551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2e1b8-a7b5-4531-a732-4242e57211b6 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:37.966822 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2e1b8-a7b5-4531-a732-4242e57211b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:37.967089 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2e1b8-a7b5-4531-a732-4242e57211b6 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:37.967895 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2e1b8-a7b5-4531-a732-4242e57211b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:37.968236 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2e1b8-a7b5-4531-a732-4242e57211b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:37.969664 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2e1b8-a7b5-4531-a732-4242e57211b6 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:37.980650 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 291/583] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:37.980650 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08115e-6cf0-4254-ba6f-e922c945a786 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:37.991208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 293/584] 10.222.0.71 () {56 vars in 1103 bytes} [Mon May 16 20:11:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:37.992071 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2e1b8-a7b5-4531-a732-4242e57211b6 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:38.096918 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08115e-6cf0-4254-ba6f-e922c945a786 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:38.111068 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2e1b8-a7b5-4531-a732-4242e57211b6 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:38.131390 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec0c49-4d1c-4d24-bfc0-412614ad1329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:38.132211 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec0c49-4d1c-4d24-bfc0-412614ad1329 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:38.132497 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec0c49-4d1c-4d24-bfc0-412614ad1329 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:38.132776 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec0c49-4d1c-4d24-bfc0-412614ad1329 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:38.140913 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec0c49-4d1c-4d24-bfc0-412614ad1329 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:38.143070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec0c49-4d1c-4d24-bfc0-412614ad1329 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:38.150733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c023d2-cf9c-45cd-93e6-8164b58af749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:38.151402 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c023d2-cf9c-45cd-93e6-8164b58af749 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:38.151681 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c023d2-cf9c-45cd-93e6-8164b58af749 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:38.151950 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c023d2-cf9c-45cd-93e6-8164b58af749 None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:38.152717 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c023d2-cf9c-45cd-93e6-8164b58af749 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:38.153017 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c023d2-cf9c-45cd-93e6-8164b58af749 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:38.154400 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c023d2-cf9c-45cd-93e6-8164b58af749 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:38.160643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-90ec0c49-4d1c-4d24-bfc0-412614ad1329 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:38.160643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:38.160643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:38.160643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:38.160643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:38.160643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:38.160643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:38.160643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:38.160643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:38.160643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:38.160643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:38.160643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:38.160643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:11:38.160643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:11:38.160643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:11:38.161922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:11:38.161922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:38.161922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:38.161922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:38.161922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:38.161922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:38.161922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:38.161922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:38.161922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:38.161922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:38.161922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:38.161922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:38.161922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:38.161922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:38.161922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:38.161922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:38.161922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:38.164268 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:11:38.164268 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:11:38.164268 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:11:38.164268 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:11:38.164268 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:11:38.164268 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:11:38.164268 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:38.164268 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:38.164268 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 292/585] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:38.164268 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec0c49-4d1c-4d24-bfc0-412614ad1329 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:38.177048 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 294/586] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:38.177048 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c023d2-cf9c-45cd-93e6-8164b58af749 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:38.296454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec0c49-4d1c-4d24-bfc0-412614ad1329 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:38.298609 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c023d2-cf9c-45cd-93e6-8164b58af749 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:38.334215 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260107e-68bb-4b2f-9582-ee02058f7e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:38.335019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260107e-68bb-4b2f-9582-ee02058f7e6a None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:38.335298 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260107e-68bb-4b2f-9582-ee02058f7e6a None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:38.335574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260107e-68bb-4b2f-9582-ee02058f7e6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:38.336982 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923b85a-06cb-4950-be7b-be3838627103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:38.337934 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923b85a-06cb-4950-be7b-be3838627103 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:38.338361 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923b85a-06cb-4950-be7b-be3838627103 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:38.338776 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923b85a-06cb-4950-be7b-be3838627103 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:38.343000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260107e-68bb-4b2f-9582-ee02058f7e6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:38.344494 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260107e-68bb-4b2f-9582-ee02058f7e6a None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:38.351933 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923b85a-06cb-4950-be7b-be3838627103 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:38.354807 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923b85a-06cb-4950-be7b-be3838627103 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:38.359239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-2260107e-68bb-4b2f-9582-ee02058f7e6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:38.359239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:38.359239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:38.359239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:38.359239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:38.359239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:38.359239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:38.359239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:38.359239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:38.359239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:38.359239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:38.359239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:38.359239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:11:38.359239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:11:38.359239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:11:38.360643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:11:38.360643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:38.360643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:38.360643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:38.360643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:38.360643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:38.360643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:38.360643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:38.360643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:38.360643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:38.360643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:38.360643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:38.360643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:38.360643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:38.360643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:38.360643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:38.360643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:38.362945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:11:38.362945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:11:38.362945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:11:38.362945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:11:38.362945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:11:38.362945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:11:38.362945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:38.362945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:38.365558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 293/587] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:38.366122 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260107e-68bb-4b2f-9582-ee02058f7e6a None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:38.377920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-9923b85a-06cb-4950-be7b-be3838627103 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:38.377920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:38.377920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:38.377920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:38.377920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:38.377920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:38.377920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:38.377920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:38.377920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:38.377920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:38.377920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:38.377920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:38.377920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:38.377920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:38.377920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:38.381268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:38.381268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:38.381268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:38.381268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:38.381268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:38.381268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:38.381268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:38.381268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:38.381268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:38.381268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:38.381268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:38.381268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:38.381268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:38.381268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:38.381268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:38.381268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:38.381268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:38.385566 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:38.385566 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:38.385566 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:38.385566 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:38.385566 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 295/588] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:38.385566 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923b85a-06cb-4950-be7b-be3838627103 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:38.486183 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260107e-68bb-4b2f-9582-ee02058f7e6a None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:38.505660 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923b85a-06cb-4950-be7b-be3838627103 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:38.531779 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37754cd5-25a0-42ff-82e1-f80d1ebd2f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:38.532537 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37754cd5-25a0-42ff-82e1-f80d1ebd2f18 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:38.532834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37754cd5-25a0-42ff-82e1-f80d1ebd2f18 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:38.533125 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37754cd5-25a0-42ff-82e1-f80d1ebd2f18 None admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:38.534008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37754cd5-25a0-42ff-82e1-f80d1ebd2f18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:38.534436 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37754cd5-25a0-42ff-82e1-f80d1ebd2f18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:38.535889 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37754cd5-25a0-42ff-82e1-f80d1ebd2f18 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:38.552419 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 294/589] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:11:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:38.553767 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37754cd5-25a0-42ff-82e1-f80d1ebd2f18 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:38.567277 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ace910-7d21-487a-80ce-b7c49a4f1d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:38.568067 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ace910-7d21-487a-80ce-b7c49a4f1d94 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:38.568398 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ace910-7d21-487a-80ce-b7c49a4f1d94 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:38.568676 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ace910-7d21-487a-80ce-b7c49a4f1d94 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:38.577759 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ace910-7d21-487a-80ce-b7c49a4f1d94 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:38.579247 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ace910-7d21-487a-80ce-b7c49a4f1d94 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:38.596909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-f9ace910-7d21-487a-80ce-b7c49a4f1d94 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 20:11:38.596909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:38.596909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:38.596909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:38.596909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:38.596909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:38.596909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:38.596909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:38.596909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:38.596909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:38.596909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:38.596909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:38.596909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:11:38.596909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:11:38.596909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:11:38.596909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:11:38.598217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:38.598217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:38.598217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:11:38.598217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:38.598217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:11:38.598217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:38.598217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:38.598217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:38.598217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:38.598217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:38.598217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:38.598217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:38.598217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:38.598217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:38.598217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:38.598217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:38.598217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:38.598217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:38.599853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:38.599853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:38.599853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:11:38.599853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:11:38.599853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:11:38.599853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:11:38.599853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:11:38.599853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:11:38.599853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 20:11:38.599853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:38.599853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 296/590] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:11:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:38.599853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ace910-7d21-487a-80ce-b7c49a4f1d94 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:38.694191 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37754cd5-25a0-42ff-82e1-f80d1ebd2f18 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:38.727292 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ace910-7d21-487a-80ce-b7c49a4f1d94 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:38.730152 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9f00a-e73c-4a01-ac27-3f72cf27d804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:38.730855 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9f00a-e73c-4a01-ac27-3f72cf27d804 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:38.731457 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9f00a-e73c-4a01-ac27-3f72cf27d804 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:38.731457 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9f00a-e73c-4a01-ac27-3f72cf27d804 None admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:38.732136 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9f00a-e73c-4a01-ac27-3f72cf27d804 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:38.732484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9f00a-e73c-4a01-ac27-3f72cf27d804 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:38.733922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9f00a-e73c-4a01-ac27-3f72cf27d804 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:38.753155 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 295/591] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:11:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:38.754472 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9f00a-e73c-4a01-ac27-3f72cf27d804 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:38.762068 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2631f-323d-46c3-9eca-08b0b933c34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:38.762770 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2631f-323d-46c3-9eca-08b0b933c34e None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:38.763126 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2631f-323d-46c3-9eca-08b0b933c34e None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:38.763399 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2631f-323d-46c3-9eca-08b0b933c34e None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:38.764127 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2631f-323d-46c3-9eca-08b0b933c34e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:38.764452 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2631f-323d-46c3-9eca-08b0b933c34e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:38.766093 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2631f-323d-46c3-9eca-08b0b933c34e None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:38.778565 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 297/592] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:38.779429 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2631f-323d-46c3-9eca-08b0b933c34e None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:38.882313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2631f-323d-46c3-9eca-08b0b933c34e None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:38.885649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9f00a-e73c-4a01-ac27-3f72cf27d804 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:38.916924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4aabf8-7a2d-4a98-ac9a-901c7a1c6f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:38.917597 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4aabf8-7a2d-4a98-ac9a-901c7a1c6f6c None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:38.917876 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4aabf8-7a2d-4a98-ac9a-901c7a1c6f6c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:38.918147 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4aabf8-7a2d-4a98-ac9a-901c7a1c6f6c None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:38.918692 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd5158-49de-48f7-a70c-e5db183e0f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:38.918988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4aabf8-7a2d-4a98-ac9a-901c7a1c6f6c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:38.919296 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4aabf8-7a2d-4a98-ac9a-901c7a1c6f6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:38.919566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd5158-49de-48f7-a70c-e5db183e0f93 None admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:38.919845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd5158-49de-48f7-a70c-e5db183e0f93 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:38.920109 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd5158-49de-48f7-a70c-e5db183e0f93 None admin] PATH_INFO: `/v3/projects/121ed31a143d49b3a16ac6c5c6b28955/users/89f45690463c48ad8e95c167be6fc9fc/roles/bd4b3497427646f48a7c4d949e498ebc` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:38.920792 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4aabf8-7a2d-4a98-ac9a-901c7a1c6f6c None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:38.935474 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd5158-49de-48f7-a70c-e5db183e0f93 None admin] RBAC: Authorizing `identity:create_grant(project_id=121ed31a143d49b3a16ac6c5c6b28955, user_id=89f45690463c48ad8e95c167be6fc9fc, role_id=bd4b3497427646f48a7c4d949e498ebc)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:38.936954 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd5158-49de-48f7-a70c-e5db183e0f93 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:38.938897 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 298/593] 10.222.0.71 () {56 vars in 1137 bytes} [Mon May 16 20:11:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:38.940964 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c2d61-e34c-4143-8ef1-87b9c70e22e0 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:38.941155 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c2d61-e34c-4143-8ef1-87b9c70e22e0 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:38.941431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c2d61-e34c-4143-8ef1-87b9c70e22e0 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:38.943095 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 299/594] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:38.944127 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c2d61-e34c-4143-8ef1-87b9c70e22e0 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:38.953182 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 296/595] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:11:38 2022] PUT /identity/v3/projects/121ed31a143d49b3a16ac6c5c6b28955/users/89f45690463c48ad8e95c167be6fc9fc/roles/bd4b3497427646f48a7c4d949e498ebc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:11:38.954026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd5158-49de-48f7-a70c-e5db183e0f93 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:39.074099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c2d61-e34c-4143-8ef1-87b9c70e22e0 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:39.079050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd5158-49de-48f7-a70c-e5db183e0f93 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:39.119975 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd432b71-a52e-435f-bb0b-5905a8ddce9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:39.121025 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd432b71-a52e-435f-bb0b-5905a8ddce9c None admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:39.121373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd432b71-a52e-435f-bb0b-5905a8ddce9c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:39.121651 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd432b71-a52e-435f-bb0b-5905a8ddce9c None admin] PATH_INFO: `/v3/projects/121ed31a143d49b3a16ac6c5c6b28955/users/242d4f9634a74013af05f50981280864/roles/bd4b3497427646f48a7c4d949e498ebc` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:39.122371 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a247e05-4f78-4bee-b0d9-c6e92c7d2a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:39.123341 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a247e05-4f78-4bee-b0d9-c6e92c7d2a3d None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:39.123622 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a247e05-4f78-4bee-b0d9-c6e92c7d2a3d None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:39.123971 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a247e05-4f78-4bee-b0d9-c6e92c7d2a3d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:39.137730 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a247e05-4f78-4bee-b0d9-c6e92c7d2a3d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:39.139415 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd432b71-a52e-435f-bb0b-5905a8ddce9c None admin] RBAC: Authorizing `identity:create_grant(project_id=121ed31a143d49b3a16ac6c5c6b28955, user_id=242d4f9634a74013af05f50981280864, role_id=bd4b3497427646f48a7c4d949e498ebc)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:39.140713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a247e05-4f78-4bee-b0d9-c6e92c7d2a3d None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:39.141222 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd432b71-a52e-435f-bb0b-5905a8ddce9c None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:39.162230 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 300/596] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:11:38 2022] PUT /identity/v3/projects/121ed31a143d49b3a16ac6c5c6b28955/users/242d4f9634a74013af05f50981280864/roles/bd4b3497427646f48a7c4d949e498ebc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:11:39.162861 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd432b71-a52e-435f-bb0b-5905a8ddce9c None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:39.170974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-8a247e05-4f78-4bee-b0d9-c6e92c7d2a3d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 20:11:39.170974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:39.170974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:39.170974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:39.170974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:39.170974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:39.170974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:39.170974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:39.170974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:39.170974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:39.170974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:39.170974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:39.170974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:11:39.170974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:11:39.170974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:11:39.170974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:11:39.172422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:39.172422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:39.172422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:11:39.172422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:39.172422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:11:39.172422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:39.172422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:39.172422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:39.172422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:39.172422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:39.172422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:39.172422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:39.172422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:39.172422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:39.172422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:39.172422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:39.172422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:39.172422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:39.173562 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:39.173562 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:39.173562 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:11:39.173562 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:11:39.173562 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:11:39.173562 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:11:39.173562 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:11:39.173562 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:11:39.173562 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 20:11:39.173562 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:39.173562 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 297/597] 10.222.0.71 () {56 vars in 1102 bytes} [Mon May 16 20:11:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:39.176460 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a820a9-cd7a-4626-b5bb-4945a1365d20 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:39.176884 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a820a9-cd7a-4626-b5bb-4945a1365d20 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:39.177366 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a820a9-cd7a-4626-b5bb-4945a1365d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:39.213912 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-87a820a9-cd7a-4626-b5bb-4945a1365d20 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:39.215234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-87a820a9-cd7a-4626-b5bb-4945a1365d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:39.301091 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd432b71-a52e-435f-bb0b-5905a8ddce9c None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:39.332597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 298/598] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:39.333951 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a820a9-cd7a-4626-b5bb-4945a1365d20 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:39.361083 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8fc95-2bc9-45fd-a71f-84f8b259fbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:39.362779 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8fc95-2bc9-45fd-a71f-84f8b259fbd6 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:39.363006 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8fc95-2bc9-45fd-a71f-84f8b259fbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:39.363274 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8fc95-2bc9-45fd-a71f-84f8b259fbd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:39.382895 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8fc95-2bc9-45fd-a71f-84f8b259fbd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:39.385294 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8fc95-2bc9-45fd-a71f-84f8b259fbd6 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:39.414162 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-cec8fc95-2bc9-45fd-a71f-84f8b259fbd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:39.414162 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:39.414162 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:39.414162 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:39.414162 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:39.414162 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:39.414162 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:39.414162 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:39.414162 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:39.414162 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:39.414162 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:39.414162 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:39.414162 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:39.414162 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:39.414162 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:39.415219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:39.415219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:39.415219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:39.415219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:39.415219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:39.415219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:39.415219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:39.415219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:39.415219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:39.415219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:39.415219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:39.415219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:39.415219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:39.415219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:39.415219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:39.415219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:39.415219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:39.416571 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:39.416571 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:39.416571 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:39.416571 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:39.416571 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 301/599] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:39.416571 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8fc95-2bc9-45fd-a71f-84f8b259fbd6 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:39.467128 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a820a9-cd7a-4626-b5bb-4945a1365d20 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:39.525974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e765a-6047-485f-9379-2351338e1132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:39.526652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e765a-6047-485f-9379-2351338e1132 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:39.527081 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e765a-6047-485f-9379-2351338e1132 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:39.527375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e765a-6047-485f-9379-2351338e1132 None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:39.528258 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e765a-6047-485f-9379-2351338e1132 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:39.528947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e765a-6047-485f-9379-2351338e1132 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:39.530706 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e765a-6047-485f-9379-2351338e1132 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:39.552841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 299/600] 10.222.0.71 () {56 vars in 1139 bytes} [Mon May 16 20:11:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:39.553763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e765a-6047-485f-9379-2351338e1132 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:39.619206 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8fc95-2bc9-45fd-a71f-84f8b259fbd6 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:39.665947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e765a-6047-485f-9379-2351338e1132 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:39.688171 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c80cd9-dcb2-4fd7-bdda-15e6f75e776e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:39.690232 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c80cd9-dcb2-4fd7-bdda-15e6f75e776e None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:39.691523 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c80cd9-dcb2-4fd7-bdda-15e6f75e776e None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:39.692010 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c80cd9-dcb2-4fd7-bdda-15e6f75e776e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:39.703886 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737095b3-e09c-4d6b-8957-f0092ad8116f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:39.704584 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737095b3-e09c-4d6b-8957-f0092ad8116f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:39.704863 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737095b3-e09c-4d6b-8957-f0092ad8116f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:39.705423 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737095b3-e09c-4d6b-8957-f0092ad8116f None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:39.706161 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737095b3-e09c-4d6b-8957-f0092ad8116f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:39.706462 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737095b3-e09c-4d6b-8957-f0092ad8116f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:39.707834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737095b3-e09c-4d6b-8957-f0092ad8116f None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:39.712712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c80cd9-dcb2-4fd7-bdda-15e6f75e776e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:39.720686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 300/601] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:39.721573 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737095b3-e09c-4d6b-8957-f0092ad8116f None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:39.730970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-37c80cd9-dcb2-4fd7-bdda-15e6f75e776e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:39.730970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:39.730970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:39.730970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:39.730970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:39.730970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:39.730970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:39.730970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:39.730970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:39.730970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:39.730970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:39.730970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:39.730970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:39.730970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:39.730970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:39.730970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:39.734540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:39.734540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:39.734540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:39.734540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:39.734540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:39.734540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:39.734540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:39.734540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:39.734540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:39.734540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:39.734540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:39.734540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:39.734540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:39.734540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:39.734540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:39.734540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:39.738457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:39.738457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:39.738457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:39.738457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:39.738457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:39.738457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:39.738457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:39.738457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:39.738457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:39.738457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:39.738457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:39.738457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:39.747395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 302/602] 10.222.0.71 () {56 vars in 1102 bytes} [Mon May 16 20:11:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:39.747395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c80cd9-dcb2-4fd7-bdda-15e6f75e776e None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:39.832506 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737095b3-e09c-4d6b-8957-f0092ad8116f None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:39.869039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1e163-bf44-4585-a392-784c4d87578d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:39.869915 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1e163-bf44-4585-a392-784c4d87578d None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:39.870176 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1e163-bf44-4585-a392-784c4d87578d None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:39.870466 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1e163-bf44-4585-a392-784c4d87578d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:39.882327 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1e163-bf44-4585-a392-784c4d87578d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:39.883822 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1e163-bf44-4585-a392-784c4d87578d None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:39.902705 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-09b1e163-bf44-4585-a392-784c4d87578d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:39.902705 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:39.902705 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:39.902705 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:39.902705 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:39.902705 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:39.902705 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:39.902705 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:39.902705 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:39.902705 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:39.902705 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:39.902705 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:39.902705 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:39.902705 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:39.902705 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:39.906158 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:39.906158 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:39.906158 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:39.906158 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:39.906158 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:39.906158 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:39.906158 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:39.906158 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:39.906158 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:39.906158 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:39.906158 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:39.906158 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:39.906158 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:39.906158 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:39.906158 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:39.906158 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:39.906158 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:39.913806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:39.913806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:39.913806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:39.913806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:39.913806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 301/603] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:39.913806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1e163-bf44-4585-a392-784c4d87578d None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:39.956877 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c80cd9-dcb2-4fd7-bdda-15e6f75e776e None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:40.010969 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1e163-bf44-4585-a392-784c4d87578d None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:40.023112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0889ce-abc6-486f-be23-59c546062430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:40.024628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0889ce-abc6-486f-be23-59c546062430 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:40.025120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0889ce-abc6-486f-be23-59c546062430 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:40.025699 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0889ce-abc6-486f-be23-59c546062430 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:40.040100 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0889ce-abc6-486f-be23-59c546062430 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:40.041613 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0889ce-abc6-486f-be23-59c546062430 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:40.057627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-4d0889ce-abc6-486f-be23-59c546062430 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:40.057627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:40.057627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:40.057627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:40.057627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:40.057627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:40.057627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:40.057627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:40.057627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:40.057627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:40.057627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:40.057627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:40.057627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:11:40.057627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:11:40.057627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:11:40.059905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:11:40.059905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:40.059905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:40.059905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:40.059905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:40.059905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:40.059905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:40.059905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:40.059905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:40.059905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:40.059905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:40.059905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:40.059905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:40.059905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:40.059905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:40.059905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:40.059905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:40.062110 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:11:40.062110 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:11:40.062110 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:11:40.062110 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:11:40.062110 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:11:40.062110 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:11:40.062110 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:40.062110 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:40.062110 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 303/604] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:40.062110 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0889ce-abc6-486f-be23-59c546062430 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:40.068654 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc601f-a816-4477-ac86-57206a54ba37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:40.068654 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc601f-a816-4477-ac86-57206a54ba37 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:40.068654 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc601f-a816-4477-ac86-57206a54ba37 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:40.068654 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc601f-a816-4477-ac86-57206a54ba37 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:40.069281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc601f-a816-4477-ac86-57206a54ba37 None admin] RBAC: Adding query filter params (name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:40.070148 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc601f-a816-4477-ac86-57206a54ba37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:40.078135 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc601f-a816-4477-ac86-57206a54ba37 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:40.089771 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 302/605] 10.222.0.71 () {56 vars in 1103 bytes} [Mon May 16 20:11:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:40.090661 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc601f-a816-4477-ac86-57206a54ba37 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:40.190081 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0889ce-abc6-486f-be23-59c546062430 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:40.220176 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc601f-a816-4477-ac86-57206a54ba37 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:40.226447 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce458a0-f989-4995-ad4f-aded145c43fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:40.227108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce458a0-f989-4995-ad4f-aded145c43fe None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:40.227381 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce458a0-f989-4995-ad4f-aded145c43fe None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:40.232542 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce458a0-f989-4995-ad4f-aded145c43fe None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:40.232542 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce458a0-f989-4995-ad4f-aded145c43fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:40.232542 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce458a0-f989-4995-ad4f-aded145c43fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:40.232542 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce458a0-f989-4995-ad4f-aded145c43fe None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:40.242344 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 304/606] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:40.243309 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce458a0-f989-4995-ad4f-aded145c43fe None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:40.250381 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aba75e-b800-41e3-804c-a2ac26a643ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:40.251044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aba75e-b800-41e3-804c-a2ac26a643ee None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:40.251323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aba75e-b800-41e3-804c-a2ac26a643ee None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:40.251597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aba75e-b800-41e3-804c-a2ac26a643ee None admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:40.253320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aba75e-b800-41e3-804c-a2ac26a643ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:40.253824 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aba75e-b800-41e3-804c-a2ac26a643ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:40.255396 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aba75e-b800-41e3-804c-a2ac26a643ee None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:40.269079 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 303/607] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:11:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:40.269998 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aba75e-b800-41e3-804c-a2ac26a643ee None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:40.347905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce458a0-f989-4995-ad4f-aded145c43fe None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:40.372888 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aba75e-b800-41e3-804c-a2ac26a643ee None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:40.386392 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dadb6c-8f86-4047-bf72-6cbaebe0f492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:40.387511 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dadb6c-8f86-4047-bf72-6cbaebe0f492 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:40.387953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dadb6c-8f86-4047-bf72-6cbaebe0f492 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:40.388340 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dadb6c-8f86-4047-bf72-6cbaebe0f492 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:40.402982 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dadb6c-8f86-4047-bf72-6cbaebe0f492 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:40.404775 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dadb6c-8f86-4047-bf72-6cbaebe0f492 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:40.410449 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f8239-3bb8-40d3-b7ec-f4e241029733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:40.411254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f8239-3bb8-40d3-b7ec-f4e241029733 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:40.411531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f8239-3bb8-40d3-b7ec-f4e241029733 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:40.411798 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f8239-3bb8-40d3-b7ec-f4e241029733 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:40.420069 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f8239-3bb8-40d3-b7ec-f4e241029733 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:40.421643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f8239-3bb8-40d3-b7ec-f4e241029733 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:40.426027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-92dadb6c-8f86-4047-bf72-6cbaebe0f492 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:40.426027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:40.426027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:40.426027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:40.426027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:40.426027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:40.426027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:40.426027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:40.426027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:40.426027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:40.426027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:40.426027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:40.426027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:40.426027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:40.426027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:40.428301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:40.428301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:40.428301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:40.428301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:40.428301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:40.428301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:40.428301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:40.428301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:40.428301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:40.428301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:40.428301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:40.428301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:40.428301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:40.428301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:40.428301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:40.428301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:40.428301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:40.430558 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:40.430558 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:40.430558 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:40.430558 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:40.430558 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 305/608] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:40.430558 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dadb6c-8f86-4047-bf72-6cbaebe0f492 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:40.442763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-e52f8239-3bb8-40d3-b7ec-f4e241029733 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:40.442763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:40.442763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:40.442763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:40.442763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:40.442763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:40.442763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:40.442763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:40.442763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:40.442763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:40.442763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:40.442763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:40.442763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:11:40.442763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:11:40.442763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:11:40.444901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:11:40.444901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:40.444901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:40.444901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:40.444901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:40.444901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:40.444901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:40.444901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:40.444901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:40.444901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:40.444901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:40.444901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:40.444901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:40.444901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:40.444901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:40.444901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:40.444901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:40.447174 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:11:40.447174 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:11:40.447174 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:11:40.447174 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:11:40.447174 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:11:40.447174 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:11:40.447174 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:40.447174 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:40.456186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 304/609] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:40.456186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f8239-3bb8-40d3-b7ec-f4e241029733 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:40.538421 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dadb6c-8f86-4047-bf72-6cbaebe0f492 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:40.565782 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f8239-3bb8-40d3-b7ec-f4e241029733 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:40.576104 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad1700-5511-4443-ac89-21b12aaf9a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:40.577048 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad1700-5511-4443-ac89-21b12aaf9a01 None admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:40.577324 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad1700-5511-4443-ac89-21b12aaf9a01 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:40.577598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad1700-5511-4443-ac89-21b12aaf9a01 None admin] PATH_INFO: `/v3/projects/121ed31a143d49b3a16ac6c5c6b28955/users/3c62c3f9351a4181a4fc2930570171b5/roles/bd4b3497427646f48a7c4d949e498ebc` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:40.594535 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad1700-5511-4443-ac89-21b12aaf9a01 None admin] RBAC: Authorizing `identity:create_grant(project_id=121ed31a143d49b3a16ac6c5c6b28955, user_id=3c62c3f9351a4181a4fc2930570171b5, role_id=bd4b3497427646f48a7c4d949e498ebc)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:40.596762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad1700-5511-4443-ac89-21b12aaf9a01 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:40.601086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6726a42-3f45-4102-ad4a-80413f16fcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:40.602017 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6726a42-3f45-4102-ad4a-80413f16fcbf None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:40.602298 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6726a42-3f45-4102-ad4a-80413f16fcbf None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:40.602766 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6726a42-3f45-4102-ad4a-80413f16fcbf None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:40.603658 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6726a42-3f45-4102-ad4a-80413f16fcbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:40.603968 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6726a42-3f45-4102-ad4a-80413f16fcbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:40.605777 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6726a42-3f45-4102-ad4a-80413f16fcbf None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:40.616084 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 306/610] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:11:40 2022] PUT /identity/v3/projects/121ed31a143d49b3a16ac6c5c6b28955/users/3c62c3f9351a4181a4fc2930570171b5/roles/bd4b3497427646f48a7c4d949e498ebc => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:11:40.617437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad1700-5511-4443-ac89-21b12aaf9a01 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:40.624785 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 305/611] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:40.625951 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6726a42-3f45-4102-ad4a-80413f16fcbf None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:40.730038 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad1700-5511-4443-ac89-21b12aaf9a01 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:40.730226 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6726a42-3f45-4102-ad4a-80413f16fcbf None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:40.768916 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7df3f-caf8-46e3-8bef-a2fbe2979d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:40.769722 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7ade2-7f90-41ef-a274-db167efe6c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:40.770270 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7df3f-caf8-46e3-8bef-a2fbe2979d7f None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:40.770742 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7df3f-caf8-46e3-8bef-a2fbe2979d7f None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:40.771072 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7ade2-7f90-41ef-a274-db167efe6c8d None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:40.771461 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7df3f-caf8-46e3-8bef-a2fbe2979d7f None admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:40.771578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7ade2-7f90-41ef-a274-db167efe6c8d None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:40.772005 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7ade2-7f90-41ef-a274-db167efe6c8d None admin] PATH_INFO: `/v3/users/swift` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:40.772792 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7df3f-caf8-46e3-8bef-a2fbe2979d7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:40.773701 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7df3f-caf8-46e3-8bef-a2fbe2979d7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:40.775424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7df3f-caf8-46e3-8bef-a2fbe2979d7f None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:40.780401 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7ade2-7f90-41ef-a274-db167efe6c8d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:40.781856 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7ade2-7f90-41ef-a274-db167efe6c8d None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:40.790592 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 307/612] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:11:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:40.801291 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7df3f-caf8-46e3-8bef-a2fbe2979d7f None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:40.804566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-c1e7ade2-7f90-41ef-a274-db167efe6c8d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 20:11:40.804566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:40.804566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:40.804566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:40.804566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:40.804566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:40.804566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:40.804566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:40.804566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:40.804566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:40.804566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:40.804566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:40.804566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:11:40.804566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:11:40.804566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:11:40.804566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:11:40.805574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:40.805574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:40.805574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:11:40.805574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:40.805574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:11:40.805574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:40.805574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:40.805574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:40.805574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:40.805574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:40.805574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:40.805574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:40.805574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:40.805574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:40.805574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:40.805574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:40.805574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:40.805574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:40.806545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:40.806545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:40.806545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:11:40.806545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:11:40.806545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:11:40.806545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:11:40.806545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:11:40.806545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:11:40.806545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 20:11:40.806545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:40.806545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 306/613] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:11:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:40.811570 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7ade2-7f90-41ef-a274-db167efe6c8d None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:40.923457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7df3f-caf8-46e3-8bef-a2fbe2979d7f None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:40.961105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db56e8-7849-488c-a540-1a9362d85af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:40.962976 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db56e8-7849-488c-a540-1a9362d85af7 None admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:40.963536 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db56e8-7849-488c-a540-1a9362d85af7 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:40.964024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db56e8-7849-488c-a540-1a9362d85af7 None admin] PATH_INFO: `/v3/projects/121ed31a143d49b3a16ac6c5c6b28955/users/eedc173e2cdc48b489ac40f3d9dccb7a/roles/bd4b3497427646f48a7c4d949e498ebc` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:40.976661 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7ade2-7f90-41ef-a274-db167efe6c8d None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:40.981045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db56e8-7849-488c-a540-1a9362d85af7 None admin] RBAC: Authorizing `identity:create_grant(project_id=121ed31a143d49b3a16ac6c5c6b28955, user_id=eedc173e2cdc48b489ac40f3d9dccb7a, role_id=bd4b3497427646f48a7c4d949e498ebc)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:40.982843 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db56e8-7849-488c-a540-1a9362d85af7 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:40.998581 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 308/614] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:11:40 2022] PUT /identity/v3/projects/121ed31a143d49b3a16ac6c5c6b28955/users/eedc173e2cdc48b489ac40f3d9dccb7a/roles/bd4b3497427646f48a7c4d949e498ebc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:11:41.021436 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2181414-5a9a-4008-9b14-4a6120e94e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:41.022137 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2181414-5a9a-4008-9b14-4a6120e94e50 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:41.022423 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2181414-5a9a-4008-9b14-4a6120e94e50 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:41.022704 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2181414-5a9a-4008-9b14-4a6120e94e50 None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:41.023593 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2181414-5a9a-4008-9b14-4a6120e94e50 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:41.023903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2181414-5a9a-4008-9b14-4a6120e94e50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:41.025455 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2181414-5a9a-4008-9b14-4a6120e94e50 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:41.048052 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 307/615] 10.222.0.71 () {56 vars in 1135 bytes} [Mon May 16 20:11:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:41.053618 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db56e8-7849-488c-a540-1a9362d85af7 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:41.222028 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db56e8-7849-488c-a540-1a9362d85af7 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:41.279701 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7797943-f37c-4529-b34a-6f5f273952a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:41.280552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7797943-f37c-4529-b34a-6f5f273952a8 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:41.280835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7797943-f37c-4529-b34a-6f5f273952a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:41.281113 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7797943-f37c-4529-b34a-6f5f273952a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:41.296861 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7797943-f37c-4529-b34a-6f5f273952a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:41.298381 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7797943-f37c-4529-b34a-6f5f273952a8 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:41.324484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-b7797943-f37c-4529-b34a-6f5f273952a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:41.324484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:41.324484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:41.324484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:41.324484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:41.324484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:41.324484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:41.324484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:41.324484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:41.324484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:41.324484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:41.324484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:41.324484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:41.324484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:41.324484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:41.326914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:41.326914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:41.326914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:41.326914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:41.326914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:41.326914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:41.326914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:41.326914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:41.326914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:41.326914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:41.326914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:41.326914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:41.326914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:41.326914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:41.326914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:41.326914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:41.326914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:41.328823 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:41.328823 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:41.328823 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:41.328823 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:41.328823 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 309/616] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:41.338538 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2181414-5a9a-4008-9b14-4a6120e94e50 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:41.529636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2181414-5a9a-4008-9b14-4a6120e94e50 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:41.577953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c468c6-293a-4401-b0d3-e13cfcae98ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:41.579020 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c468c6-293a-4401-b0d3-e13cfcae98ae None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:41.579512 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c468c6-293a-4401-b0d3-e13cfcae98ae None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:41.580065 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c468c6-293a-4401-b0d3-e13cfcae98ae None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:41.581540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c468c6-293a-4401-b0d3-e13cfcae98ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:41.582071 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c468c6-293a-4401-b0d3-e13cfcae98ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:41.583669 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c468c6-293a-4401-b0d3-e13cfcae98ae None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:41.598623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 308/617] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:41.603884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7797943-f37c-4529-b34a-6f5f273952a8 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:41.750467 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1a9ab-a5d2-4ffe-a271-ed7f64ede751 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:41.751193 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1a9ab-a5d2-4ffe-a271-ed7f64ede751 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:41.751698 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1a9ab-a5d2-4ffe-a271-ed7f64ede751 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:41.760041 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 309/618] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:11:41.768497 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f466c36-8576-4329-b262-c347a0e50e9e None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:41.769200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f466c36-8576-4329-b262-c347a0e50e9e None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:41.769741 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f466c36-8576-4329-b262-c347a0e50e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:41.785738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7797943-f37c-4529-b34a-6f5f273952a8 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:41.811033 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-0f466c36-8576-4329-b262-c347a0e50e9e None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:41.812638 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-0f466c36-8576-4329-b262-c347a0e50e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:41.823570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c89570-b9d5-45be-a3fb-6e5679d24edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:41.824529 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c89570-b9d5-45be-a3fb-6e5679d24edf None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:41.824661 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c89570-b9d5-45be-a3fb-6e5679d24edf None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:41.824946 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c89570-b9d5-45be-a3fb-6e5679d24edf None admin] PATH_INFO: `/v3/projects/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:41.833414 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c89570-b9d5-45be-a3fb-6e5679d24edf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:41.834824 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c89570-b9d5-45be-a3fb-6e5679d24edf None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:41.850018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-82c89570-b9d5-45be-a3fb-6e5679d24edf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:41.850018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:41.850018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:41.850018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:41.850018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:41.850018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:41.850018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:41.850018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:41.850018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:41.850018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:41.850018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:41.850018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:41.850018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:11:41.850018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:11:41.850018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:11:41.851019 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:11:41.851019 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:41.851019 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:41.851019 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:41.851019 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:41.851019 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:41.851019 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:41.851019 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:41.851019 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:41.851019 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:41.851019 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:41.851019 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:41.851019 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:41.851019 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:41.851019 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:41.851019 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:41.851019 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:41.853002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:11:41.853002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:11:41.853002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:11:41.853002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:11:41.853002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:11:41.853002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:11:41.853002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:41.853002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:41.856321 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 310/619] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:41.857859 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5b92f-1109-4d60-a3b5-6ee3ab01d398 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:41.858164 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5b92f-1109-4d60-a3b5-6ee3ab01d398 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:41.858435 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5b92f-1109-4d60-a3b5-6ee3ab01d398 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:41.860267 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 311/620] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:41.861059 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5b92f-1109-4d60-a3b5-6ee3ab01d398 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:41.899583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 310/621] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:41.901536 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c896c1-014a-41f0-ad76-2b32be9a6be6 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:41.902060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c896c1-014a-41f0-ad76-2b32be9a6be6 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:41.902550 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c896c1-014a-41f0-ad76-2b32be9a6be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:41.931427 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-f7c896c1-014a-41f0-ad76-2b32be9a6be6 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:41.932782 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f7c896c1-014a-41f0-ad76-2b32be9a6be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:41.975652 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5b92f-1109-4d60-a3b5-6ee3ab01d398 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:42.014159 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbc1ee-64e1-410d-b944-2b76b32e9dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:42.014590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 311/622] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:42.015727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c896c1-014a-41f0-ad76-2b32be9a6be6 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:42.016065 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbc1ee-64e1-410d-b944-2b76b32e9dde None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:42.016617 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbc1ee-64e1-410d-b944-2b76b32e9dde None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:42.017096 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbc1ee-64e1-410d-b944-2b76b32e9dde None admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:42.018693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbc1ee-64e1-410d-b944-2b76b32e9dde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:42.019258 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbc1ee-64e1-410d-b944-2b76b32e9dde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:42.021863 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbc1ee-64e1-410d-b944-2b76b32e9dde None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:42.042933 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 312/623] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:11:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:42.052363 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbc1ee-64e1-410d-b944-2b76b32e9dde None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:42.155559 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c896c1-014a-41f0-ad76-2b32be9a6be6 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:42.175346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbc1ee-64e1-410d-b944-2b76b32e9dde None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:42.193474 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0296a-d077-4672-9f08-b683299d6489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:42.194288 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0296a-d077-4672-9f08-b683299d6489 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:42.194572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0296a-d077-4672-9f08-b683299d6489 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:42.194846 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0296a-d077-4672-9f08-b683299d6489 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:42.208363 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0296a-d077-4672-9f08-b683299d6489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:42.218877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-84f0296a-d077-4672-9f08-b683299d6489 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:42.218877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:42.218877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:42.218877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:42.218877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:42.218877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:42.218877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:42.218877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:42.218877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:42.218877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:42.218877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:42.218877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:42.218877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:42.218877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:42.218877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:42.218877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:42.219891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:42.219891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:42.219891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:42.219891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:42.219891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:42.219891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:42.219891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:42.219891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:42.219891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:42.219891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:42.219891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:42.219891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:42.219891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:42.219891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:42.219891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:42.219891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:42.222840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:42.222840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:42.222840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:42.222840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:42.222840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:42.222840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:42.222840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:42.222840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:42.222840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:42.222840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:42.222840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:42.222840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:42.224553 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 312/624] 10.222.0.71 () {56 vars in 1102 bytes} [Mon May 16 20:11:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:42.225469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0296a-d077-4672-9f08-b683299d6489 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:42.227546 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcc8a7-1221-4ca6-acf2-f92228f0f236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:42.229209 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcc8a7-1221-4ca6-acf2-f92228f0f236 None admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:42.229947 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcc8a7-1221-4ca6-acf2-f92228f0f236 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:42.231385 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcc8a7-1221-4ca6-acf2-f92228f0f236 None admin] PATH_INFO: `/v3/projects/121ed31a143d49b3a16ac6c5c6b28955/users/7e701cf55d13410aa259ec72578ed27a/roles/bd4b3497427646f48a7c4d949e498ebc` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:42.257401 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcc8a7-1221-4ca6-acf2-f92228f0f236 None admin] RBAC: Authorizing `identity:create_grant(project_id=121ed31a143d49b3a16ac6c5c6b28955, user_id=7e701cf55d13410aa259ec72578ed27a, role_id=bd4b3497427646f48a7c4d949e498ebc)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:42.259971 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcc8a7-1221-4ca6-acf2-f92228f0f236 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:42.280448 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 313/625] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:11:42 2022] PUT /identity/v3/projects/121ed31a143d49b3a16ac6c5c6b28955/users/7e701cf55d13410aa259ec72578ed27a/roles/bd4b3497427646f48a7c4d949e498ebc => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:11:42.282256 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcc8a7-1221-4ca6-acf2-f92228f0f236 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:42.346464 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0296a-d077-4672-9f08-b683299d6489 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:42.384781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5652b7f-2695-46b4-931c-a4c9135a1c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:42.385628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5652b7f-2695-46b4-931c-a4c9135a1c95 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:42.385914 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5652b7f-2695-46b4-931c-a4c9135a1c95 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:42.386197 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5652b7f-2695-46b4-931c-a4c9135a1c95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:42.398795 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5652b7f-2695-46b4-931c-a4c9135a1c95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:42.406823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-f5652b7f-2695-46b4-931c-a4c9135a1c95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:42.406823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:42.406823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:42.406823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:42.406823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:42.406823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:42.406823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:42.406823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:42.406823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:42.406823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:42.406823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:42.406823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:42.406823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:42.406823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:42.406823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:42.406823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:42.407825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:42.407825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:42.407825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:42.407825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:42.407825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:42.407825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:42.407825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:42.407825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:42.407825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:42.407825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:42.407825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:42.407825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:42.407825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:42.407825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:42.407825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:42.407825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:42.409520 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:42.409520 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:42.409520 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:42.409520 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:42.409520 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:42.409520 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:42.409520 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:42.409520 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:42.409520 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:42.409520 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:42.409520 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:42.409520 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:42.409520 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 313/626] 10.222.0.71 () {56 vars in 1102 bytes} [Mon May 16 20:11:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:42.413802 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcc8a7-1221-4ca6-acf2-f92228f0f236 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:42.416300 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5652b7f-2695-46b4-931c-a4c9135a1c95 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:42.554928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97931e8-0e1b-4d27-bf73-a2fc590d70fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:42.556102 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97931e8-0e1b-4d27-bf73-a2fc590d70fa None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:42.556626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97931e8-0e1b-4d27-bf73-a2fc590d70fa None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:42.557106 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97931e8-0e1b-4d27-bf73-a2fc590d70fa None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:42.558342 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97931e8-0e1b-4d27-bf73-a2fc590d70fa None admin] RBAC: Adding query filter params (name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:42.558837 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97931e8-0e1b-4d27-bf73-a2fc590d70fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:42.561318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5652b7f-2695-46b4-931c-a4c9135a1c95 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:42.561565 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97931e8-0e1b-4d27-bf73-a2fc590d70fa None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:42.575862 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 314/627] 10.222.0.71 () {56 vars in 1103 bytes} [Mon May 16 20:11:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:42.586243 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97931e8-0e1b-4d27-bf73-a2fc590d70fa None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:42.616448 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce4959-0bd9-4b01-8b55-39126adb06f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:42.617217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce4959-0bd9-4b01-8b55-39126adb06f7 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:42.617663 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce4959-0bd9-4b01-8b55-39126adb06f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:42.618044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce4959-0bd9-4b01-8b55-39126adb06f7 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:42.618976 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce4959-0bd9-4b01-8b55-39126adb06f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:42.619397 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce4959-0bd9-4b01-8b55-39126adb06f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:42.621008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce4959-0bd9-4b01-8b55-39126adb06f7 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:42.632255 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 314/628] 10.222.0.71 () {56 vars in 1103 bytes} [Mon May 16 20:11:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:11:42.643201 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce4959-0bd9-4b01-8b55-39126adb06f7 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:42.746582 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97931e8-0e1b-4d27-bf73-a2fc590d70fa None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:42.833465 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03164513-dad2-4959-b19c-9a5c7f0d465c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:42.834772 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03164513-dad2-4959-b19c-9a5c7f0d465c None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:42.835238 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03164513-dad2-4959-b19c-9a5c7f0d465c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:42.835686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03164513-dad2-4959-b19c-9a5c7f0d465c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:42.854751 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03164513-dad2-4959-b19c-9a5c7f0d465c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:42.857724 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03164513-dad2-4959-b19c-9a5c7f0d465c None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:42.887818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-03164513-dad2-4959-b19c-9a5c7f0d465c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:42.887818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:42.887818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:42.887818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:42.887818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:42.887818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:42.887818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:42.887818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:42.887818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:42.887818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:42.887818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:42.887818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:42.887818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:42.887818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:42.887818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:42.889552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:42.889552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:42.889552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:42.889552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:42.889552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:42.889552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:42.889552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:42.889552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:42.889552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:42.889552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:42.889552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:42.889552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:42.889552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:42.889552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:42.889552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:42.889552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:42.889552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:42.891517 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:42.891517 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:42.891517 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:42.891517 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:42.896861 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce4959-0bd9-4b01-8b55-39126adb06f7 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:42.897235 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 315/629] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:42.902628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03164513-dad2-4959-b19c-9a5c7f0d465c None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:42.996463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25eb0f8-a67c-4b62-9a5b-1567ff57ae8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:42.998361 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25eb0f8-a67c-4b62-9a5b-1567ff57ae8d None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:42.999179 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25eb0f8-a67c-4b62-9a5b-1567ff57ae8d None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:42.999925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25eb0f8-a67c-4b62-9a5b-1567ff57ae8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:43.042085 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25eb0f8-a67c-4b62-9a5b-1567ff57ae8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:43.045259 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25eb0f8-a67c-4b62-9a5b-1567ff57ae8d None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:43.089866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-e25eb0f8-a67c-4b62-9a5b-1567ff57ae8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:43.089866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:43.089866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:43.089866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:43.089866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:43.089866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:43.089866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:43.089866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:43.089866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:43.089866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:43.089866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:43.089866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:43.089866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:43.089866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:43.089866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:43.092840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:43.092840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:43.092840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:43.092840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:43.092840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:43.092840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:43.092840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:43.092840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:43.092840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:43.092840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:43.092840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:43.092840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:43.092840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:43.092840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:43.092840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:43.092840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:43.092840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:43.095330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:43.095330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:43.095330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:43.095330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:43.095330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 315/630] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 450 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:43.104183 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25eb0f8-a67c-4b62-9a5b-1567ff57ae8d None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:43.104443 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03164513-dad2-4959-b19c-9a5c7f0d465c None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:43.166455 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e9f83-cbe0-4ff5-97fc-58517b33c07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:43.167187 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e9f83-cbe0-4ff5-97fc-58517b33c07b None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:43.167526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e9f83-cbe0-4ff5-97fc-58517b33c07b None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:43.167935 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e9f83-cbe0-4ff5-97fc-58517b33c07b None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:43.168969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e9f83-cbe0-4ff5-97fc-58517b33c07b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:43.169365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e9f83-cbe0-4ff5-97fc-58517b33c07b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:43.170967 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e9f83-cbe0-4ff5-97fc-58517b33c07b None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:43.203606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 316/631] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:11:43.210061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e9f83-cbe0-4ff5-97fc-58517b33c07b None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:43.330800 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25eb0f8-a67c-4b62-9a5b-1567ff57ae8d None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:43.371715 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cd54a-bbdf-4af8-903a-d202f77ea9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:43.372744 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cd54a-bbdf-4af8-903a-d202f77ea9a3 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:43.372744 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cd54a-bbdf-4af8-903a-d202f77ea9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:43.372988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cd54a-bbdf-4af8-903a-d202f77ea9a3 None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:43.376210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cd54a-bbdf-4af8-903a-d202f77ea9a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:43.376210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cd54a-bbdf-4af8-903a-d202f77ea9a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:43.376210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cd54a-bbdf-4af8-903a-d202f77ea9a3 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:43.380083 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e9f83-cbe0-4ff5-97fc-58517b33c07b None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:43.398024 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 316/632] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:43.404831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cd54a-bbdf-4af8-903a-d202f77ea9a3 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:43.425207 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c574e6-8c15-4c0b-afa0-472052bbd721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:43.425930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c574e6-8c15-4c0b-afa0-472052bbd721 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:43.426216 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c574e6-8c15-4c0b-afa0-472052bbd721 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:43.426468 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c574e6-8c15-4c0b-afa0-472052bbd721 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:43.434946 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c574e6-8c15-4c0b-afa0-472052bbd721 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:43.436500 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c574e6-8c15-4c0b-afa0-472052bbd721 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:43.453188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-16c574e6-8c15-4c0b-afa0-472052bbd721 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 20:11:43.453188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:43.453188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:43.453188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:43.453188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:43.453188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:43.453188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:43.453188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:43.453188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:43.453188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:43.453188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:43.453188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:43.453188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:11:43.453188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:11:43.453188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:11:43.453188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:11:43.456929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:43.456929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:43.456929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:11:43.456929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:43.456929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:11:43.456929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:43.456929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:43.456929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:43.456929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:43.456929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:43.456929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:43.456929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:43.456929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:43.456929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:43.456929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:43.456929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:43.456929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:43.456929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:43.464611 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:43.464611 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:43.464611 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:11:43.464611 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:11:43.464611 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:11:43.464611 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:11:43.464611 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:11:43.464611 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:11:43.464611 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 20:11:43.464611 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:43.464611 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 317/633] 10.222.0.71 () {56 vars in 1093 bytes} [Mon May 16 20:11:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:43.464611 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c574e6-8c15-4c0b-afa0-472052bbd721 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:43.596188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c574e6-8c15-4c0b-afa0-472052bbd721 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:43.657794 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60368b4e-2f17-41a8-afd6-3431c2153467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:43.659225 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60368b4e-2f17-41a8-afd6-3431c2153467 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:43.659605 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60368b4e-2f17-41a8-afd6-3431c2153467 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:43.659886 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60368b4e-2f17-41a8-afd6-3431c2153467 None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:43.660654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60368b4e-2f17-41a8-afd6-3431c2153467 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:43.660963 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60368b4e-2f17-41a8-afd6-3431c2153467 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:43.662419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60368b4e-2f17-41a8-afd6-3431c2153467 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:43.667663 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cd54a-bbdf-4af8-903a-d202f77ea9a3 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:43.716280 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 318/634] 10.222.0.71 () {56 vars in 1133 bytes} [Mon May 16 20:11:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:43.724399 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8fb9f-fd9a-4bae-94bc-2c6dde5a7ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:43.725311 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8fb9f-fd9a-4bae-94bc-2c6dde5a7ed0 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:43.725597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8fb9f-fd9a-4bae-94bc-2c6dde5a7ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:43.725875 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8fb9f-fd9a-4bae-94bc-2c6dde5a7ed0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:43.733889 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8fb9f-fd9a-4bae-94bc-2c6dde5a7ed0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:43.735583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8fb9f-fd9a-4bae-94bc-2c6dde5a7ed0 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:43.739020 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60368b4e-2f17-41a8-afd6-3431c2153467 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:43.756042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-83c8fb9f-fd9a-4bae-94bc-2c6dde5a7ed0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 20:11:43.756042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:43.756042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:43.756042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:43.756042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:43.756042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:43.756042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:43.756042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:43.756042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:43.756042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:43.756042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:43.756042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:43.756042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:11:43.756042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:11:43.756042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:11:43.756042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:11:43.762727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:43.762727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:43.762727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:11:43.762727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:43.762727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:11:43.762727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:43.762727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:43.762727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:43.762727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:43.762727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:43.762727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:43.762727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:43.762727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:43.762727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:43.762727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:43.762727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:43.762727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:43.762727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:43.764491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:43.764491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:43.764491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:11:43.764491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:11:43.764491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:11:43.764491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:11:43.764491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:11:43.764491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:11:43.764491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 20:11:43.764491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:43.764491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 317/635] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:11:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:43.764491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8fb9f-fd9a-4bae-94bc-2c6dde5a7ed0 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:43.894109 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8fb9f-fd9a-4bae-94bc-2c6dde5a7ed0 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:43.941212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12178aca-a2a5-46d8-b894-0d32fef69d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:43.941909 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12178aca-a2a5-46d8-b894-0d32fef69d9f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:43.942381 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12178aca-a2a5-46d8-b894-0d32fef69d9f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:43.942672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12178aca-a2a5-46d8-b894-0d32fef69d9f None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:43.943540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12178aca-a2a5-46d8-b894-0d32fef69d9f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:43.943853 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12178aca-a2a5-46d8-b894-0d32fef69d9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:43.945366 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12178aca-a2a5-46d8-b894-0d32fef69d9f None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:43.968821 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 318/636] 10.222.0.71 () {56 vars in 1137 bytes} [Mon May 16 20:11:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:43.977091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12178aca-a2a5-46d8-b894-0d32fef69d9f None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:44.048186 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60368b4e-2f17-41a8-afd6-3431c2153467 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:44.098465 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12178aca-a2a5-46d8-b894-0d32fef69d9f None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:44.148653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f82e3-677d-4b2a-b19c-47a5b16b9d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:44.149799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f82e3-677d-4b2a-b19c-47a5b16b9d77 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:44.150463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f82e3-677d-4b2a-b19c-47a5b16b9d77 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:44.151039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f82e3-677d-4b2a-b19c-47a5b16b9d77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:44.157058 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cacb2-fd54-4f6a-ab09-849f45225f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:44.157762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cacb2-fd54-4f6a-ab09-849f45225f36 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:44.158703 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cacb2-fd54-4f6a-ab09-849f45225f36 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:44.159135 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cacb2-fd54-4f6a-ab09-849f45225f36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:44.238889 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f82e3-677d-4b2a-b19c-47a5b16b9d77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:44.241663 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f82e3-677d-4b2a-b19c-47a5b16b9d77 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:44.283935 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cacb2-fd54-4f6a-ab09-849f45225f36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:44.285687 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cacb2-fd54-4f6a-ab09-849f45225f36 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:44.393504 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 319/637] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:11:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 20:11:44.394691 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543b3a5-cb35-4fdc-8a87-af9ee8d27386 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:44.394849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543b3a5-cb35-4fdc-8a87-af9ee8d27386 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:44.395133 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543b3a5-cb35-4fdc-8a87-af9ee8d27386 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:44.396475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 320/638] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:44.400394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07d875-532f-4f8b-ac65-434e347e1c83 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:44.401235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07d875-532f-4f8b-ac65-434e347e1c83 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:44.401794 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07d875-532f-4f8b-ac65-434e347e1c83 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:44.404092 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 321/639] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:44.409681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07d875-532f-4f8b-ac65-434e347e1c83 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:44.435259 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 319/640] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:11:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 20:11:44.437130 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67539297-9900-4f40-ab4c-0fa9a8c6fb4a None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:44.437621 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67539297-9900-4f40-ab4c-0fa9a8c6fb4a None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:44.438062 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67539297-9900-4f40-ab4c-0fa9a8c6fb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:44.456773 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-67539297-9900-4f40-ab4c-0fa9a8c6fb4a None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:44.462237 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-67539297-9900-4f40-ab4c-0fa9a8c6fb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:44.535361 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07d875-532f-4f8b-ac65-434e347e1c83 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:44.572182 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22009f-fed3-44f3-af28-0e96625b74d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:44.573490 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 320/641] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:44.573641 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22009f-fed3-44f3-af28-0e96625b74d8 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:44.574212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22009f-fed3-44f3-af28-0e96625b74d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:44.574798 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22009f-fed3-44f3-af28-0e96625b74d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:44.575648 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd898b3-ec8c-4c93-b312-3332354fca13 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:44.576113 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd898b3-ec8c-4c93-b312-3332354fca13 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:44.576634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd898b3-ec8c-4c93-b312-3332354fca13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:44.594794 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-2bd898b3-ec8c-4c93-b312-3332354fca13 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:44.596580 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-2bd898b3-ec8c-4c93-b312-3332354fca13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:44.601246 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22009f-fed3-44f3-af28-0e96625b74d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:44.603035 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22009f-fed3-44f3-af28-0e96625b74d8 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:44.629821 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-bc22009f-fed3-44f3-af28-0e96625b74d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:44.629821 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:44.629821 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:44.629821 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:44.629821 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:44.629821 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:44.629821 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:44.629821 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:44.629821 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:44.629821 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:44.629821 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:44.629821 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:44.629821 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:44.629821 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:44.629821 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:44.630807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:44.630807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:44.630807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:44.630807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:44.630807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:44.630807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:44.630807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:44.630807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:44.630807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:44.630807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:44.630807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:44.630807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:44.630807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:44.630807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:44.630807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:44.630807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:44.630807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:44.633377 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:44.633377 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:44.633377 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:44.633377 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:44.633377 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 322/642] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:44.633377 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22009f-fed3-44f3-af28-0e96625b74d8 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:44.684200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 321/643] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:44.684200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd898b3-ec8c-4c93-b312-3332354fca13 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:44.742533 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22009f-fed3-44f3-af28-0e96625b74d8 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:44.782132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942ad92-b1ea-4ce7-9dd9-de44a0d9809f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:44.792411 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942ad92-b1ea-4ce7-9dd9-de44a0d9809f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:44.792411 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942ad92-b1ea-4ce7-9dd9-de44a0d9809f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:44.792411 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942ad92-b1ea-4ce7-9dd9-de44a0d9809f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:44.798746 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942ad92-b1ea-4ce7-9dd9-de44a0d9809f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:44.800329 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942ad92-b1ea-4ce7-9dd9-de44a0d9809f None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:44.814757 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd898b3-ec8c-4c93-b312-3332354fca13 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:44.822702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-a942ad92-b1ea-4ce7-9dd9-de44a0d9809f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:44.822702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:44.822702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:44.822702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:44.822702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:44.822702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:44.822702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:44.822702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:44.822702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:44.822702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:44.822702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:44.822702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:44.822702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:44.822702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:44.822702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:44.824929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:44.824929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:44.824929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:44.824929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:44.824929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:44.824929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:44.824929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:44.824929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:44.824929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:44.824929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:44.824929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:44.824929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:44.824929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:44.824929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:44.824929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:44.824929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:44.824929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:44.826086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:44.826086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:44.826086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:44.826086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:44.826086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 323/644] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:44.826086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942ad92-b1ea-4ce7-9dd9-de44a0d9809f None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:44.869740 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74248d58-b40a-4f15-8404-7d2dc03b1d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:44.871035 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74248d58-b40a-4f15-8404-7d2dc03b1d7f None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:44.871509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74248d58-b40a-4f15-8404-7d2dc03b1d7f None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:44.871976 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74248d58-b40a-4f15-8404-7d2dc03b1d7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:44.890891 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74248d58-b40a-4f15-8404-7d2dc03b1d7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:44.900057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-74248d58-b40a-4f15-8404-7d2dc03b1d7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:44.900057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:44.900057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:44.900057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:44.900057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:44.900057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:44.900057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:44.900057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:44.900057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:44.900057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:44.900057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:44.900057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:44.900057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:44.900057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:44.900057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:44.900057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:44.901295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:44.901295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:44.901295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:44.901295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:44.901295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:44.901295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:44.901295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:44.901295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:44.901295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:44.901295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:44.901295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:44.901295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:44.901295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:44.901295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:44.901295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:44.901295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:44.902337 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:44.902337 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:44.902337 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:44.902337 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:44.902337 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:44.902337 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:44.902337 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:44.902337 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:44.902337 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:44.902337 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:44.902337 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:44.902337 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:44.902337 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 322/645] 10.222.0.71 () {56 vars in 1102 bytes} [Mon May 16 20:11:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:44.902337 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74248d58-b40a-4f15-8404-7d2dc03b1d7f None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:44.963988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942ad92-b1ea-4ce7-9dd9-de44a0d9809f None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:45.005681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41974782-689f-4703-a387-6cfba30fc656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:45.006388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41974782-689f-4703-a387-6cfba30fc656 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:45.006644 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41974782-689f-4703-a387-6cfba30fc656 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:45.006978 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41974782-689f-4703-a387-6cfba30fc656 None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:45.007812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41974782-689f-4703-a387-6cfba30fc656 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:45.008213 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41974782-689f-4703-a387-6cfba30fc656 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:45.009798 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41974782-689f-4703-a387-6cfba30fc656 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:45.022851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74248d58-b40a-4f15-8404-7d2dc03b1d7f None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:45.023113 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 324/646] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:45.023777 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41974782-689f-4703-a387-6cfba30fc656 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:45.074758 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697cf6b-19af-4ef8-8542-a3adf244c3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:45.075667 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697cf6b-19af-4ef8-8542-a3adf244c3cd None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:45.075956 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697cf6b-19af-4ef8-8542-a3adf244c3cd None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:45.076277 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697cf6b-19af-4ef8-8542-a3adf244c3cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:45.094473 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697cf6b-19af-4ef8-8542-a3adf244c3cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:45.109214 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-5697cf6b-19af-4ef8-8542-a3adf244c3cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:45.109214 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:45.109214 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:45.109214 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:45.109214 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:45.109214 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:45.109214 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:45.109214 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:45.109214 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:45.109214 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:45.109214 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:45.109214 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:45.109214 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:45.109214 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:45.109214 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:45.109214 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:45.110211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:45.110211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:45.110211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:45.110211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:45.110211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:45.110211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:45.110211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:45.110211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:45.110211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:45.110211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:45.110211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:45.110211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:45.110211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:45.110211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:45.110211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:45.110211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:45.111585 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:45.111585 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:45.111585 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:45.111585 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:45.111585 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:45.111585 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:45.111585 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:45.111585 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:45.111585 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:45.111585 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:45.111585 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:45.111585 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:45.117808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 323/647] 10.222.0.71 () {56 vars in 1102 bytes} [Mon May 16 20:11:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:45.117808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697cf6b-19af-4ef8-8542-a3adf244c3cd None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:45.165068 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41974782-689f-4703-a387-6cfba30fc656 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:45.222767 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70d318-20a5-4e55-8061-f2262588da91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:45.223448 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70d318-20a5-4e55-8061-f2262588da91 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:45.223732 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70d318-20a5-4e55-8061-f2262588da91 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:45.224008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70d318-20a5-4e55-8061-f2262588da91 None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:45.233626 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70d318-20a5-4e55-8061-f2262588da91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:45.234033 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70d318-20a5-4e55-8061-f2262588da91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:45.235363 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70d318-20a5-4e55-8061-f2262588da91 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:45.258914 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 325/648] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:45.258914 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70d318-20a5-4e55-8061-f2262588da91 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:45.270990 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697cf6b-19af-4ef8-8542-a3adf244c3cd None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:45.311084 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18469b-8c49-4703-8d0a-5b5bc338501d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:45.311757 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18469b-8c49-4703-8d0a-5b5bc338501d None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:45.312036 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18469b-8c49-4703-8d0a-5b5bc338501d None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:45.312347 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18469b-8c49-4703-8d0a-5b5bc338501d None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:45.313087 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18469b-8c49-4703-8d0a-5b5bc338501d None admin] RBAC: Adding query filter params (name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:45.313389 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18469b-8c49-4703-8d0a-5b5bc338501d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:45.315387 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18469b-8c49-4703-8d0a-5b5bc338501d None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:45.328439 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 324/649] 10.222.0.71 () {56 vars in 1103 bytes} [Mon May 16 20:11:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:45.329485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18469b-8c49-4703-8d0a-5b5bc338501d None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:45.383287 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70d318-20a5-4e55-8061-f2262588da91 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:45.425561 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4b158-df82-41c0-865e-f0f9c3846abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:45.426359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4b158-df82-41c0-865e-f0f9c3846abe None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:45.426644 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4b158-df82-41c0-865e-f0f9c3846abe None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:45.426916 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4b158-df82-41c0-865e-f0f9c3846abe None admin] PATH_INFO: `/v3/projects/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:45.434844 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4b158-df82-41c0-865e-f0f9c3846abe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:45.436334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4b158-df82-41c0-865e-f0f9c3846abe None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:45.450688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18469b-8c49-4703-8d0a-5b5bc338501d None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:45.451088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-96c4b158-df82-41c0-865e-f0f9c3846abe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:45.451088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:45.451088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:45.451088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:45.451088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:45.451088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:45.451088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:45.451088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:45.451088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:45.451088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:45.451088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:45.451088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:45.451088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:11:45.451088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:11:45.451088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:11:45.452322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:11:45.452322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:45.452322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:45.452322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:45.452322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:45.452322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:45.452322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:45.452322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:45.452322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:45.452322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:45.452322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:45.452322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:45.452322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:45.452322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:45.452322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:45.452322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:45.452322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:45.453235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:11:45.453235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:11:45.453235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:11:45.453235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:11:45.453235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:11:45.453235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:11:45.453235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:45.453235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:45.453235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 326/650] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:45.453726 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4b158-df82-41c0-865e-f0f9c3846abe None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:45.495540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1803f-81c4-4f11-a94f-7387b477bfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:45.496242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1803f-81c4-4f11-a94f-7387b477bfd4 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:45.496517 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1803f-81c4-4f11-a94f-7387b477bfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:45.496791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1803f-81c4-4f11-a94f-7387b477bfd4 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:45.497569 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1803f-81c4-4f11-a94f-7387b477bfd4 None admin] RBAC: Adding query filter params (name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:45.497875 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1803f-81c4-4f11-a94f-7387b477bfd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:45.499258 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1803f-81c4-4f11-a94f-7387b477bfd4 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:45.508121 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 325/651] 10.222.0.71 () {56 vars in 1103 bytes} [Mon May 16 20:11:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:45.508992 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1803f-81c4-4f11-a94f-7387b477bfd4 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:45.588614 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4b158-df82-41c0-865e-f0f9c3846abe None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:45.622305 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1803f-81c4-4f11-a94f-7387b477bfd4 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:45.624218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7ef6f-bfc6-4aa4-9793-f3d3a73147d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:45.625014 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7ef6f-bfc6-4aa4-9793-f3d3a73147d7 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:45.625289 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7ef6f-bfc6-4aa4-9793-f3d3a73147d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:45.625568 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7ef6f-bfc6-4aa4-9793-f3d3a73147d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:45.633093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7ef6f-bfc6-4aa4-9793-f3d3a73147d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:45.634534 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7ef6f-bfc6-4aa4-9793-f3d3a73147d7 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:45.650758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-6eb7ef6f-bfc6-4aa4-9793-f3d3a73147d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:45.650758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:45.650758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:45.650758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:45.650758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:45.650758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:45.650758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:45.650758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:45.650758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:45.650758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:45.650758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:45.650758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:45.650758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:11:45.650758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:11:45.650758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:11:45.652388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:11:45.652388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:45.652388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:45.652388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:45.652388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:45.652388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:45.652388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:45.652388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:45.652388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:45.652388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:45.652388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:45.652388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:45.652388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:45.652388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:45.652388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:45.652388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:45.652388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:45.653818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:11:45.653818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:11:45.653818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:11:45.653818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:11:45.653818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:11:45.653818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:11:45.653818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:45.653818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:45.653818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 327/652] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:45.653818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7ef6f-bfc6-4aa4-9793-f3d3a73147d7 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:45.665882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfbfcc-4d17-468c-aa8a-0660e50b6169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:45.667196 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfbfcc-4d17-468c-aa8a-0660e50b6169 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:45.667671 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfbfcc-4d17-468c-aa8a-0660e50b6169 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:45.668132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfbfcc-4d17-468c-aa8a-0660e50b6169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:45.682361 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfbfcc-4d17-468c-aa8a-0660e50b6169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:45.683855 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfbfcc-4d17-468c-aa8a-0660e50b6169 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:45.709333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-f9dfbfcc-4d17-468c-aa8a-0660e50b6169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:45.709333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:45.709333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:45.709333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:45.709333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:45.709333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:45.709333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:45.709333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:45.709333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:45.709333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:45.709333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:45.709333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:45.709333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:45.709333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:45.709333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:45.711123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:45.711123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:45.711123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:45.711123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:45.711123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:45.711123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:45.711123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:45.711123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:45.711123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:45.711123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:45.711123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:45.711123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:45.711123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:45.711123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:45.711123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:45.711123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:45.711123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:45.712866 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:45.712866 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:45.712866 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:45.712866 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:45.712866 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 326/653] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:45.712866 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9421d-88a3-422c-950a-ec2b60148e79 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:45.712866 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9421d-88a3-422c-950a-ec2b60148e79 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:45.712866 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9421d-88a3-422c-950a-ec2b60148e79 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:45.714158 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 327/654] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:45.714733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9421d-88a3-422c-950a-ec2b60148e79 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:45.765691 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7ef6f-bfc6-4aa4-9793-f3d3a73147d7 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:45.799613 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9346a6-8973-485d-825e-b43a4b2c39f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:45.800299 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9346a6-8973-485d-825e-b43a4b2c39f7 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:45.800578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9346a6-8973-485d-825e-b43a4b2c39f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:45.800848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9346a6-8973-485d-825e-b43a4b2c39f7 None admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:45.801626 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9346a6-8973-485d-825e-b43a4b2c39f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:45.801931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9346a6-8973-485d-825e-b43a4b2c39f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:45.803375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9346a6-8973-485d-825e-b43a4b2c39f7 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:45.817944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 328/655] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:11:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:45.818555 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9346a6-8973-485d-825e-b43a4b2c39f7 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:45.823442 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9421d-88a3-422c-950a-ec2b60148e79 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:45.861263 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81b8f8-2d5e-49de-a375-e4df7180ccfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:45.862229 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81b8f8-2d5e-49de-a375-e4df7180ccfb None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:45.862514 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81b8f8-2d5e-49de-a375-e4df7180ccfb None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:45.862919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81b8f8-2d5e-49de-a375-e4df7180ccfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:45.874742 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81b8f8-2d5e-49de-a375-e4df7180ccfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:45.876228 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81b8f8-2d5e-49de-a375-e4df7180ccfb None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:45.895107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-fe81b8f8-2d5e-49de-a375-e4df7180ccfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:45.895107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:45.895107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:45.895107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:45.895107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:45.895107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:45.895107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:45.895107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:45.895107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:45.895107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:45.895107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:45.895107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:45.895107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:45.895107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:45.895107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:45.896190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:45.896190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:45.896190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:45.896190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:45.896190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:45.896190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:45.896190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:45.896190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:45.896190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:45.896190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:45.896190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:45.896190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:45.896190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:45.896190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:45.896190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:45.896190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:45.896190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:45.897577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:45.897577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:45.897577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:45.897577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:45.897577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 328/656] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:45.897577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81b8f8-2d5e-49de-a375-e4df7180ccfb None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:45.928409 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9346a6-8973-485d-825e-b43a4b2c39f7 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:45.963384 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82cbbc-684b-430d-95e0-04f175b9ca1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:45.964261 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82cbbc-684b-430d-95e0-04f175b9ca1e None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:45.964645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82cbbc-684b-430d-95e0-04f175b9ca1e None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:45.965020 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82cbbc-684b-430d-95e0-04f175b9ca1e None admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:45.965933 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82cbbc-684b-430d-95e0-04f175b9ca1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:45.966354 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82cbbc-684b-430d-95e0-04f175b9ca1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:45.967899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82cbbc-684b-430d-95e0-04f175b9ca1e None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:45.980866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 329/657] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:11:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:45.982177 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb226c80-bfed-4f2b-b61b-25f24db5b0d7 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:45.982468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb226c80-bfed-4f2b-b61b-25f24db5b0d7 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:45.982742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb226c80-bfed-4f2b-b61b-25f24db5b0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:46.002933 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-cb226c80-bfed-4f2b-b61b-25f24db5b0d7 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:46.004186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-cb226c80-bfed-4f2b-b61b-25f24db5b0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:46.011929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81b8f8-2d5e-49de-a375-e4df7180ccfb None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:46.046863 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c5fab-df17-4fbe-a90b-31f5a3b44c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:46.047521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c5fab-df17-4fbe-a90b-31f5a3b44c74 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:46.047798 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c5fab-df17-4fbe-a90b-31f5a3b44c74 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:46.048062 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c5fab-df17-4fbe-a90b-31f5a3b44c74 None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:46.048905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c5fab-df17-4fbe-a90b-31f5a3b44c74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:46.049199 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c5fab-df17-4fbe-a90b-31f5a3b44c74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:46.050693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c5fab-df17-4fbe-a90b-31f5a3b44c74 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:46.062663 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 329/658] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:46.063498 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c5fab-df17-4fbe-a90b-31f5a3b44c74 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:46.085015 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 330/659] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:46.086307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb226c80-bfed-4f2b-b61b-25f24db5b0d7 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:46.182426 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c5fab-df17-4fbe-a90b-31f5a3b44c74 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:46.196550 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb226c80-bfed-4f2b-b61b-25f24db5b0d7 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:46.229787 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83336f61-d59b-4c92-9a62-a0648fdd2fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:46.230809 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83336f61-d59b-4c92-9a62-a0648fdd2fae None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:46.231250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83336f61-d59b-4c92-9a62-a0648fdd2fae None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:46.231663 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83336f61-d59b-4c92-9a62-a0648fdd2fae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:46.233135 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83336f61-d59b-4c92-9a62-a0648fdd2fae None admin] RBAC: Adding query filter params (role.id=bd4b3497427646f48a7c4d949e498ebc, scope.project.id=121ed31a143d49b3a16ac6c5c6b28955, user.id=89f45690463c48ad8e95c167be6fc9fc) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:46.233799 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83336f61-d59b-4c92-9a62-a0648fdd2fae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:46.235233 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83336f61-d59b-4c92-9a62-a0648fdd2fae None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:46.241965 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 330/660] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:11:46 2022] GET /identity/v3/role_assignments?user.id=89f45690463c48ad8e95c167be6fc9fc&scope.project.id=121ed31a143d49b3a16ac6c5c6b28955&role.id=bd4b3497427646f48a7c4d949e498ebc => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:46.242769 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83336f61-d59b-4c92-9a62-a0648fdd2fae None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:46.247244 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ab514-6b9a-4ff1-a526-a2f7ca32858d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:46.248346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ab514-6b9a-4ff1-a526-a2f7ca32858d None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:46.248796 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ab514-6b9a-4ff1-a526-a2f7ca32858d None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:46.249234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ab514-6b9a-4ff1-a526-a2f7ca32858d None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:46.250456 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ab514-6b9a-4ff1-a526-a2f7ca32858d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:46.250948 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ab514-6b9a-4ff1-a526-a2f7ca32858d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:46.253987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ab514-6b9a-4ff1-a526-a2f7ca32858d None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:46.277295 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 331/661] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:46.278560 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ab514-6b9a-4ff1-a526-a2f7ca32858d None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:46.384587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83336f61-d59b-4c92-9a62-a0648fdd2fae None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:46.425264 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbdeee-90b0-42f1-9bd9-5bb0861a912b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:46.425934 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbdeee-90b0-42f1-9bd9-5bb0861a912b None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:46.426218 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbdeee-90b0-42f1-9bd9-5bb0861a912b None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:46.426488 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbdeee-90b0-42f1-9bd9-5bb0861a912b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:46.427347 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbdeee-90b0-42f1-9bd9-5bb0861a912b None admin] RBAC: Adding query filter params (role.id=bd4b3497427646f48a7c4d949e498ebc, scope.project.id=121ed31a143d49b3a16ac6c5c6b28955, user.id=242d4f9634a74013af05f50981280864) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:46.427654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbdeee-90b0-42f1-9bd9-5bb0861a912b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:46.429224 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbdeee-90b0-42f1-9bd9-5bb0861a912b None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:46.437918 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ab514-6b9a-4ff1-a526-a2f7ca32858d None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:46.438718 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 331/662] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:11:46 2022] GET /identity/v3/role_assignments?user.id=242d4f9634a74013af05f50981280864&scope.project.id=121ed31a143d49b3a16ac6c5c6b28955&role.id=bd4b3497427646f48a7c4d949e498ebc => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:46.439264 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbdeee-90b0-42f1-9bd9-5bb0861a912b None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:46.488857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6cc0b-c10c-4d30-9bba-a23bd9a31723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:46.490066 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6cc0b-c10c-4d30-9bba-a23bd9a31723 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:46.490567 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6cc0b-c10c-4d30-9bba-a23bd9a31723 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:46.490917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6cc0b-c10c-4d30-9bba-a23bd9a31723 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:46.502996 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6cc0b-c10c-4d30-9bba-a23bd9a31723 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:46.505195 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6cc0b-c10c-4d30-9bba-a23bd9a31723 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:46.521239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-fbe6cc0b-c10c-4d30-9bba-a23bd9a31723 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 20:11:46.521239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:46.521239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:46.521239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:46.521239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:46.521239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:46.521239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:46.521239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:46.521239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:46.521239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:46.521239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:46.521239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:46.521239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:11:46.521239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:11:46.521239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:11:46.521239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:11:46.522306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:46.522306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:46.522306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:11:46.522306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:46.522306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:11:46.522306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:46.522306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:46.522306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:46.522306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:46.522306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:46.522306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:46.522306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:46.522306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:46.522306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:46.522306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:46.522306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:46.522306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:46.522306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:46.523278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:46.523278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:46.523278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:11:46.523278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:11:46.523278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:11:46.523278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:11:46.523278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:11:46.523278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:11:46.523278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 20:11:46.523278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:46.527536 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 332/663] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:11:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:46.528575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6cc0b-c10c-4d30-9bba-a23bd9a31723 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:46.614033 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbdeee-90b0-42f1-9bd9-5bb0861a912b None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:46.664443 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea468a-6ba6-4636-b680-2ad1586cbd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:46.666172 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea468a-6ba6-4636-b680-2ad1586cbd78 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:46.666701 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea468a-6ba6-4636-b680-2ad1586cbd78 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:46.667196 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea468a-6ba6-4636-b680-2ad1586cbd78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:46.676143 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6cc0b-c10c-4d30-9bba-a23bd9a31723 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:46.680849 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea468a-6ba6-4636-b680-2ad1586cbd78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:46.688902 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-55ea468a-6ba6-4636-b680-2ad1586cbd78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:46.688902 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:46.688902 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:46.688902 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:46.688902 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:46.688902 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:46.688902 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:46.688902 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:46.688902 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:46.688902 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:46.688902 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:46.688902 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:46.688902 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:46.688902 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:46.688902 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:46.688902 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:46.691276 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:46.691276 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:46.691276 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:46.691276 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:46.691276 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:46.691276 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:46.691276 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:46.691276 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:46.691276 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:46.691276 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:46.691276 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:46.691276 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:46.691276 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:46.691276 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:46.691276 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:46.691276 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:46.692234 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:46.692234 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:46.692234 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:46.692234 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:46.692234 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:46.692234 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:46.692234 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:46.692234 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:46.692234 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:46.692234 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:46.692234 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:46.692234 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:46.692234 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 332/664] 10.222.0.71 () {56 vars in 1102 bytes} [Mon May 16 20:11:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:46.692234 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea468a-6ba6-4636-b680-2ad1586cbd78 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:46.733479 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fc78b-a19f-4126-96f6-985fc6f52690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:46.734464 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fc78b-a19f-4126-96f6-985fc6f52690 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:46.734580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fc78b-a19f-4126-96f6-985fc6f52690 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:46.734827 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fc78b-a19f-4126-96f6-985fc6f52690 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:46.745539 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fc78b-a19f-4126-96f6-985fc6f52690 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:46.747076 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fc78b-a19f-4126-96f6-985fc6f52690 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:46.773490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-6b7fc78b-a19f-4126-96f6-985fc6f52690 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 20:11:46.773490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:46.773490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:46.773490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:46.773490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:46.773490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:46.773490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:46.773490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:46.773490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:46.773490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:46.773490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:46.773490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:46.773490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:11:46.773490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:11:46.773490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:11:46.773490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:11:46.775234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:46.775234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:46.775234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:11:46.775234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:46.775234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:11:46.775234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:46.775234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:46.775234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:46.775234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:46.775234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:46.775234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:46.775234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:46.775234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:46.775234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:46.775234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:46.775234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:46.775234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:46.775234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:46.777031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:46.777031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:46.777031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:11:46.777031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:11:46.777031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:11:46.777031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:11:46.777031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:11:46.777031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:11:46.777031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 20:11:46.777031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:46.782008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 333/665] 10.222.0.71 () {56 vars in 1102 bytes} [Mon May 16 20:11:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:46.782008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fc78b-a19f-4126-96f6-985fc6f52690 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:46.817464 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea468a-6ba6-4636-b680-2ad1586cbd78 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:46.857443 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fde5f-7fbe-40ff-9796-39114874d45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:46.858366 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fde5f-7fbe-40ff-9796-39114874d45b None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:46.858649 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fde5f-7fbe-40ff-9796-39114874d45b None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:46.858915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fde5f-7fbe-40ff-9796-39114874d45b None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:46.859837 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fde5f-7fbe-40ff-9796-39114874d45b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:46.860174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fde5f-7fbe-40ff-9796-39114874d45b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:46.862354 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fde5f-7fbe-40ff-9796-39114874d45b None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:46.883902 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 333/666] 10.222.0.71 () {56 vars in 1137 bytes} [Mon May 16 20:11:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:46.884793 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fde5f-7fbe-40ff-9796-39114874d45b None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:46.900483 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fc78b-a19f-4126-96f6-985fc6f52690 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:46.941487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d665c7f-c98c-4f3f-9e0b-680ef9c6c378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:46.942087 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d665c7f-c98c-4f3f-9e0b-680ef9c6c378 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:46.942370 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d665c7f-c98c-4f3f-9e0b-680ef9c6c378 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:46.942647 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d665c7f-c98c-4f3f-9e0b-680ef9c6c378 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:46.943411 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d665c7f-c98c-4f3f-9e0b-680ef9c6c378 None admin] RBAC: Adding query filter params (name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:46.943718 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d665c7f-c98c-4f3f-9e0b-680ef9c6c378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:46.945233 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d665c7f-c98c-4f3f-9e0b-680ef9c6c378 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:46.954217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 334/667] 10.222.0.71 () {56 vars in 1103 bytes} [Mon May 16 20:11:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:46.956337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d665c7f-c98c-4f3f-9e0b-680ef9c6c378 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:46.995338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fde5f-7fbe-40ff-9796-39114874d45b None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:47.035272 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563e55e-0785-45f3-9550-5fd9b8867607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:47.035954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563e55e-0785-45f3-9550-5fd9b8867607 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:47.036266 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563e55e-0785-45f3-9550-5fd9b8867607 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:47.036540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563e55e-0785-45f3-9550-5fd9b8867607 None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:47.037393 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563e55e-0785-45f3-9550-5fd9b8867607 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:47.037698 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563e55e-0785-45f3-9550-5fd9b8867607 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:47.039172 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563e55e-0785-45f3-9550-5fd9b8867607 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:47.065679 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 334/668] 10.222.0.71 () {56 vars in 1139 bytes} [Mon May 16 20:11:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:47.066739 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563e55e-0785-45f3-9550-5fd9b8867607 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:47.072509 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d665c7f-c98c-4f3f-9e0b-680ef9c6c378 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:47.109459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b86c4-49b9-45c5-be00-b23fda3eff60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:47.110117 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b86c4-49b9-45c5-be00-b23fda3eff60 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:47.110407 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b86c4-49b9-45c5-be00-b23fda3eff60 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:47.110688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b86c4-49b9-45c5-be00-b23fda3eff60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:47.176385 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563e55e-0785-45f3-9550-5fd9b8867607 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:47.186723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b86c4-49b9-45c5-be00-b23fda3eff60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:47.187998 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b86c4-49b9-45c5-be00-b23fda3eff60 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:47.213327 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20973ffb-a3ae-4f9a-a63a-24fc17c65508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:47.214576 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20973ffb-a3ae-4f9a-a63a-24fc17c65508 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:47.215070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20973ffb-a3ae-4f9a-a63a-24fc17c65508 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:47.215549 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20973ffb-a3ae-4f9a-a63a-24fc17c65508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:47.228143 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20973ffb-a3ae-4f9a-a63a-24fc17c65508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:47.230254 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20973ffb-a3ae-4f9a-a63a-24fc17c65508 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:47.250680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-20973ffb-a3ae-4f9a-a63a-24fc17c65508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:47.250680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:47.250680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:47.250680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:47.250680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:47.250680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:47.250680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:47.250680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:47.250680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:47.250680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:47.250680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:47.250680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:47.250680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:47.250680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:47.250680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:47.251868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:47.251868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:47.251868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:47.251868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:47.251868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:47.251868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:47.251868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:47.251868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:47.251868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:47.251868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:47.251868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:47.251868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:47.251868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:47.251868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:47.251868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:47.251868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:47.251868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:47.253442 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:47.253442 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:47.253442 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:47.253442 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:47.258012 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 335/669] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:47.259060 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20973ffb-a3ae-4f9a-a63a-24fc17c65508 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:47.320924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 335/670] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:11:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:11:47.322307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b86c4-49b9-45c5-be00-b23fda3eff60 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:47.383781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20973ffb-a3ae-4f9a-a63a-24fc17c65508 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:47.429054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7473b2a-ad1c-41c0-a00a-5ec440997500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:47.430192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7473b2a-ad1c-41c0-a00a-5ec440997500 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:47.430716 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7473b2a-ad1c-41c0-a00a-5ec440997500 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:47.431251 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7473b2a-ad1c-41c0-a00a-5ec440997500 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:47.443446 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b86c4-49b9-45c5-be00-b23fda3eff60 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:47.502634 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9bce54-c65c-458a-b080-10442c87f6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:47.504086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bce54-c65c-458a-b080-10442c87f6ab None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:47.504611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bce54-c65c-458a-b080-10442c87f6ab None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:47.505071 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bce54-c65c-458a-b080-10442c87f6ab None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:47.506019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9bce54-c65c-458a-b080-10442c87f6ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:47.506517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9bce54-c65c-458a-b080-10442c87f6ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:47.508927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9bce54-c65c-458a-b080-10442c87f6ab None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:47.526026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 336/671] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:47.527292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9bce54-c65c-458a-b080-10442c87f6ab None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:47.536718 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7473b2a-ad1c-41c0-a00a-5ec440997500 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:47.538341 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7473b2a-ad1c-41c0-a00a-5ec440997500 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:47.666946 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9bce54-c65c-458a-b080-10442c87f6ab None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:47.717240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 336/672] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:11:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:11:47.728176 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7473b2a-ad1c-41c0-a00a-5ec440997500 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:47.729049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0b9b4-04d8-4f4a-b0c6-7725d9160249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:47.729866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0b9b4-04d8-4f4a-b0c6-7725d9160249 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:47.730148 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0b9b4-04d8-4f4a-b0c6-7725d9160249 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:47.730417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0b9b4-04d8-4f4a-b0c6-7725d9160249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:47.746205 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0b9b4-04d8-4f4a-b0c6-7725d9160249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:47.748251 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0b9b4-04d8-4f4a-b0c6-7725d9160249 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:47.767471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-d2b0b9b4-04d8-4f4a-b0c6-7725d9160249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:47.767471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:47.767471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:47.767471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:47.767471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:47.767471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:47.767471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:47.767471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:47.767471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:47.767471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:47.767471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:47.767471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:47.767471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:47.767471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:47.767471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:47.768674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:47.768674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:47.768674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:47.768674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:47.768674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:47.768674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:47.768674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:47.768674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:47.768674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:47.768674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:47.768674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:47.768674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:47.768674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:47.768674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:47.768674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:47.768674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:47.768674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:47.769562 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:47.769562 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:47.769562 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:47.769562 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:47.771888 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 337/673] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:47.773110 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0b9b4-04d8-4f4a-b0c6-7725d9160249 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:47.842823 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7473b2a-ad1c-41c0-a00a-5ec440997500 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:47.883603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fcd61-0fc2-4bed-8f10-2960c0ab8c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:47.884467 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fcd61-0fc2-4bed-8f10-2960c0ab8c10 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:47.884749 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fcd61-0fc2-4bed-8f10-2960c0ab8c10 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:47.885023 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fcd61-0fc2-4bed-8f10-2960c0ab8c10 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:47.893915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fcd61-0fc2-4bed-8f10-2960c0ab8c10 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:47.895440 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fcd61-0fc2-4bed-8f10-2960c0ab8c10 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:47.896289 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0b9b4-04d8-4f4a-b0c6-7725d9160249 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:47.911665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-eb9fcd61-0fc2-4bed-8f10-2960c0ab8c10 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 20:11:47.911665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:47.911665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:47.911665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:47.911665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:47.911665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:47.911665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:47.911665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:47.911665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:47.911665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:47.911665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:47.911665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:47.911665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:11:47.911665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:11:47.911665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:11:47.911665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:11:47.912728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:47.912728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:47.912728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:11:47.912728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:47.912728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:11:47.912728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:47.912728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:47.912728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:47.912728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:47.912728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:47.912728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:47.912728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:47.912728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:47.912728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:47.912728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:47.912728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:47.912728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:47.912728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:47.913654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:47.913654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:47.913654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:11:47.913654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:11:47.913654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:11:47.913654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:11:47.913654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:11:47.913654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:11:47.913654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 20:11:47.913654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:47.917721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 337/674] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:11:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:47.918729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fcd61-0fc2-4bed-8f10-2960c0ab8c10 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:47.931653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0b281-c1ce-4321-992c-5166408e7f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:47.932479 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0b281-c1ce-4321-992c-5166408e7f0d None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:47.932758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0b281-c1ce-4321-992c-5166408e7f0d None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:47.933029 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0b281-c1ce-4321-992c-5166408e7f0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:47.944871 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0b281-c1ce-4321-992c-5166408e7f0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:47.946392 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0b281-c1ce-4321-992c-5166408e7f0d None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:47.965351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-94c0b281-c1ce-4321-992c-5166408e7f0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:47.965351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:47.965351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:47.965351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:47.965351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:47.965351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:47.965351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:47.965351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:47.965351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:47.965351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:47.965351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:47.965351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:47.965351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:47.965351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:47.965351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:47.967452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:47.967452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:47.967452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:47.967452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:47.967452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:47.967452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:47.967452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:47.967452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:47.967452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:47.967452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:47.967452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:47.967452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:47.967452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:47.967452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:47.967452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:47.967452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:47.967452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:47.969633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:47.969633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:47.969633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:47.969633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:47.969633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 338/675] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:47.969633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0b281-c1ce-4321-992c-5166408e7f0d None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:48.028664 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fcd61-0fc2-4bed-8f10-2960c0ab8c10 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:48.065483 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb4b1b-5668-4f35-9cfc-359826759add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:48.066122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb4b1b-5668-4f35-9cfc-359826759add None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:48.066401 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb4b1b-5668-4f35-9cfc-359826759add None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:48.066675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb4b1b-5668-4f35-9cfc-359826759add None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:48.067408 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb4b1b-5668-4f35-9cfc-359826759add None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:48.067717 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb4b1b-5668-4f35-9cfc-359826759add None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:48.069148 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb4b1b-5668-4f35-9cfc-359826759add None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:48.072607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0b281-c1ce-4321-992c-5166408e7f0d None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:48.082085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 338/676] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:48.083092 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb4b1b-5668-4f35-9cfc-359826759add None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:48.114633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73571cb7-ad7f-4a46-90c0-4de039ab43df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:48.115304 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73571cb7-ad7f-4a46-90c0-4de039ab43df None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:48.115584 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73571cb7-ad7f-4a46-90c0-4de039ab43df None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:48.115856 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73571cb7-ad7f-4a46-90c0-4de039ab43df None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:48.116738 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73571cb7-ad7f-4a46-90c0-4de039ab43df None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:48.117048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73571cb7-ad7f-4a46-90c0-4de039ab43df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:48.118490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73571cb7-ad7f-4a46-90c0-4de039ab43df None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:48.137696 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 339/677] 10.222.0.71 () {56 vars in 1135 bytes} [Mon May 16 20:11:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:48.138581 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73571cb7-ad7f-4a46-90c0-4de039ab43df None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:48.202596 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb4b1b-5668-4f35-9cfc-359826759add None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:48.240262 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad13fd-73f1-4512-b979-683509d37eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:48.240943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad13fd-73f1-4512-b979-683509d37eb7 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:48.241224 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad13fd-73f1-4512-b979-683509d37eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:48.241500 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad13fd-73f1-4512-b979-683509d37eb7 None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:48.242306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad13fd-73f1-4512-b979-683509d37eb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:48.242533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad13fd-73f1-4512-b979-683509d37eb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:48.243926 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad13fd-73f1-4512-b979-683509d37eb7 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:48.257511 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 339/678] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:48.258485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad13fd-73f1-4512-b979-683509d37eb7 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:48.263411 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73571cb7-ad7f-4a46-90c0-4de039ab43df None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:48.301268 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877cd2f-edf5-4558-a2ab-4b1dc3678055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:48.302422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877cd2f-edf5-4558-a2ab-4b1dc3678055 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:48.302892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877cd2f-edf5-4558-a2ab-4b1dc3678055 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:48.303356 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877cd2f-edf5-4558-a2ab-4b1dc3678055 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:48.313577 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877cd2f-edf5-4558-a2ab-4b1dc3678055 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:48.315976 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877cd2f-edf5-4558-a2ab-4b1dc3678055 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:48.334588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-0877cd2f-edf5-4558-a2ab-4b1dc3678055 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:48.334588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:48.334588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:48.334588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:48.334588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:48.334588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:48.334588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:48.334588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:48.334588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:48.334588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:48.334588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:48.334588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:48.334588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:11:48.334588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:11:48.334588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:11:48.336116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:11:48.336116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:48.336116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:48.336116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:48.336116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:48.336116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:48.336116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:48.336116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:48.336116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:48.336116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:48.336116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:48.336116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:48.336116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:48.336116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:48.336116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:48.336116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:48.336116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:48.337640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:11:48.337640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:11:48.337640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:11:48.337640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:11:48.337640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:11:48.337640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:11:48.337640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:48.337640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:48.340456 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 340/679] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:48.341566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877cd2f-edf5-4558-a2ab-4b1dc3678055 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:48.390359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad13fd-73f1-4512-b979-683509d37eb7 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:48.430204 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab15f5f-2333-4db1-8447-3cbeff778b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:48.432459 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab15f5f-2333-4db1-8447-3cbeff778b07 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:48.433206 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab15f5f-2333-4db1-8447-3cbeff778b07 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:48.433950 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab15f5f-2333-4db1-8447-3cbeff778b07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:48.485582 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877cd2f-edf5-4558-a2ab-4b1dc3678055 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:48.524432 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab1575-7eff-4d42-b56a-b91ed1e2d2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:48.525563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab1575-7eff-4d42-b56a-b91ed1e2d2ea None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:48.526037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab1575-7eff-4d42-b56a-b91ed1e2d2ea None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:48.526151 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab15f5f-2333-4db1-8447-3cbeff778b07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:48.526611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab1575-7eff-4d42-b56a-b91ed1e2d2ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:48.527628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab15f5f-2333-4db1-8447-3cbeff778b07 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:48.535083 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab1575-7eff-4d42-b56a-b91ed1e2d2ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:48.536891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab1575-7eff-4d42-b56a-b91ed1e2d2ea None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:48.552082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-67ab1575-7eff-4d42-b56a-b91ed1e2d2ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:48.552082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:48.552082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:48.552082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:48.552082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:48.552082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:48.552082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:48.552082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:48.552082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:48.552082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:48.552082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:48.552082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:48.552082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:11:48.552082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:11:48.552082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:11:48.553022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:11:48.553022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:48.553022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:48.553022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:48.553022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:48.553022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:48.553022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:48.553022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:48.553022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:48.553022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:48.553022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:48.553022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:48.553022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:48.553022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:48.553022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:48.553022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:48.553022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:48.553915 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:11:48.553915 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:11:48.553915 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:11:48.553915 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:11:48.553915 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:11:48.553915 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:11:48.553915 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:48.553915 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:48.556574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 341/680] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:48.557678 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab1575-7eff-4d42-b56a-b91ed1e2d2ea None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:48.640712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 340/681] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:11:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:11:48.641408 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab15f5f-2333-4db1-8447-3cbeff778b07 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:48.668765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab1575-7eff-4d42-b56a-b91ed1e2d2ea None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:48.709488 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991415f-1ede-427b-971f-0ac06b482f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:48.710856 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991415f-1ede-427b-971f-0ac06b482f35 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:48.711700 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991415f-1ede-427b-971f-0ac06b482f35 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:48.712566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991415f-1ede-427b-971f-0ac06b482f35 None admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:48.714584 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991415f-1ede-427b-971f-0ac06b482f35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:48.715591 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991415f-1ede-427b-971f-0ac06b482f35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:48.718783 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991415f-1ede-427b-971f-0ac06b482f35 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:48.741592 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 342/682] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:11:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:48.743459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991415f-1ede-427b-971f-0ac06b482f35 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:48.768845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab15f5f-2333-4db1-8447-3cbeff778b07 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:48.808852 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0f5ae-563e-46a0-bccc-50367bf38307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:48.809427 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0f5ae-563e-46a0-bccc-50367bf38307 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:48.809714 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0f5ae-563e-46a0-bccc-50367bf38307 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:48.809991 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0f5ae-563e-46a0-bccc-50367bf38307 None admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:48.810990 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0f5ae-563e-46a0-bccc-50367bf38307 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:48.811299 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0f5ae-563e-46a0-bccc-50367bf38307 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:48.812947 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0f5ae-563e-46a0-bccc-50367bf38307 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:48.828039 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 341/683] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:11:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:48.828640 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0f5ae-563e-46a0-bccc-50367bf38307 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:48.904313 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991415f-1ede-427b-971f-0ac06b482f35 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:48.942135 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e12bf-239e-4be5-a506-350bcbb637f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:48.943397 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e12bf-239e-4be5-a506-350bcbb637f0 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:48.943749 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0f5ae-563e-46a0-bccc-50367bf38307 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:48.944144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e12bf-239e-4be5-a506-350bcbb637f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:48.944692 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e12bf-239e-4be5-a506-350bcbb637f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:48.960280 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e12bf-239e-4be5-a506-350bcbb637f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:48.962023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e12bf-239e-4be5-a506-350bcbb637f0 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:48.981601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-035e12bf-239e-4be5-a506-350bcbb637f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:48.981601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:48.981601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:48.981601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:48.981601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:48.981601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:48.981601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:48.981601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:48.981601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:48.981601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:48.981601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:48.981601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:48.981601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:48.981601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:48.981601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:48.982583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:48.982583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:48.982583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:48.982583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:48.982583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:48.982583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:48.982583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:48.982583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:48.982583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:48.982583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:48.982583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:48.982583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:48.982583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:48.982583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:48.982583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:48.982583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:48.982583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:48.983792 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:48.983792 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:48.983792 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:48.983792 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:48.983792 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 343/684] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:48.983792 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e12bf-239e-4be5-a506-350bcbb637f0 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:48.987338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75931279-49ec-4b71-a961-9c8e7f6ff372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:48.988008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75931279-49ec-4b71-a961-9c8e7f6ff372 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:48.988698 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75931279-49ec-4b71-a961-9c8e7f6ff372 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:48.988892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75931279-49ec-4b71-a961-9c8e7f6ff372 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:48.989739 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75931279-49ec-4b71-a961-9c8e7f6ff372 None admin] RBAC: Adding query filter params (role.id=bd4b3497427646f48a7c4d949e498ebc, scope.project.id=121ed31a143d49b3a16ac6c5c6b28955, user.id=3c62c3f9351a4181a4fc2930570171b5) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:48.990854 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75931279-49ec-4b71-a961-9c8e7f6ff372 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:48.991551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75931279-49ec-4b71-a961-9c8e7f6ff372 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:48.998683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 342/685] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:11:48 2022] GET /identity/v3/role_assignments?user.id=3c62c3f9351a4181a4fc2930570171b5&scope.project.id=121ed31a143d49b3a16ac6c5c6b28955&role.id=bd4b3497427646f48a7c4d949e498ebc => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:49.000261 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22202891-edea-4202-9bad-14cd64eba479 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:49.000389 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22202891-edea-4202-9bad-14cd64eba479 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:49.000671 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22202891-edea-4202-9bad-14cd64eba479 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:49.002598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 343/686] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:49.003290 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22202891-edea-4202-9bad-14cd64eba479 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:49.120404 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e12bf-239e-4be5-a506-350bcbb637f0 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:49.147047 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22202891-edea-4202-9bad-14cd64eba479 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:49.165453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d51110-fd18-4fbc-92a0-574578128979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:49.166126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d51110-fd18-4fbc-92a0-574578128979 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:49.166404 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d51110-fd18-4fbc-92a0-574578128979 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:49.166852 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d51110-fd18-4fbc-92a0-574578128979 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:49.167541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d51110-fd18-4fbc-92a0-574578128979 None admin] RBAC: Adding query filter params (role.id=bd4b3497427646f48a7c4d949e498ebc, scope.project.id=121ed31a143d49b3a16ac6c5c6b28955, user.id=eedc173e2cdc48b489ac40f3d9dccb7a) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:49.168202 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d51110-fd18-4fbc-92a0-574578128979 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:49.169404 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d51110-fd18-4fbc-92a0-574578128979 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:49.176949 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 344/687] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:11:48 2022] GET /identity/v3/role_assignments?user.id=eedc173e2cdc48b489ac40f3d9dccb7a&scope.project.id=121ed31a143d49b3a16ac6c5c6b28955&role.id=bd4b3497427646f48a7c4d949e498ebc => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:49.178274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b904f-d96b-44a1-a05a-8c5c647d2b82 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:49.178566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b904f-d96b-44a1-a05a-8c5c647d2b82 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:49.178835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b904f-d96b-44a1-a05a-8c5c647d2b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:49.201971 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-c87b904f-d96b-44a1-a05a-8c5c647d2b82 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:49.203266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-c87b904f-d96b-44a1-a05a-8c5c647d2b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:49.207078 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26520a87-0145-47f9-9700-c46ffd41187c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:49.208101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26520a87-0145-47f9-9700-c46ffd41187c None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:49.208423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26520a87-0145-47f9-9700-c46ffd41187c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:49.208697 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26520a87-0145-47f9-9700-c46ffd41187c None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:49.210677 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26520a87-0145-47f9-9700-c46ffd41187c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:49.211127 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26520a87-0145-47f9-9700-c46ffd41187c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:49.212627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26520a87-0145-47f9-9700-c46ffd41187c None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:49.238592 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 344/688] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:49.238592 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d80eeb-4acd-4d93-b34d-1ca0d0c2273a None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:49.238592 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d80eeb-4acd-4d93-b34d-1ca0d0c2273a None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:49.239016 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d80eeb-4acd-4d93-b34d-1ca0d0c2273a None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:49.241596 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 345/689] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:49.246616 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707e230-2138-48db-b37d-6205fd3f8de5 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:49.247169 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707e230-2138-48db-b37d-6205fd3f8de5 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:49.247455 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707e230-2138-48db-b37d-6205fd3f8de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:49.271316 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-e707e230-2138-48db-b37d-6205fd3f8de5 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:49.273598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-e707e230-2138-48db-b37d-6205fd3f8de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:49.341710 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 345/690] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:49.342541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b904f-d96b-44a1-a05a-8c5c647d2b82 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:49.374786 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 346/691] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:11:49.375674 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707e230-2138-48db-b37d-6205fd3f8de5 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:49.477626 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b904f-d96b-44a1-a05a-8c5c647d2b82 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:49.518062 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707e230-2138-48db-b37d-6205fd3f8de5 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:49.525673 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95591e9-32a9-4060-9441-6bc7494dae17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:49.526479 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95591e9-32a9-4060-9441-6bc7494dae17 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:49.526759 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95591e9-32a9-4060-9441-6bc7494dae17 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:49.527032 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95591e9-32a9-4060-9441-6bc7494dae17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:49.534636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95591e9-32a9-4060-9441-6bc7494dae17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:49.536093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95591e9-32a9-4060-9441-6bc7494dae17 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:49.550834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-f95591e9-32a9-4060-9441-6bc7494dae17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:49.550834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:49.550834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:49.550834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:49.550834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:49.550834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:49.550834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:49.550834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:49.550834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:49.550834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:49.550834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:49.550834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:49.550834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:11:49.550834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:11:49.550834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:11:49.553045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:11:49.553045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:49.553045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:49.553045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:49.553045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:49.553045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:49.553045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:49.553045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:49.553045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:49.553045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:49.553045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:49.553045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:49.553045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:49.553045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:49.553045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:49.553045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:49.553045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:49.555291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:11:49.555291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:11:49.555291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:11:49.555291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:11:49.555291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:11:49.555291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:11:49.555291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:49.555291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:49.555291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 346/692] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:49.555291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95591e9-32a9-4060-9441-6bc7494dae17 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:49.573304 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0031b5a-0966-49b2-bb21-743f2693bc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:49.574690 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0031b5a-0966-49b2-bb21-743f2693bc98 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:49.575701 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0031b5a-0966-49b2-bb21-743f2693bc98 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:49.576580 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0031b5a-0966-49b2-bb21-743f2693bc98 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:49.577468 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0031b5a-0966-49b2-bb21-743f2693bc98 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:49.579503 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0031b5a-0966-49b2-bb21-743f2693bc98 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:49.599192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-d0031b5a-0966-49b2-bb21-743f2693bc98 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 20:11:49.599192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:49.599192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:11:49.599192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:11:49.599192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:11:49.599192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:11:49.599192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:11:49.599192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:11:49.599192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 20:11:49.599192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:49.599192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:11:49.599192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:49.599192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:49.599192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:49.599192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:49.599192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:49.600242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:49.600242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:49.600242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:49.600242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:49.600242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:49.600242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:49.600242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:49.600242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:11:49.600242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:11:49.600242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:11:49.600242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:11:49.600242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:49.600242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:49.600242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:49.600242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:49.600242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:49.601122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:49.601122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:49.601122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:49.601122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:49.601122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:49.601122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:49.601122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:49.601122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:49.601122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:49.601122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:49.601122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:49.601122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:11:49.601122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:11:49.601122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 20:11:49.601122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:49.609001 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 347/693] 10.222.0.71 () {56 vars in 1129 bytes} [Mon May 16 20:11:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:49.609001 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0031b5a-0966-49b2-bb21-743f2693bc98 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:49.694272 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95591e9-32a9-4060-9441-6bc7494dae17 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:49.745626 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c548be4-fecc-4201-a181-55ab58fbc08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:49.746930 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c548be4-fecc-4201-a181-55ab58fbc08a None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:49.747311 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c548be4-fecc-4201-a181-55ab58fbc08a None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:49.747619 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c548be4-fecc-4201-a181-55ab58fbc08a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:49.750849 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0031b5a-0966-49b2-bb21-743f2693bc98 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:49.761086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c548be4-fecc-4201-a181-55ab58fbc08a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:49.772245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-7c548be4-fecc-4201-a181-55ab58fbc08a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:11:49.772245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:49.772245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:49.772245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:49.772245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:49.772245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:49.772245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:49.772245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:49.772245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:49.772245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:49.772245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:49.772245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:49.772245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:49.772245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:49.772245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:49.772245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:49.773438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:49.773438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:49.773438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:49.773438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:49.773438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:49.773438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:49.773438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:49.773438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:49.773438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:49.773438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:49.773438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:49.773438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:49.773438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:49.773438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:49.773438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:49.773438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:49.774428 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:49.774428 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:49.774428 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:49.774428 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:49.774428 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:49.774428 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:49.774428 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:49.774428 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:49.774428 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:49.774428 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:49.774428 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:11:49.774428 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:49.777331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 347/694] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:11:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:49.778426 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c548be4-fecc-4201-a181-55ab58fbc08a None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:49.802976 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867df10-127e-4ebc-9f9f-8714375a2428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:49.803762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867df10-127e-4ebc-9f9f-8714375a2428 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:49.803915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867df10-127e-4ebc-9f9f-8714375a2428 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:49.804214 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867df10-127e-4ebc-9f9f-8714375a2428 None admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:49.805032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867df10-127e-4ebc-9f9f-8714375a2428 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:49.805341 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867df10-127e-4ebc-9f9f-8714375a2428 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:49.806896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867df10-127e-4ebc-9f9f-8714375a2428 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:49.828217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 348/695] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:11:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:49.828217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867df10-127e-4ebc-9f9f-8714375a2428 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:49.942646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c548be4-fecc-4201-a181-55ab58fbc08a None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:49.971979 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867df10-127e-4ebc-9f9f-8714375a2428 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:49.985745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5988e-7cfd-4cbc-a30b-8bc0d773ca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:49.986960 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5988e-7cfd-4cbc-a30b-8bc0d773ca99 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:49.987785 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5988e-7cfd-4cbc-a30b-8bc0d773ca99 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:49.988081 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5988e-7cfd-4cbc-a30b-8bc0d773ca99 None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:49.988994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5988e-7cfd-4cbc-a30b-8bc0d773ca99 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:49.989453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5988e-7cfd-4cbc-a30b-8bc0d773ca99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:49.990860 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5988e-7cfd-4cbc-a30b-8bc0d773ca99 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:49.997051 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 348/696] 10.222.0.71 () {56 vars in 1124 bytes} [Mon May 16 20:11:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:49.998179 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5988e-7cfd-4cbc-a30b-8bc0d773ca99 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:50.029861 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba767353-6d43-480d-b847-7d4a9d879e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:50.030714 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba767353-6d43-480d-b847-7d4a9d879e14 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:50.031102 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba767353-6d43-480d-b847-7d4a9d879e14 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:50.031484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba767353-6d43-480d-b847-7d4a9d879e14 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:50.032475 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba767353-6d43-480d-b847-7d4a9d879e14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:50.033562 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba767353-6d43-480d-b847-7d4a9d879e14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:50.035145 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba767353-6d43-480d-b847-7d4a9d879e14 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:50.045048 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 349/697] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:11:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:50.046070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba767353-6d43-480d-b847-7d4a9d879e14 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:50.129386 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5988e-7cfd-4cbc-a30b-8bc0d773ca99 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:50.177483 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba767353-6d43-480d-b847-7d4a9d879e14 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:50.189114 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b826c1c-ec33-4857-8755-bf8ce08a5812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:50.190443 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b826c1c-ec33-4857-8755-bf8ce08a5812 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:50.191040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b826c1c-ec33-4857-8755-bf8ce08a5812 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:50.191643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b826c1c-ec33-4857-8755-bf8ce08a5812 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:50.193315 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b826c1c-ec33-4857-8755-bf8ce08a5812 None admin] RBAC: Adding query filter params (role.id=bd4b3497427646f48a7c4d949e498ebc, scope.project.id=121ed31a143d49b3a16ac6c5c6b28955, user.id=7e701cf55d13410aa259ec72578ed27a) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:50.193978 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b826c1c-ec33-4857-8755-bf8ce08a5812 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:50.196774 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b826c1c-ec33-4857-8755-bf8ce08a5812 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:50.217106 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53597473-cf95-42a0-9484-fd6dc43a15ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:50.217782 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53597473-cf95-42a0-9484-fd6dc43a15ea None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:50.218056 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53597473-cf95-42a0-9484-fd6dc43a15ea None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:50.218225 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 349/698] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:11:49 2022] GET /identity/v3/role_assignments?user.id=7e701cf55d13410aa259ec72578ed27a&scope.project.id=121ed31a143d49b3a16ac6c5c6b28955&role.id=bd4b3497427646f48a7c4d949e498ebc => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:50.218399 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53597473-cf95-42a0-9484-fd6dc43a15ea None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:50.219043 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53597473-cf95-42a0-9484-fd6dc43a15ea None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:50.219352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53597473-cf95-42a0-9484-fd6dc43a15ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:50.219812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b826c1c-ec33-4857-8755-bf8ce08a5812 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:50.225843 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53597473-cf95-42a0-9484-fd6dc43a15ea None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:50.248134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 350/699] 10.222.0.71 () {56 vars in 1124 bytes} [Mon May 16 20:11:50 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:50.384128 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b826c1c-ec33-4857-8755-bf8ce08a5812 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:50.438456 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795e81a-498f-42ff-aaa0-0342f1a790dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:50.439845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795e81a-498f-42ff-aaa0-0342f1a790dc None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:50.440386 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795e81a-498f-42ff-aaa0-0342f1a790dc None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:50.440838 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795e81a-498f-42ff-aaa0-0342f1a790dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:50.461153 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795e81a-498f-42ff-aaa0-0342f1a790dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:50.462793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795e81a-498f-42ff-aaa0-0342f1a790dc None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:50.486750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-d795e81a-498f-42ff-aaa0-0342f1a790dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:50.486750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:50.486750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:50.486750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:50.486750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:50.486750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:50.486750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:50.486750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:50.486750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:50.486750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:50.486750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:50.486750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:50.486750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:50.486750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:50.486750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:50.487743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:50.487743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:50.487743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:50.487743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:50.487743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:50.487743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:50.487743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:50.487743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:50.487743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:50.487743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:50.487743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:50.487743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:50.487743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:50.487743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:50.487743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:50.487743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:50.487743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:50.489057 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:50.489057 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:50.489057 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:50.489057 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:50.489057 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 350/700] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:50.496669 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53597473-cf95-42a0-9484-fd6dc43a15ea None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:50.630038 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53597473-cf95-42a0-9484-fd6dc43a15ea None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:50.670231 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0d6a4-0d72-4f57-b0c2-4b12cf716609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:50.670905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0d6a4-0d72-4f57-b0c2-4b12cf716609 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:50.671185 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0d6a4-0d72-4f57-b0c2-4b12cf716609 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:50.671456 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0d6a4-0d72-4f57-b0c2-4b12cf716609 None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:50.672298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0d6a4-0d72-4f57-b0c2-4b12cf716609 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:50.672608 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0d6a4-0d72-4f57-b0c2-4b12cf716609 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:50.674873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0d6a4-0d72-4f57-b0c2-4b12cf716609 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:50.689884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 351/701] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:50.694965 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795e81a-498f-42ff-aaa0-0342f1a790dc None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:50.826992 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795e81a-498f-42ff-aaa0-0342f1a790dc None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:50.864827 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40486b0-c298-4abc-bf2e-e7746072e97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:50.865653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40486b0-c298-4abc-bf2e-e7746072e97e None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:50.865934 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40486b0-c298-4abc-bf2e-e7746072e97e None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:50.866212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40486b0-c298-4abc-bf2e-e7746072e97e None admin] PATH_INFO: `/v3/users/nova` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:50.875113 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40486b0-c298-4abc-bf2e-e7746072e97e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:50.877247 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40486b0-c298-4abc-bf2e-e7746072e97e None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:50.893892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-d40486b0-c298-4abc-bf2e-e7746072e97e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 20:11:50.893892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:50.893892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:50.893892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:50.893892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:50.893892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:50.893892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:50.893892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:50.893892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:50.893892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:50.893892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:50.893892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:50.893892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:11:50.893892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:11:50.893892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:11:50.893892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:11:50.896223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:50.896223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:50.896223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:11:50.896223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:50.896223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:11:50.896223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:50.896223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:50.896223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:50.896223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:50.896223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:50.896223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:50.896223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:50.896223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:50.896223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:50.896223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:50.896223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:50.896223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:50.896223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:50.898498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:50.898498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:50.898498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:11:50.898498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:11:50.898498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:11:50.898498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:11:50.898498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:11:50.898498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:11:50.898498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 20:11:50.898498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:50.898498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 351/702] 10.222.0.71 () {56 vars in 1093 bytes} [Mon May 16 20:11:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:11:50.904788 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0d6a4-0d72-4f57-b0c2-4b12cf716609 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:51.064182 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0d6a4-0d72-4f57-b0c2-4b12cf716609 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:51.100723 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75284164-43ca-4aa1-b2ba-f88277eca72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:51.101415 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75284164-43ca-4aa1-b2ba-f88277eca72f None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:51.101779 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75284164-43ca-4aa1-b2ba-f88277eca72f None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:51.102048 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75284164-43ca-4aa1-b2ba-f88277eca72f None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:51.102988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75284164-43ca-4aa1-b2ba-f88277eca72f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:51.103346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75284164-43ca-4aa1-b2ba-f88277eca72f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:51.105181 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75284164-43ca-4aa1-b2ba-f88277eca72f None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:51.138265 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 352/703] 10.222.0.71 () {56 vars in 1133 bytes} [Mon May 16 20:11:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:51.149413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40486b0-c298-4abc-bf2e-e7746072e97e None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:51.282595 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40486b0-c298-4abc-bf2e-e7746072e97e None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:51.338124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e473a2-ac8c-4de1-b38a-b04f7f0346f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:51.339055 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e473a2-ac8c-4de1-b38a-b04f7f0346f4 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:51.339514 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e473a2-ac8c-4de1-b38a-b04f7f0346f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:51.339958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e473a2-ac8c-4de1-b38a-b04f7f0346f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:51.524241 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e473a2-ac8c-4de1-b38a-b04f7f0346f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:51.525673 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e473a2-ac8c-4de1-b38a-b04f7f0346f4 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:51.775696 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 352/704] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:11:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:11:51.781739 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75284164-43ca-4aa1-b2ba-f88277eca72f None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:51.918486 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b89610-d7d2-45e4-873a-60a2a7cae35c None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:51.918817 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b89610-d7d2-45e4-873a-60a2a7cae35c None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:51.919047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b89610-d7d2-45e4-873a-60a2a7cae35c None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:51.920734 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 353/705] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:51.929813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25987984-6e95-466f-92b7-3ec5bcf05565 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:51.930117 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25987984-6e95-466f-92b7-3ec5bcf05565 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:51.930381 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25987984-6e95-466f-92b7-3ec5bcf05565 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:51.932301 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 354/706] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:51.933619 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadb0e3-3299-4ae7-96a0-c535ca710df5 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:51.933849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadb0e3-3299-4ae7-96a0-c535ca710df5 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:51.934130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadb0e3-3299-4ae7-96a0-c535ca710df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:51.968473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-ceadb0e3-3299-4ae7-96a0-c535ca710df5 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:51.971864 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-ceadb0e3-3299-4ae7-96a0-c535ca710df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:52.016572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75284164-43ca-4aa1-b2ba-f88277eca72f None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:52.064646 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bfb12-5a60-4ea4-b1f9-a0e8093722d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:52.065813 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bfb12-5a60-4ea4-b1f9-a0e8093722d7 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:52.066291 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bfb12-5a60-4ea4-b1f9-a0e8093722d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:52.066772 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bfb12-5a60-4ea4-b1f9-a0e8093722d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:52.077955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bfb12-5a60-4ea4-b1f9-a0e8093722d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:52.080568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bfb12-5a60-4ea4-b1f9-a0e8093722d7 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:52.091782 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 355/707] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:52.093330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74f566-312a-459c-a7ad-86a9a4b17dd3 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:52.094364 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74f566-312a-459c-a7ad-86a9a4b17dd3 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:52.094654 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74f566-312a-459c-a7ad-86a9a4b17dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:52.106036 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-590bfb12-5a60-4ea4-b1f9-a0e8093722d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:52.106036 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:52.106036 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:52.106036 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:52.106036 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:52.106036 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:52.106036 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:52.106036 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:52.106036 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:52.106036 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:52.106036 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:52.106036 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:52.106036 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:52.106036 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:52.106036 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:52.107009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:52.107009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:52.107009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:52.107009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:52.107009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:52.107009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:52.107009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:52.107009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:52.107009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:52.107009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:52.107009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:52.107009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:52.107009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:52.107009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:52.107009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:52.107009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:52.107009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:52.107886 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:52.107886 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:52.107886 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:52.107886 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:52.110425 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 353/708] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:52.117494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bfb12-5a60-4ea4-b1f9-a0e8093722d7 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:52.119064 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-3e74f566-312a-459c-a7ad-86a9a4b17dd3 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:52.120346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-3e74f566-312a-459c-a7ad-86a9a4b17dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:52.224176 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 356/709] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:52.224176 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74f566-312a-459c-a7ad-86a9a4b17dd3 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:52.278655 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bfb12-5a60-4ea4-b1f9-a0e8093722d7 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:52.326273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71c1f8-5187-4e6f-9dd2-0e070e5285f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:52.327362 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71c1f8-5187-4e6f-9dd2-0e070e5285f6 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:52.327871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71c1f8-5187-4e6f-9dd2-0e070e5285f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:52.328409 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71c1f8-5187-4e6f-9dd2-0e070e5285f6 None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:52.329368 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71c1f8-5187-4e6f-9dd2-0e070e5285f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:52.329910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71c1f8-5187-4e6f-9dd2-0e070e5285f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:52.331544 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71c1f8-5187-4e6f-9dd2-0e070e5285f6 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:52.343945 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 354/710] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:52.345683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71c1f8-5187-4e6f-9dd2-0e070e5285f6 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:52.351857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74f566-312a-459c-a7ad-86a9a4b17dd3 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:52.390269 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ff871-91ec-42fb-b8b7-c6613f1a3a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:52.391401 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ff871-91ec-42fb-b8b7-c6613f1a3a38 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:52.391819 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ff871-91ec-42fb-b8b7-c6613f1a3a38 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:52.392284 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ff871-91ec-42fb-b8b7-c6613f1a3a38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:52.403459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ff871-91ec-42fb-b8b7-c6613f1a3a38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:52.405231 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ff871-91ec-42fb-b8b7-c6613f1a3a38 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:52.430870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-273ff871-91ec-42fb-b8b7-c6613f1a3a38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:52.430870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:52.430870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:52.430870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:52.430870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:52.430870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:52.430870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:52.430870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:52.430870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:52.430870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:52.430870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:52.430870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:52.430870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:52.430870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:52.430870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:52.432050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:52.432050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:52.432050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:52.432050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:52.432050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:52.432050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:52.432050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:52.432050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:52.432050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:52.432050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:52.432050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:52.432050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:52.432050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:52.432050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:52.432050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:52.432050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:52.432050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:52.433222 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:52.433222 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:52.433222 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:52.433222 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:52.435180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 357/711] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:52.436236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ff871-91ec-42fb-b8b7-c6613f1a3a38 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:52.468275 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71c1f8-5187-4e6f-9dd2-0e070e5285f6 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:52.506444 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1decf6c-abdd-4dab-9ca6-7639439929c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:52.507653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1decf6c-abdd-4dab-9ca6-7639439929c2 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:52.508144 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1decf6c-abdd-4dab-9ca6-7639439929c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:52.508658 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1decf6c-abdd-4dab-9ca6-7639439929c2 None admin] PATH_INFO: `/v3/services/network` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:52.509517 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1decf6c-abdd-4dab-9ca6-7639439929c2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:52.511181 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1decf6c-abdd-4dab-9ca6-7639439929c2 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:52.524085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-c1decf6c-abdd-4dab-9ca6-7639439929c2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 20:11:52.524085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:52.524085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:11:52.524085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:11:52.524085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:11:52.524085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:11:52.524085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:11:52.524085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:11:52.524085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 20:11:52.524085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:52.524085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:11:52.524085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:52.524085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:52.524085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:52.524085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:52.524085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:52.524085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:52.525134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:52.525134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:52.525134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:52.525134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:52.525134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:52.525134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:52.525134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:11:52.525134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:11:52.525134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:11:52.525134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:11:52.525134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:52.525134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:52.525134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:52.525134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:52.525134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:52.525134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:52.526052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:52.526052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:52.526052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:52.526052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:52.526052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:52.526052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:52.526052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:52.526052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:52.526052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:52.526052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:52.526052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:11:52.526052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:11:52.526052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 20:11:52.526052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:52.534199 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 355/712] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:52 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:52.535361 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1decf6c-abdd-4dab-9ca6-7639439929c2 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:52.560788 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ff871-91ec-42fb-b8b7-c6613f1a3a38 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:52.614632 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924bda7-0ab2-4da5-bcdb-9406696713e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:52.616254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924bda7-0ab2-4da5-bcdb-9406696713e6 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:52.616988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924bda7-0ab2-4da5-bcdb-9406696713e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:52.617463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924bda7-0ab2-4da5-bcdb-9406696713e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:52.628529 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924bda7-0ab2-4da5-bcdb-9406696713e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:52.629484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924bda7-0ab2-4da5-bcdb-9406696713e6 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:52.655580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-f924bda7-0ab2-4da5-bcdb-9406696713e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:52.655580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:52.655580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:52.655580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:52.655580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:52.655580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:52.655580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:52.655580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:52.655580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:52.655580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:52.655580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:52.655580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:52.655580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:11:52.655580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:11:52.655580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:11:52.656590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:11:52.656590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:52.656590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:52.656590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:52.656590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:52.656590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:52.656590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:52.656590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:52.656590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:52.656590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:52.656590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:52.656590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:52.656590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:52.656590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:52.656590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:52.656590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:52.656590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:52.657492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:11:52.657492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:11:52.657492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:11:52.657492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:11:52.657492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:11:52.657492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:11:52.657492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:52.657492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:52.664565 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 358/713] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:52.665702 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1decf6c-abdd-4dab-9ca6-7639439929c2 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:52.666209 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924bda7-0ab2-4da5-bcdb-9406696713e6 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:52.703630 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c46b5-49b1-4c6e-9a5b-d82ac1006416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:52.704997 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c46b5-49b1-4c6e-9a5b-d82ac1006416 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:52.705528 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c46b5-49b1-4c6e-9a5b-d82ac1006416 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:52.706001 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c46b5-49b1-4c6e-9a5b-d82ac1006416 None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:52.706942 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c46b5-49b1-4c6e-9a5b-d82ac1006416 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:52.707448 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c46b5-49b1-4c6e-9a5b-d82ac1006416 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:52.709094 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c46b5-49b1-4c6e-9a5b-d82ac1006416 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:52.726890 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 356/714] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:52.728173 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c46b5-49b1-4c6e-9a5b-d82ac1006416 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:52.775853 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924bda7-0ab2-4da5-bcdb-9406696713e6 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:52.820606 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e023ca-6b46-4c19-889b-85b99c592cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:52.821276 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e023ca-6b46-4c19-889b-85b99c592cfc None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:52.821710 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e023ca-6b46-4c19-889b-85b99c592cfc None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:52.821817 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e023ca-6b46-4c19-889b-85b99c592cfc None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:52.822506 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e023ca-6b46-4c19-889b-85b99c592cfc None admin] RBAC: Adding query filter params (name=network) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:52.822810 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e023ca-6b46-4c19-889b-85b99c592cfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:52.824218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e023ca-6b46-4c19-889b-85b99c592cfc None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:52.830995 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 359/715] 10.222.0.71 () {56 vars in 1112 bytes} [Mon May 16 20:11:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:52.830995 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e023ca-6b46-4c19-889b-85b99c592cfc None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:52.843519 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c46b5-49b1-4c6e-9a5b-d82ac1006416 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:52.879329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56e332-bebe-401d-a7d1-faaeb0e9d63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:52.880343 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56e332-bebe-401d-a7d1-faaeb0e9d63a None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:52.880799 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56e332-bebe-401d-a7d1-faaeb0e9d63a None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:52.881243 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56e332-bebe-401d-a7d1-faaeb0e9d63a None admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:52.882192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56e332-bebe-401d-a7d1-faaeb0e9d63a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:52.882689 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56e332-bebe-401d-a7d1-faaeb0e9d63a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:52.884326 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56e332-bebe-401d-a7d1-faaeb0e9d63a None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:52.897572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 357/716] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:11:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:52.898797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56e332-bebe-401d-a7d1-faaeb0e9d63a None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:52.933458 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e023ca-6b46-4c19-889b-85b99c592cfc None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:52.967529 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be50cae-7325-41c2-8d24-4252bd2d9200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:52.968324 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be50cae-7325-41c2-8d24-4252bd2d9200 None admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:52.968679 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be50cae-7325-41c2-8d24-4252bd2d9200 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:52.969033 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be50cae-7325-41c2-8d24-4252bd2d9200 None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:52.969824 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be50cae-7325-41c2-8d24-4252bd2d9200 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:52.972124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be50cae-7325-41c2-8d24-4252bd2d9200 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:53.000208 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 360/717] 10.222.0.71 () {60 vars in 1132 bytes} [Mon May 16 20:11:52 2022] POST /identity/v3/users => generated 254 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:11:53.000208 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be50cae-7325-41c2-8d24-4252bd2d9200 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:53.032169 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56e332-bebe-401d-a7d1-faaeb0e9d63a None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:53.121432 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be50cae-7325-41c2-8d24-4252bd2d9200 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:53.137134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44628b9-2507-41b2-bf97-cbe9a7e016a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:53.137747 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44628b9-2507-41b2-bf97-cbe9a7e016a0 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:53.138034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44628b9-2507-41b2-bf97-cbe9a7e016a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:53.138309 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44628b9-2507-41b2-bf97-cbe9a7e016a0 None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:53.139059 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44628b9-2507-41b2-bf97-cbe9a7e016a0 None admin] RBAC: Adding query filter params (type=network) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:53.139366 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44628b9-2507-41b2-bf97-cbe9a7e016a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:53.141097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44628b9-2507-41b2-bf97-cbe9a7e016a0 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:53.159328 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 358/718] 10.222.0.71 () {56 vars in 1112 bytes} [Mon May 16 20:11:52 2022] GET /identity/v3/services?type=network => generated 124 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:53.163138 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdabd4-cfa0-4329-9d29-c942e2dfd4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:53.163810 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdabd4-cfa0-4329-9d29-c942e2dfd4da None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:53.164090 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdabd4-cfa0-4329-9d29-c942e2dfd4da None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:53.164402 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdabd4-cfa0-4329-9d29-c942e2dfd4da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:53.165308 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdabd4-cfa0-4329-9d29-c942e2dfd4da None admin] RBAC: Adding query filter params (role.id=6576d9225a0946de877f527e3d15db05, scope.project.id=121ed31a143d49b3a16ac6c5c6b28955, user.id=242d4f9634a74013af05f50981280864) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:53.165668 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdabd4-cfa0-4329-9d29-c942e2dfd4da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:53.167149 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdabd4-cfa0-4329-9d29-c942e2dfd4da None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:53.174957 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 361/719] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:11:52 2022] GET /identity/v3/role_assignments?user.id=242d4f9634a74013af05f50981280864&scope.project.id=121ed31a143d49b3a16ac6c5c6b28955&role.id=6576d9225a0946de877f527e3d15db05 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:53.326257 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e27fee-4090-4e6a-a6e7-8f6ce4926780 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:53.326543 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e27fee-4090-4e6a-a6e7-8f6ce4926780 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:53.326824 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e27fee-4090-4e6a-a6e7-8f6ce4926780 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:53.328231 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 359/720] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:53.335907 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a93a23-bc98-4c05-82e0-b1eedec84353 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:53.336404 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a93a23-bc98-4c05-82e0-b1eedec84353 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:53.336791 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a93a23-bc98-4c05-82e0-b1eedec84353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:53.356366 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-b2a93a23-bc98-4c05-82e0-b1eedec84353 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:53.357607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-b2a93a23-bc98-4c05-82e0-b1eedec84353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:53.440650 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 362/721] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:53.464347 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e27fee-4090-4e6a-a6e7-8f6ce4926780 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:53.600371 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e27fee-4090-4e6a-a6e7-8f6ce4926780 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:53.644988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669d84d-9bc3-46fb-a5b1-441c7a1a44de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:53.645647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669d84d-9bc3-46fb-a5b1-441c7a1a44de None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:53.645923 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669d84d-9bc3-46fb-a5b1-441c7a1a44de None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:53.646190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669d84d-9bc3-46fb-a5b1-441c7a1a44de None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:53.646901 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669d84d-9bc3-46fb-a5b1-441c7a1a44de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:53.652376 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669d84d-9bc3-46fb-a5b1-441c7a1a44de None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:53.677383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 360/722] 10.222.0.71 () {60 vars in 1141 bytes} [Mon May 16 20:11:53 2022] POST /identity/v3/services => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:11:53.957792 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a976c5-2f78-4eb6-8992-77aad56ef32a None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:53.958758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a976c5-2f78-4eb6-8992-77aad56ef32a None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:53.959234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a976c5-2f78-4eb6-8992-77aad56ef32a None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:53.960848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 363/723] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:53.968101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d4771-7679-4303-a840-3e79bf3ae546 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:53.968705 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d4771-7679-4303-a840-3e79bf3ae546 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:53.968705 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d4771-7679-4303-a840-3e79bf3ae546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:53.988915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-3e6d4771-7679-4303-a840-3e79bf3ae546 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:53.990099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-3e6d4771-7679-4303-a840-3e79bf3ae546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:54.070126 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 361/724] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:53 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:54.093777 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a976c5-2f78-4eb6-8992-77aad56ef32a None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:54.219947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a976c5-2f78-4eb6-8992-77aad56ef32a None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:54.263033 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94ee5c-4ae2-4597-8b84-6feac6f3ed5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:54.264071 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94ee5c-4ae2-4597-8b84-6feac6f3ed5b None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:54.264543 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94ee5c-4ae2-4597-8b84-6feac6f3ed5b None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:54.265214 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94ee5c-4ae2-4597-8b84-6feac6f3ed5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:54.276228 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94ee5c-4ae2-4597-8b84-6feac6f3ed5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:54.284655 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-5e94ee5c-4ae2-4597-8b84-6feac6f3ed5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:11:54.284655 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:54.284655 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:54.284655 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:54.284655 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:54.284655 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:54.284655 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:54.284655 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:54.284655 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:54.284655 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:54.284655 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:54.284655 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:54.284655 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:54.284655 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:54.284655 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:54.284655 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:54.285793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:54.285793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:54.285793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:54.285793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:54.285793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:54.285793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:54.285793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:54.285793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:54.285793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:54.285793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:54.285793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:54.285793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:54.285793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:54.285793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:54.285793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:54.285793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:54.286831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:54.286831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:54.286831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:54.286831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:54.286831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:54.286831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:54.286831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:54.286831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:54.286831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:54.286831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:54.286831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:11:54.286831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:54.292745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 364/725] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:11:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:54.295754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d4771-7679-4303-a840-3e79bf3ae546 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:54.397286 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d4771-7679-4303-a840-3e79bf3ae546 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:54.432043 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8086eb-8856-4844-9b07-9f5807ea2296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:54.433019 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8086eb-8856-4844-9b07-9f5807ea2296 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:54.433481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8086eb-8856-4844-9b07-9f5807ea2296 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:54.433954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8086eb-8856-4844-9b07-9f5807ea2296 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:54.434832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8086eb-8856-4844-9b07-9f5807ea2296 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:54.435274 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8086eb-8856-4844-9b07-9f5807ea2296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:54.436815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8086eb-8856-4844-9b07-9f5807ea2296 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:54.448310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 362/726] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:11:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:54.451401 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94ee5c-4ae2-4597-8b84-6feac6f3ed5b None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:54.572795 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94ee5c-4ae2-4597-8b84-6feac6f3ed5b None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:54.608042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6107de8-a91c-43d4-b26e-cc60156f9771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:54.609130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6107de8-a91c-43d4-b26e-cc60156f9771 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:54.609559 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6107de8-a91c-43d4-b26e-cc60156f9771 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:54.610080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6107de8-a91c-43d4-b26e-cc60156f9771 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:54.621801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6107de8-a91c-43d4-b26e-cc60156f9771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:54.623488 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6107de8-a91c-43d4-b26e-cc60156f9771 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:54.641906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-f6107de8-a91c-43d4-b26e-cc60156f9771 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:54.641906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:54.641906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:54.641906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:54.641906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:54.641906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:54.641906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:54.641906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:54.641906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:54.641906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:54.641906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:54.641906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:54.641906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:54.641906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:54.641906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:54.642881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:54.642881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:54.642881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:54.642881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:54.642881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:54.642881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:54.642881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:54.642881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:54.642881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:54.642881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:54.642881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:54.642881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:54.642881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:54.642881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:54.642881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:54.642881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:54.642881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:54.643931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:54.643931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:54.643931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:54.643931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:54.650049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 365/727] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:54.651677 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8086eb-8856-4844-9b07-9f5807ea2296 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:54.754637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8086eb-8856-4844-9b07-9f5807ea2296 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:54.789113 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90639c44-7c1b-4ed8-9549-9bdf9823100d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:54.790014 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90639c44-7c1b-4ed8-9549-9bdf9823100d None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:54.790434 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90639c44-7c1b-4ed8-9549-9bdf9823100d None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:54.790842 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90639c44-7c1b-4ed8-9549-9bdf9823100d None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:54.791726 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90639c44-7c1b-4ed8-9549-9bdf9823100d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:54.792249 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90639c44-7c1b-4ed8-9549-9bdf9823100d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:54.793770 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90639c44-7c1b-4ed8-9549-9bdf9823100d None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:54.811392 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 363/728] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:54.813049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6107de8-a91c-43d4-b26e-cc60156f9771 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:54.924048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6107de8-a91c-43d4-b26e-cc60156f9771 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:54.962532 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789086d-d353-4481-8ee1-2bd353dfa100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:54.964058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789086d-d353-4481-8ee1-2bd353dfa100 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:54.964546 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789086d-d353-4481-8ee1-2bd353dfa100 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:54.964958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789086d-d353-4481-8ee1-2bd353dfa100 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:54.973652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789086d-d353-4481-8ee1-2bd353dfa100 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:54.975299 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789086d-d353-4481-8ee1-2bd353dfa100 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:54.990218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-d789086d-d353-4481-8ee1-2bd353dfa100 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 20:11:54.990218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:54.990218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:54.990218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:54.990218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:54.990218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:54.990218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:54.990218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:54.990218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:54.990218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:54.990218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:54.990218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:54.990218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:11:54.990218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:11:54.990218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:11:54.990218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:11:54.991395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:54.991395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:54.991395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:11:54.991395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:54.991395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:11:54.991395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:54.991395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:54.991395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:54.991395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:54.991395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:54.991395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:54.991395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:54.991395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:54.991395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:54.991395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:54.991395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:54.991395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:54.991395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:54.992519 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:54.992519 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:54.992519 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:11:54.992519 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:11:54.992519 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:11:54.992519 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:11:54.992519 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:11:54.992519 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:11:54.992519 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 20:11:54.992519 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:54.999071 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 366/729] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:11:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:11:55.000641 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90639c44-7c1b-4ed8-9549-9bdf9823100d None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:55.123953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90639c44-7c1b-4ed8-9549-9bdf9823100d None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:55.178244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0d1b8-8524-49b3-816f-6bc99b22f7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:55.178880 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0d1b8-8524-49b3-816f-6bc99b22f7dc None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:55.179303 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0d1b8-8524-49b3-816f-6bc99b22f7dc None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:55.179605 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0d1b8-8524-49b3-816f-6bc99b22f7dc None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:55.180484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0d1b8-8524-49b3-816f-6bc99b22f7dc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:55.180789 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0d1b8-8524-49b3-816f-6bc99b22f7dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:55.182230 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0d1b8-8524-49b3-816f-6bc99b22f7dc None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:55.223322 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 364/730] 10.222.0.71 () {56 vars in 1135 bytes} [Mon May 16 20:11:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:55.232001 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789086d-d353-4481-8ee1-2bd353dfa100 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:55.382425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789086d-d353-4481-8ee1-2bd353dfa100 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:55.424519 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5d794-3d8d-40bd-acdb-d71eed7e9122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:55.425440 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5d794-3d8d-40bd-acdb-d71eed7e9122 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:55.425903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5d794-3d8d-40bd-acdb-d71eed7e9122 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:55.426323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5d794-3d8d-40bd-acdb-d71eed7e9122 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:55.528719 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5d794-3d8d-40bd-acdb-d71eed7e9122 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:55.530568 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5d794-3d8d-40bd-acdb-d71eed7e9122 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:55.672467 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 367/731] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:11:55 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 20:11:55.679070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0d1b8-8524-49b3-816f-6bc99b22f7dc None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:55.816824 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0d1b8-8524-49b3-816f-6bc99b22f7dc None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:55.866530 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f396762-f0da-4bc6-a23b-3612e01c25ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:55.867335 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f396762-f0da-4bc6-a23b-3612e01c25ce None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:55.867612 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f396762-f0da-4bc6-a23b-3612e01c25ce None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:55.867907 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f396762-f0da-4bc6-a23b-3612e01c25ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:55.879936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f396762-f0da-4bc6-a23b-3612e01c25ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:55.881706 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f396762-f0da-4bc6-a23b-3612e01c25ce None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:55.902339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-7f396762-f0da-4bc6-a23b-3612e01c25ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:55.902339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:55.902339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:55.902339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:55.902339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:55.902339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:55.902339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:55.902339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:55.902339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:55.902339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:55.902339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:55.902339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:55.902339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:55.902339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:55.902339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:55.903349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:55.903349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:55.903349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:55.903349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:55.903349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:55.903349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:55.903349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:55.903349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:55.903349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:55.903349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:55.903349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:55.903349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:55.903349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:55.903349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:55.903349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:55.903349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:55.903349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:55.904609 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:55.904609 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:55.904609 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:55.904609 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:55.904609 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 365/732] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:55.913522 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5d794-3d8d-40bd-acdb-d71eed7e9122 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:56.049371 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5d794-3d8d-40bd-acdb-d71eed7e9122 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:56.098628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7e9dc-6abe-44ad-978b-4aef6780f33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:56.099261 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7e9dc-6abe-44ad-978b-4aef6780f33a None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:56.099605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7e9dc-6abe-44ad-978b-4aef6780f33a None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:56.099894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7e9dc-6abe-44ad-978b-4aef6780f33a None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:56.100832 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7e9dc-6abe-44ad-978b-4aef6780f33a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:56.101140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7e9dc-6abe-44ad-978b-4aef6780f33a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:56.102645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7e9dc-6abe-44ad-978b-4aef6780f33a None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:56.123896 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 368/733] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:56.131095 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f396762-f0da-4bc6-a23b-3612e01c25ce None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:56.160255 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c32795-b70d-405f-81ad-b46aa7322305 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:56.160255 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c32795-b70d-405f-81ad-b46aa7322305 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:56.160255 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c32795-b70d-405f-81ad-b46aa7322305 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:56.162014 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 369/734] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:11:56.167543 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c63c8-46b4-4931-99fd-148f684e04a6 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:56.168120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c63c8-46b4-4931-99fd-148f684e04a6 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:56.168630 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c63c8-46b4-4931-99fd-148f684e04a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:56.208476 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-3a7c63c8-46b4-4931-99fd-148f684e04a6 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:56.211805 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-3a7c63c8-46b4-4931-99fd-148f684e04a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:56.304120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f396762-f0da-4bc6-a23b-3612e01c25ce None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:56.342439 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209d57f-e2e9-42f4-bdbc-4209f0b9a327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:56.348176 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 370/735] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 20:11:56.349297 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209d57f-e2e9-42f4-bdbc-4209f0b9a327 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:56.349815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209d57f-e2e9-42f4-bdbc-4209f0b9a327 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:56.350299 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209d57f-e2e9-42f4-bdbc-4209f0b9a327 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:56.362366 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209d57f-e2e9-42f4-bdbc-4209f0b9a327 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:56.364257 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209d57f-e2e9-42f4-bdbc-4209f0b9a327 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:56.380284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-1209d57f-e2e9-42f4-bdbc-4209f0b9a327 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:56.380284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:56.380284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:56.380284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:56.380284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:56.380284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:56.380284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:56.380284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:56.380284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:56.380284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:56.380284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:56.380284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:56.380284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:11:56.380284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:11:56.380284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:11:56.381273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:11:56.381273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:56.381273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:56.381273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:56.381273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:56.381273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:56.381273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:56.381273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:56.381273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:56.381273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:56.381273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:56.381273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:56.381273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:56.381273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:56.381273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:56.381273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:56.381273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:56.382191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:11:56.382191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:11:56.382191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:11:56.382191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:11:56.382191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:11:56.382191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:11:56.382191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:56.382191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:56.387791 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c63c8-46b4-4931-99fd-148f684e04a6 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:56.390375 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 366/736] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:56.392881 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced15e8-ced6-430e-865a-1f54770e3990 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:56.392881 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced15e8-ced6-430e-865a-1f54770e3990 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:56.393178 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced15e8-ced6-430e-865a-1f54770e3990 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:56.394534 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 367/737] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:56.395107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced15e8-ced6-430e-865a-1f54770e3990 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:56.508019 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced15e8-ced6-430e-865a-1f54770e3990 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:56.513449 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c63c8-46b4-4931-99fd-148f684e04a6 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:56.545305 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031efa9-0f4a-4d32-a395-df1f53c0fd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:56.545961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031efa9-0f4a-4d32-a395-df1f53c0fd38 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:56.546238 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031efa9-0f4a-4d32-a395-df1f53c0fd38 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:56.546507 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031efa9-0f4a-4d32-a395-df1f53c0fd38 None admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:56.547724 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031efa9-0f4a-4d32-a395-df1f53c0fd38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:56.548575 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031efa9-0f4a-4d32-a395-df1f53c0fd38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:56.550496 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031efa9-0f4a-4d32-a395-df1f53c0fd38 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:56.567299 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b65a6f-2924-4777-b705-6255a6288518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:56.568086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b65a6f-2924-4777-b705-6255a6288518 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:56.568297 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 368/738] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:11:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:56.568401 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b65a6f-2924-4777-b705-6255a6288518 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:56.568648 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b65a6f-2924-4777-b705-6255a6288518 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:56.569632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b2c11-0d80-4d87-83f5-e4af4116db2b None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:56.569925 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b2c11-0d80-4d87-83f5-e4af4116db2b None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:56.570212 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b2c11-0d80-4d87-83f5-e4af4116db2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:56.579267 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b65a6f-2924-4777-b705-6255a6288518 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:56.587245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-c1b65a6f-2924-4777-b705-6255a6288518 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:11:56.587245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:56.587245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:56.587245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:56.587245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:56.587245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:56.587245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:56.587245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:56.587245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:56.587245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:56.587245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:56.587245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:56.587245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:56.587245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:56.587245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:56.587245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:56.588625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:56.588625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:56.588625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:56.588625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:56.588625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:56.588625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:56.588625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:56.588625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:56.588625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:56.588625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:56.588625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:56.588625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:56.588625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:56.588625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:56.588625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:56.588625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:56.589517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:56.589517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:56.589517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:56.589517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:56.589517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:56.589517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:56.589517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:56.589517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:56.589517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:56.589517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:56.589517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:11:56.589517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:56.590164 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-037b2c11-0d80-4d87-83f5-e4af4116db2b None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:56.590164 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-037b2c11-0d80-4d87-83f5-e4af4116db2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:56.592553 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 371/739] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:11:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:56.594109 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc224c59-69fc-4075-9319-3148102bbd65 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:56.594400 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc224c59-69fc-4075-9319-3148102bbd65 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:56.594677 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc224c59-69fc-4075-9319-3148102bbd65 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:56.596608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 372/740] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:56.600276 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc224c59-69fc-4075-9319-3148102bbd65 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:56.666631 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 369/741] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:56.667817 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b2c11-0d80-4d87-83f5-e4af4116db2b None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:56.719053 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc224c59-69fc-4075-9319-3148102bbd65 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:56.766271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624a386-7efd-4130-8196-92db58d87c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:56.767912 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624a386-7efd-4130-8196-92db58d87c25 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:56.768666 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624a386-7efd-4130-8196-92db58d87c25 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:56.769090 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624a386-7efd-4130-8196-92db58d87c25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:56.770147 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624a386-7efd-4130-8196-92db58d87c25 None admin] RBAC: Adding query filter params (role.id=6576d9225a0946de877f527e3d15db05, scope.project.id=121ed31a143d49b3a16ac6c5c6b28955, user.id=7e701cf55d13410aa259ec72578ed27a) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:56.770313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b2c11-0d80-4d87-83f5-e4af4116db2b None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:56.770764 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624a386-7efd-4130-8196-92db58d87c25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:56.773399 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624a386-7efd-4130-8196-92db58d87c25 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:56.780786 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 373/742] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:11:56 2022] GET /identity/v3/role_assignments?user.id=7e701cf55d13410aa259ec72578ed27a&scope.project.id=121ed31a143d49b3a16ac6c5c6b28955&role.id=6576d9225a0946de877f527e3d15db05 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:56.782952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c3ea3-c239-44ce-8341-e6e6d0127210 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:56.783381 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c3ea3-c239-44ce-8341-e6e6d0127210 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:56.783967 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c3ea3-c239-44ce-8341-e6e6d0127210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:56.806622 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-bf9c3ea3-c239-44ce-8341-e6e6d0127210 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:56.807153 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdeb7c-96b5-4fb3-adec-35bff4935527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:56.807893 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-bf9c3ea3-c239-44ce-8341-e6e6d0127210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:56.808028 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdeb7c-96b5-4fb3-adec-35bff4935527 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:56.808188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdeb7c-96b5-4fb3-adec-35bff4935527 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:56.808522 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdeb7c-96b5-4fb3-adec-35bff4935527 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:56.809296 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdeb7c-96b5-4fb3-adec-35bff4935527 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:56.809680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdeb7c-96b5-4fb3-adec-35bff4935527 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:56.811184 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdeb7c-96b5-4fb3-adec-35bff4935527 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:56.824641 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 370/743] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:11:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:56.824641 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdeb7c-96b5-4fb3-adec-35bff4935527 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:56.900214 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 374/744] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:56.901940 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0dd9a-f2dc-4ffd-b55d-548b46b51082 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:56.902333 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0dd9a-f2dc-4ffd-b55d-548b46b51082 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:56.902702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0dd9a-f2dc-4ffd-b55d-548b46b51082 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:56.908213 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 375/745] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:56.908213 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0dd9a-f2dc-4ffd-b55d-548b46b51082 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:56.975816 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdeb7c-96b5-4fb3-adec-35bff4935527 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:57.019655 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c526f1f-9131-47ac-b790-841dcebbde31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:57.020503 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c526f1f-9131-47ac-b790-841dcebbde31 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:57.020780 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c526f1f-9131-47ac-b790-841dcebbde31 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:57.021046 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c526f1f-9131-47ac-b790-841dcebbde31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:57.043221 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c526f1f-9131-47ac-b790-841dcebbde31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:57.046748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0dd9a-f2dc-4ffd-b55d-548b46b51082 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:57.050962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-7c526f1f-9131-47ac-b790-841dcebbde31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:57.050962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:57.050962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:57.050962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:57.050962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:57.050962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:57.050962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:57.050962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:57.050962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:57.050962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:57.050962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:57.050962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:57.050962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:57.050962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:57.050962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:57.050962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:57.051899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:57.051899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:57.051899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:57.051899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:57.051899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:57.051899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:57.051899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:57.051899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:57.051899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:57.051899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:57.051899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:57.051899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:57.051899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:57.051899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:57.051899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:57.051899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:57.052831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:57.052831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:57.052831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:57.052831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:57.052831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:57.052831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:57.052831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:57.052831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:57.052831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:57.052831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:57.052831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:11:57.052831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:57.052831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 371/746] 10.222.0.71 () {56 vars in 1102 bytes} [Mon May 16 20:11:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:57.054029 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5df3b-772c-440e-80f2-590cc2277d54 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:57.054029 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5df3b-772c-440e-80f2-590cc2277d54 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:57.054261 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5df3b-772c-440e-80f2-590cc2277d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:57.071262 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-afe5df3b-772c-440e-80f2-590cc2277d54 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:57.072454 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-afe5df3b-772c-440e-80f2-590cc2277d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:57.083384 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d5873-726d-4c7b-8626-3ef4fe40b9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:57.084221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d5873-726d-4c7b-8626-3ef4fe40b9da None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:57.084507 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d5873-726d-4c7b-8626-3ef4fe40b9da None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:57.084781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d5873-726d-4c7b-8626-3ef4fe40b9da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:57.095900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d5873-726d-4c7b-8626-3ef4fe40b9da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:57.097642 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d5873-726d-4c7b-8626-3ef4fe40b9da None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:57.116564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-b94d5873-726d-4c7b-8626-3ef4fe40b9da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:57.116564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:57.116564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:57.116564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:57.116564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:57.116564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:57.116564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:57.116564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:57.116564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:57.116564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:57.116564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:57.116564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:57.116564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:57.116564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:57.116564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:57.117508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:57.117508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:57.117508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:57.117508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:57.117508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:57.117508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:57.117508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:57.117508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:57.117508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:57.117508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:57.117508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:57.117508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:57.117508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:57.117508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:57.117508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:57.117508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:57.117508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:57.118406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:57.118406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:57.118406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:57.118406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:57.118406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 376/747] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:57.118692 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d5873-726d-4c7b-8626-3ef4fe40b9da None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:57.149428 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 372/748] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:57 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 20:11:57.151088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5df3b-772c-440e-80f2-590cc2277d54 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:57.243285 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d5873-726d-4c7b-8626-3ef4fe40b9da None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:57.261855 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5df3b-772c-440e-80f2-590cc2277d54 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:57.278101 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6321ea2-3265-4564-9c94-b0bb749d5aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:57.278781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6321ea2-3265-4564-9c94-b0bb749d5aa4 None admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:57.279057 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6321ea2-3265-4564-9c94-b0bb749d5aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:57.279335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6321ea2-3265-4564-9c94-b0bb749d5aa4 None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:57.280067 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6321ea2-3265-4564-9c94-b0bb749d5aa4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:57.281608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6321ea2-3265-4564-9c94-b0bb749d5aa4 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:57.298341 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 377/749] 10.222.0.71 () {60 vars in 1141 bytes} [Mon May 16 20:11:57 2022] POST /identity/v3/services => generated 240 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:11:57.299932 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6321ea2-3265-4564-9c94-b0bb749d5aa4 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:57.317485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002c804-40aa-43cd-ac70-5cdd6854ad75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:57.318483 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002c804-40aa-43cd-ac70-5cdd6854ad75 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:57.318914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002c804-40aa-43cd-ac70-5cdd6854ad75 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:57.319329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002c804-40aa-43cd-ac70-5cdd6854ad75 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:57.320366 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002c804-40aa-43cd-ac70-5cdd6854ad75 None admin] RBAC: Adding query filter params (name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:57.320836 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002c804-40aa-43cd-ac70-5cdd6854ad75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:57.322492 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002c804-40aa-43cd-ac70-5cdd6854ad75 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:57.332953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 373/750] 10.222.0.71 () {56 vars in 1103 bytes} [Mon May 16 20:11:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:57.334161 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002c804-40aa-43cd-ac70-5cdd6854ad75 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:57.437244 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6321ea2-3265-4564-9c94-b0bb749d5aa4 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:57.463654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002c804-40aa-43cd-ac70-5cdd6854ad75 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:57.479646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f27ce8-6548-42a5-ba6b-94291384713c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:57.480547 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f27ce8-6548-42a5-ba6b-94291384713c None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:57.480971 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f27ce8-6548-42a5-ba6b-94291384713c None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:57.481354 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f27ce8-6548-42a5-ba6b-94291384713c None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:57.482244 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f27ce8-6548-42a5-ba6b-94291384713c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:57.482647 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f27ce8-6548-42a5-ba6b-94291384713c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:57.484332 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f27ce8-6548-42a5-ba6b-94291384713c None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:57.503780 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 378/751] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:57.505215 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f27ce8-6548-42a5-ba6b-94291384713c None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:57.510997 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9fd9e-cdfb-4d5e-b5af-9f84c60d9715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:57.512806 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9fd9e-cdfb-4d5e-b5af-9f84c60d9715 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:57.513588 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9fd9e-cdfb-4d5e-b5af-9f84c60d9715 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:57.514058 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9fd9e-cdfb-4d5e-b5af-9f84c60d9715 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:57.515575 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de9fd9e-cdfb-4d5e-b5af-9f84c60d9715 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:57.518322 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de9fd9e-cdfb-4d5e-b5af-9f84c60d9715 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:57.536316 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-1de9fd9e-cdfb-4d5e-b5af-9f84c60d9715 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 20:11:57.536316 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:57.536316 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:11:57.536316 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:11:57.536316 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:11:57.536316 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:11:57.536316 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:11:57.536316 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:11:57.536316 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 20:11:57.536316 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:57.536316 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:11:57.536316 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:57.536316 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:57.536316 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:57.536316 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:57.536316 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:57.537330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:57.537330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:57.537330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:57.537330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:57.537330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:57.537330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:57.537330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:57.537330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:11:57.537330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:11:57.537330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:11:57.537330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:11:57.537330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:57.537330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:57.537330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:57.537330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:57.537330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:57.538153 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:57.538153 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:57.538153 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:57.538153 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:57.538153 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:57.538153 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:57.538153 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:57.538153 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:57.538153 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:57.538153 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:57.538153 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:57.538153 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:11:57.538153 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:11:57.538153 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 20:11:57.538153 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:57.539461 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 374/752] 10.222.0.71 () {56 vars in 1129 bytes} [Mon May 16 20:11:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:57.540699 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9fd9e-cdfb-4d5e-b5af-9f84c60d9715 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:57.650370 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f27ce8-6548-42a5-ba6b-94291384713c None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:57.712218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ce97e-df62-41a0-a9b0-d4f22c424d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:57.713591 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ce97e-df62-41a0-a9b0-d4f22c424d0a None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:57.714237 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ce97e-df62-41a0-a9b0-d4f22c424d0a None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:57.714728 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ce97e-df62-41a0-a9b0-d4f22c424d0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:57.723768 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9fd9e-cdfb-4d5e-b5af-9f84c60d9715 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:57.738482 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ce97e-df62-41a0-a9b0-d4f22c424d0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:57.742789 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ce97e-df62-41a0-a9b0-d4f22c424d0a None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:57.766672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-0b4ce97e-df62-41a0-a9b0-d4f22c424d0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:57.766672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:57.766672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:57.766672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:57.766672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:57.766672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:57.766672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:57.766672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:57.766672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:57.766672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:57.766672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:57.766672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:57.766672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:57.766672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:57.766672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:57.768475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:57.768475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:57.768475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:57.768475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:57.768475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:57.768475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:57.768475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:57.768475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:57.768475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:57.768475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:57.768475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:57.768475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:57.768475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:57.768475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:57.768475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:57.768475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:57.768475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:57.769374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:57.769374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:57.769374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:57.769374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:57.769374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 379/753] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:57.772851 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ce97e-df62-41a0-a9b0-d4f22c424d0a None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:57.788186 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fee1d7-5620-44d9-8476-b457743e67fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:57.789587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fee1d7-5620-44d9-8476-b457743e67fc None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:57.790093 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fee1d7-5620-44d9-8476-b457743e67fc None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:57.790581 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fee1d7-5620-44d9-8476-b457743e67fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:57.805561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fee1d7-5620-44d9-8476-b457743e67fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:57.808488 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fee1d7-5620-44d9-8476-b457743e67fc None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:57.826910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-21fee1d7-5620-44d9-8476-b457743e67fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 20:11:57.826910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:57.826910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:57.826910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:57.826910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:57.826910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:57.826910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:57.826910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:57.826910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:57.826910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:57.826910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:57.826910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:57.826910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:11:57.826910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:11:57.826910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:11:57.826910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:11:57.829593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:57.829593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:57.829593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:11:57.829593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:57.829593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:11:57.829593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:57.829593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:57.829593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:57.829593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:57.829593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:57.829593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:57.829593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:57.829593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:57.829593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:57.829593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:57.829593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:57.829593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:57.829593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:57.832216 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:57.832216 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:57.832216 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:11:57.832216 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:11:57.832216 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:11:57.832216 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:11:57.832216 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:11:57.832216 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:11:57.832216 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 20:11:57.832216 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:57.832216 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 375/754] 10.222.0.71 () {56 vars in 1093 bytes} [Mon May 16 20:11:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:57.832216 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fee1d7-5620-44d9-8476-b457743e67fc None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:57.895574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ce97e-df62-41a0-a9b0-d4f22c424d0a None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:57.930634 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310a136-dbf4-4edc-8255-d85a6888aba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:57.931300 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310a136-dbf4-4edc-8255-d85a6888aba3 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:57.931577 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310a136-dbf4-4edc-8255-d85a6888aba3 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:57.931847 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310a136-dbf4-4edc-8255-d85a6888aba3 None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:57.932579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310a136-dbf4-4edc-8255-d85a6888aba3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:57.932883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310a136-dbf4-4edc-8255-d85a6888aba3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:57.934274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310a136-dbf4-4edc-8255-d85a6888aba3 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:57.944431 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 380/755] 10.222.0.71 () {56 vars in 1124 bytes} [Mon May 16 20:11:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:57.945360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310a136-dbf4-4edc-8255-d85a6888aba3 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:57.947187 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fee1d7-5620-44d9-8476-b457743e67fc None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:57.994684 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9fdb4-32f6-4a13-bb6e-84e4a52d8770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:57.995473 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9fdb4-32f6-4a13-bb6e-84e4a52d8770 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:57.995899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9fdb4-32f6-4a13-bb6e-84e4a52d8770 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:57.996314 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9fdb4-32f6-4a13-bb6e-84e4a52d8770 None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:57.997151 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9fdb4-32f6-4a13-bb6e-84e4a52d8770 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:57.997584 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9fdb4-32f6-4a13-bb6e-84e4a52d8770 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:57.999080 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9fdb4-32f6-4a13-bb6e-84e4a52d8770 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:58.014539 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 376/756] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:58.016037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9fdb4-32f6-4a13-bb6e-84e4a52d8770 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:58.096317 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310a136-dbf4-4edc-8255-d85a6888aba3 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:58.151155 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c3c70-91a9-46cf-b3ea-35ae7d7d857f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:58.152042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c3c70-91a9-46cf-b3ea-35ae7d7d857f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:58.152462 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c3c70-91a9-46cf-b3ea-35ae7d7d857f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:58.152887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c3c70-91a9-46cf-b3ea-35ae7d7d857f None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:58.153979 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c3c70-91a9-46cf-b3ea-35ae7d7d857f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:58.154391 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c3c70-91a9-46cf-b3ea-35ae7d7d857f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:58.156129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c3c70-91a9-46cf-b3ea-35ae7d7d857f None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:58.167456 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9fdb4-32f6-4a13-bb6e-84e4a52d8770 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:58.176687 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 381/757] 10.222.0.71 () {56 vars in 1133 bytes} [Mon May 16 20:11:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:58.177773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c3c70-91a9-46cf-b3ea-35ae7d7d857f None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:58.208077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53cc8c-89f0-4071-9cd6-c4f8e08a0eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:58.208789 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53cc8c-89f0-4071-9cd6-c4f8e08a0eaf None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:58.209068 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53cc8c-89f0-4071-9cd6-c4f8e08a0eaf None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:58.209338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53cc8c-89f0-4071-9cd6-c4f8e08a0eaf None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:58.210053 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53cc8c-89f0-4071-9cd6-c4f8e08a0eaf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:58.210359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53cc8c-89f0-4071-9cd6-c4f8e08a0eaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:58.211771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53cc8c-89f0-4071-9cd6-c4f8e08a0eaf None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:58.217390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 377/758] 10.222.0.71 () {56 vars in 1124 bytes} [Mon May 16 20:11:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:58.218212 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53cc8c-89f0-4071-9cd6-c4f8e08a0eaf None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:58.284951 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c3c70-91a9-46cf-b3ea-35ae7d7d857f None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:58.321669 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10326771-bfca-41f6-bc8c-11478a03ad16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:58.322708 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10326771-bfca-41f6-bc8c-11478a03ad16 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:58.323150 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10326771-bfca-41f6-bc8c-11478a03ad16 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:58.323263 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53cc8c-89f0-4071-9cd6-c4f8e08a0eaf None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:58.323609 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10326771-bfca-41f6-bc8c-11478a03ad16 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:58.333576 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10326771-bfca-41f6-bc8c-11478a03ad16 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:58.335239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10326771-bfca-41f6-bc8c-11478a03ad16 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:58.352104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-10326771-bfca-41f6-bc8c-11478a03ad16 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 20:11:58.352104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:58.352104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:58.352104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:58.352104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:58.352104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:58.352104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:58.352104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:58.352104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:58.352104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:58.352104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:58.352104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:58.352104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:11:58.352104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:11:58.352104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:11:58.352104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:11:58.354104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:58.354104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:58.354104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:11:58.354104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:58.354104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:11:58.354104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:11:58.354104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:58.354104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:58.354104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:58.354104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:58.354104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:58.354104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:58.354104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:58.354104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:58.354104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:58.354104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:58.354104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:58.354104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:58.355637 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:58.355637 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:58.355637 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:11:58.355637 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:11:58.355637 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:11:58.355637 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:11:58.355637 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:11:58.355637 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:11:58.355637 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 20:11:58.355637 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:58.364187 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 382/759] 10.222.0.71 () {56 vars in 1117 bytes} [Mon May 16 20:11:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:58.364187 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10326771-bfca-41f6-bc8c-11478a03ad16 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:58.367536 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54079a6-d937-43dd-8ef6-5f7623bd0f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:58.369058 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54079a6-d937-43dd-8ef6-5f7623bd0f0c None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:58.369338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54079a6-d937-43dd-8ef6-5f7623bd0f0c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:58.369605 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54079a6-d937-43dd-8ef6-5f7623bd0f0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:58.384861 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54079a6-d937-43dd-8ef6-5f7623bd0f0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:58.387367 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54079a6-d937-43dd-8ef6-5f7623bd0f0c None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:58.410709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-c54079a6-d937-43dd-8ef6-5f7623bd0f0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:58.410709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:58.410709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:58.410709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:58.410709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:58.410709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:58.410709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:58.410709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:58.410709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:58.410709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:58.410709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:58.410709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:58.410709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:58.410709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:58.410709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:58.411626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:58.411626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:58.411626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:58.411626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:58.411626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:58.411626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:58.411626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:58.411626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:58.411626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:58.411626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:58.411626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:58.411626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:58.411626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:58.411626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:58.411626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:58.411626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:58.411626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:58.412570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:58.412570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:58.412570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:58.412570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:58.417093 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 378/760] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:58.417093 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54079a6-d937-43dd-8ef6-5f7623bd0f0c None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:58.482990 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10326771-bfca-41f6-bc8c-11478a03ad16 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:58.518313 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1065fe-9d48-45b9-b59a-d42a4ba3a50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:58.519038 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1065fe-9d48-45b9-b59a-d42a4ba3a50d None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:58.519322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1065fe-9d48-45b9-b59a-d42a4ba3a50d None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:58.519594 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1065fe-9d48-45b9-b59a-d42a4ba3a50d None admin] PATH_INFO: `/v3/endpoints` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:58.520474 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1065fe-9d48-45b9-b59a-d42a4ba3a50d None admin] RBAC: Adding query filter params (interface=public, service_id=76d96da071a044d587b6ff0df6a714ec, region_id=RegionOne) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:58.520788 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1065fe-9d48-45b9-b59a-d42a4ba3a50d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:58.522478 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1065fe-9d48-45b9-b59a-d42a4ba3a50d None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:58.530929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 383/761] 10.222.0.71 () {56 vars in 1251 bytes} [Mon May 16 20:11:58 2022] GET /identity/v3/endpoints?service_id=76d96da071a044d587b6ff0df6a714ec&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:58.531764 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1065fe-9d48-45b9-b59a-d42a4ba3a50d None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:58.538166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54079a6-d937-43dd-8ef6-5f7623bd0f0c None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:58.580621 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69df3cb-2e79-4801-93fc-d6564c5a0a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:58.581393 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69df3cb-2e79-4801-93fc-d6564c5a0a76 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:58.581697 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69df3cb-2e79-4801-93fc-d6564c5a0a76 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:58.581968 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69df3cb-2e79-4801-93fc-d6564c5a0a76 None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:58.582818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69df3cb-2e79-4801-93fc-d6564c5a0a76 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:58.583127 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69df3cb-2e79-4801-93fc-d6564c5a0a76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:58.584746 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69df3cb-2e79-4801-93fc-d6564c5a0a76 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:58.605533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 379/762] 10.222.0.71 () {56 vars in 1149 bytes} [Mon May 16 20:11:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:58.606931 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69df3cb-2e79-4801-93fc-d6564c5a0a76 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:58.655105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1065fe-9d48-45b9-b59a-d42a4ba3a50d None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:58.693271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a9e26-f45a-4893-ac62-c40127bd9192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:58.693941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a9e26-f45a-4893-ac62-c40127bd9192 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:58.694344 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a9e26-f45a-4893-ac62-c40127bd9192 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:58.694657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a9e26-f45a-4893-ac62-c40127bd9192 None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:58.695643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a9e26-f45a-4893-ac62-c40127bd9192 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:58.696488 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a9e26-f45a-4893-ac62-c40127bd9192 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:58.700671 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a9e26-f45a-4893-ac62-c40127bd9192 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:58.716012 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 384/763] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:58.717127 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a9e26-f45a-4893-ac62-c40127bd9192 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:58.732637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69df3cb-2e79-4801-93fc-d6564c5a0a76 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:58.776097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24579761-d6cd-41fb-bd89-3a15b0d2f62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:58.776798 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24579761-d6cd-41fb-bd89-3a15b0d2f62b None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:58.777135 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24579761-d6cd-41fb-bd89-3a15b0d2f62b None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:58.777408 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24579761-d6cd-41fb-bd89-3a15b0d2f62b None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:58.778164 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24579761-d6cd-41fb-bd89-3a15b0d2f62b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:58.779569 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24579761-d6cd-41fb-bd89-3a15b0d2f62b None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:58.785734 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 380/764] 10.222.0.71 () {56 vars in 1087 bytes} [Mon May 16 20:11:58 2022] GET /identity/v3/services => generated 772 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:58.786936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24579761-d6cd-41fb-bd89-3a15b0d2f62b None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:58.854146 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a9e26-f45a-4893-ac62-c40127bd9192 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:58.898369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24579761-d6cd-41fb-bd89-3a15b0d2f62b None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:58.899151 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c0398-7896-4b70-897f-c1f0ec96a0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:58.899806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c0398-7896-4b70-897f-c1f0ec96a0b0 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:58.900086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c0398-7896-4b70-897f-c1f0ec96a0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:58.900388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c0398-7896-4b70-897f-c1f0ec96a0b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:58.953119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb76fa9-81d1-4ffc-93a9-5d867744c045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:58.954955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb76fa9-81d1-4ffc-93a9-5d867744c045 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:58.955755 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb76fa9-81d1-4ffc-93a9-5d867744c045 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:58.956448 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb76fa9-81d1-4ffc-93a9-5d867744c045 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:58.965000 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb76fa9-81d1-4ffc-93a9-5d867744c045 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:58.966910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb76fa9-81d1-4ffc-93a9-5d867744c045 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:58.996313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-ccb76fa9-81d1-4ffc-93a9-5d867744c045 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:58.996313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:58.996313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:58.996313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:58.996313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:58.996313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:58.996313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:58.996313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:58.996313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:58.996313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:58.996313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:58.996313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:58.996313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:11:58.996313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:11:58.996313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:11:58.997365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:11:58.997365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:58.997365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:58.997365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:58.997365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:58.997365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:58.997365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:58.997365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:58.997365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:58.997365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:58.997365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:58.997365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:58.997365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:58.997365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:58.997365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:58.997365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:58.997365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:58.998255 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:11:58.998255 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:11:58.998255 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:11:58.998255 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:11:58.998255 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:11:58.998255 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:11:58.998255 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:11:58.998255 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:59.001196 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 381/765] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:11:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:59.006973 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb76fa9-81d1-4ffc-93a9-5d867744c045 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:59.170068 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb76fa9-81d1-4ffc-93a9-5d867744c045 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:59.172180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c0398-7896-4b70-897f-c1f0ec96a0b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:59.174893 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c0398-7896-4b70-897f-c1f0ec96a0b0 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:59.228528 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e912c0-9ab9-4d13-8b59-a1245991758a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:59.229530 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e912c0-9ab9-4d13-8b59-a1245991758a None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:59.229748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e912c0-9ab9-4d13-8b59-a1245991758a None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:59.230005 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e912c0-9ab9-4d13-8b59-a1245991758a None admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:59.230895 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e912c0-9ab9-4d13-8b59-a1245991758a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:59.231301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e912c0-9ab9-4d13-8b59-a1245991758a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:59.232864 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e912c0-9ab9-4d13-8b59-a1245991758a None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:59.255166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 382/766] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:11:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:11:59.256941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d3f15-5c77-4b8b-b1ed-f7f51104c5bd None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:59.257428 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d3f15-5c77-4b8b-b1ed-f7f51104c5bd None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:59.257793 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d3f15-5c77-4b8b-b1ed-f7f51104c5bd None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:59.260988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 383/767] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:11:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:11:59.262065 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d3f15-5c77-4b8b-b1ed-f7f51104c5bd None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:59.309765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 385/768] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:11:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:11:59.312201 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbdbf8-35b7-4ae6-b81b-9bb2cd21b5bc None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:59.312495 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbdbf8-35b7-4ae6-b81b-9bb2cd21b5bc None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:59.312770 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbdbf8-35b7-4ae6-b81b-9bb2cd21b5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:59.334246 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-b2bbdbf8-35b7-4ae6-b81b-9bb2cd21b5bc None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:11:59.335725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-b2bbdbf8-35b7-4ae6-b81b-9bb2cd21b5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:11:59.389445 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d3f15-5c77-4b8b-b1ed-f7f51104c5bd None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:59.428254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 386/769] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:11:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:11:59.428254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bbdbf8-35b7-4ae6-b81b-9bb2cd21b5bc None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:59.443879 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203925b-5ae7-437e-80d4-27da8c3b5fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:59.445143 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203925b-5ae7-437e-80d4-27da8c3b5fe4 None admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:59.445563 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203925b-5ae7-437e-80d4-27da8c3b5fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:59.445971 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203925b-5ae7-437e-80d4-27da8c3b5fe4 None admin] PATH_INFO: `/v3/projects/121ed31a143d49b3a16ac6c5c6b28955/users/242d4f9634a74013af05f50981280864/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:59.448276 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203925b-5ae7-437e-80d4-27da8c3b5fe4 None admin] RBAC: Authorizing `identity:create_grant(project_id=121ed31a143d49b3a16ac6c5c6b28955, user_id=242d4f9634a74013af05f50981280864, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:59.449998 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203925b-5ae7-437e-80d4-27da8c3b5fe4 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:59.469112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 384/770] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:11:59 2022] PUT /identity/v3/projects/121ed31a143d49b3a16ac6c5c6b28955/users/242d4f9634a74013af05f50981280864/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:11:59.474510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203925b-5ae7-437e-80d4-27da8c3b5fe4 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:59.644658 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203925b-5ae7-437e-80d4-27da8c3b5fe4 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:59.652656 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bbdbf8-35b7-4ae6-b81b-9bb2cd21b5bc None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:59.703712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9095f2b-1ee4-4691-956a-86be8b6b48bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:59.704928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9095f2b-1ee4-4691-956a-86be8b6b48bc None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:59.705879 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9095f2b-1ee4-4691-956a-86be8b6b48bc None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:59.705879 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9095f2b-1ee4-4691-956a-86be8b6b48bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:59.727651 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9095f2b-1ee4-4691-956a-86be8b6b48bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:11:59.741132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-f9095f2b-1ee4-4691-956a-86be8b6b48bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:11:59.741132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:59.741132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:59.741132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:59.741132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:59.741132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:59.741132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:59.741132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:59.741132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:59.741132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:59.741132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:59.741132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:59.741132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:11:59.741132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:11:59.741132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:11:59.741132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:11:59.742636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:11:59.742636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:11:59.742636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:11:59.742636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:11:59.742636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:59.742636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:59.742636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:59.742636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:59.742636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:59.742636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:59.742636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:59.742636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:11:59.742636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:59.742636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:59.742636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:59.742636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:59.743943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:59.743943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:59.743943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:59.743943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:59.743943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:11:59.743943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:11:59.743943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:11:59.743943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:11:59.743943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:11:59.743943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:11:59.743943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:11:59.743943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:11:59.749005 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 385/771] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:11:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:59.750371 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9095f2b-1ee4-4691-956a-86be8b6b48bc None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:59.772888 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497a35b-21e9-4a90-aab3-44a553b90982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:59.773707 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497a35b-21e9-4a90-aab3-44a553b90982 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:59.773986 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497a35b-21e9-4a90-aab3-44a553b90982 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:59.774260 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497a35b-21e9-4a90-aab3-44a553b90982 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:59.801370 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c497a35b-21e9-4a90-aab3-44a553b90982 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:59.802871 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c497a35b-21e9-4a90-aab3-44a553b90982 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:59.835346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-c497a35b-21e9-4a90-aab3-44a553b90982 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:59.835346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:11:59.835346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:11:59.835346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:11:59.835346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:11:59.835346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:11:59.835346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:11:59.835346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:11:59.835346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:11:59.835346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:11:59.835346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:11:59.835346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:11:59.835346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:11:59.835346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:11:59.835346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:11:59.836360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:11:59.836360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:11:59.836360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:11:59.836360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:11:59.836360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:11:59.836360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:11:59.836360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:11:59.836360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:11:59.836360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:11:59.836360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:11:59.836360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:11:59.836360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:11:59.836360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:11:59.836360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:11:59.836360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:11:59.836360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:11:59.836360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:11:59.837254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:11:59.837254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:11:59.837254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:11:59.837254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:11:59.838807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 387/772] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:11:59.844532 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497a35b-21e9-4a90-aab3-44a553b90982 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:11:59.887466 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9095f2b-1ee4-4691-956a-86be8b6b48bc None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:11:59.929400 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48667e18-26d2-4951-ae07-85c27d4fb864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:11:59.930078 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48667e18-26d2-4951-ae07-85c27d4fb864 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:11:59.930362 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48667e18-26d2-4951-ae07-85c27d4fb864 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:11:59.930637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48667e18-26d2-4951-ae07-85c27d4fb864 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:11:59.931399 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48667e18-26d2-4951-ae07-85c27d4fb864 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:11:59.931703 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48667e18-26d2-4951-ae07-85c27d4fb864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:11:59.934365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48667e18-26d2-4951-ae07-85c27d4fb864 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:11:59.945899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 386/773] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:11:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:11:59.953244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48667e18-26d2-4951-ae07-85c27d4fb864 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:00.038268 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497a35b-21e9-4a90-aab3-44a553b90982 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:00.098955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14133a61-cc1d-42a0-a5ac-a820d5d57afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:00.099633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14133a61-cc1d-42a0-a5ac-a820d5d57afa None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:00.099915 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14133a61-cc1d-42a0-a5ac-a820d5d57afa None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:00.100259 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14133a61-cc1d-42a0-a5ac-a820d5d57afa None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:00.101091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14133a61-cc1d-42a0-a5ac-a820d5d57afa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:00.101489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14133a61-cc1d-42a0-a5ac-a820d5d57afa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:00.103081 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14133a61-cc1d-42a0-a5ac-a820d5d57afa None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:00.116548 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 388/774] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:00.118038 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602b3d9-f87b-409d-ab8e-d02223d099ab None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:00.118348 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602b3d9-f87b-409d-ab8e-d02223d099ab None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:00.118622 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602b3d9-f87b-409d-ab8e-d02223d099ab None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:00.124301 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 389/775] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:00.125193 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602b3d9-f87b-409d-ab8e-d02223d099ab None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:00.128541 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48667e18-26d2-4951-ae07-85c27d4fb864 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:00.173696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5aac2c-f60f-4b35-bf87-0c3702f87f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:00.175873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5aac2c-f60f-4b35-bf87-0c3702f87f32 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:00.176365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5aac2c-f60f-4b35-bf87-0c3702f87f32 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:00.176813 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5aac2c-f60f-4b35-bf87-0c3702f87f32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:00.191514 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5aac2c-f60f-4b35-bf87-0c3702f87f32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:00.194027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5aac2c-f60f-4b35-bf87-0c3702f87f32 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:00.222795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-ad5aac2c-f60f-4b35-bf87-0c3702f87f32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:00.222795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:00.222795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:00.222795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:00.222795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:00.222795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:00.222795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:00.222795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:00.222795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:00.222795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:00.222795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:00.222795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:00.222795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:12:00.222795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:12:00.222795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:12:00.223955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:12:00.223955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:00.223955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:00.223955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:00.223955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:00.223955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:00.223955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:00.223955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:00.223955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:00.223955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:00.223955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:00.223955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:00.223955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:00.223955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:00.223955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:00.223955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:00.223955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:00.225085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:12:00.225085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:12:00.225085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:00.225085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:00.230541 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 387/776] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:00.230541 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce6c49-847b-4b89-8148-a37225a6365b None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:00.230541 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce6c49-847b-4b89-8148-a37225a6365b None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:00.230541 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce6c49-847b-4b89-8148-a37225a6365b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:00.249285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-24ce6c49-847b-4b89-8148-a37225a6365b None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:00.250458 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-24ce6c49-847b-4b89-8148-a37225a6365b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:00.256929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602b3d9-f87b-409d-ab8e-d02223d099ab None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:00.303083 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8535984-f109-43cf-9c4b-aeb613d2053b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:00.304091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8535984-f109-43cf-9c4b-aeb613d2053b None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:00.304788 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8535984-f109-43cf-9c4b-aeb613d2053b None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:00.305134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8535984-f109-43cf-9c4b-aeb613d2053b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:00.314172 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8535984-f109-43cf-9c4b-aeb613d2053b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:00.316098 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8535984-f109-43cf-9c4b-aeb613d2053b None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:00.321714 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 388/777] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:00.322713 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce6c49-847b-4b89-8148-a37225a6365b None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:00.344243 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-e8535984-f109-43cf-9c4b-aeb613d2053b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:00.344243 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:00.344243 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:00.344243 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:00.344243 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:00.344243 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:00.344243 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:00.344243 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:00.344243 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:00.344243 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:00.344243 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:00.344243 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:00.344243 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:12:00.344243 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:12:00.344243 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:12:00.345924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:12:00.345924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:00.345924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:00.345924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:00.345924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:00.345924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:00.345924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:00.345924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:00.345924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:00.345924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:00.345924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:00.345924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:00.345924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:00.345924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:00.345924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:00.345924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:00.345924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:00.346883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:12:00.346883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:12:00.346883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:12:00.346883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:12:00.346883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:12:00.346883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:12:00.346883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:00.346883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:00.351200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 390/778] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:12:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:00.352271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8535984-f109-43cf-9c4b-aeb613d2053b None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:00.461484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce6c49-847b-4b89-8148-a37225a6365b None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:00.472518 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8535984-f109-43cf-9c4b-aeb613d2053b None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:00.507934 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2830ff-6e17-48de-b7af-fcc0bdd151e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:00.508693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b879d8b-803c-43a4-8de1-6402f6ec4e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:00.508818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2830ff-6e17-48de-b7af-fcc0bdd151e7 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:00.509033 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2830ff-6e17-48de-b7af-fcc0bdd151e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:00.509308 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2830ff-6e17-48de-b7af-fcc0bdd151e7 None admin] PATH_INFO: `/v3/services/network` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:00.510102 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b879d8b-803c-43a4-8de1-6402f6ec4e7e None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:00.510591 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b879d8b-803c-43a4-8de1-6402f6ec4e7e None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:00.511052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b879d8b-803c-43a4-8de1-6402f6ec4e7e None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:00.511155 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2830ff-6e17-48de-b7af-fcc0bdd151e7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:00.512080 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b879d8b-803c-43a4-8de1-6402f6ec4e7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:00.512485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2830ff-6e17-48de-b7af-fcc0bdd151e7 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:00.512823 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b879d8b-803c-43a4-8de1-6402f6ec4e7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:00.514651 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b879d8b-803c-43a4-8de1-6402f6ec4e7e None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:00.526578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-fd2830ff-6e17-48de-b7af-fcc0bdd151e7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 20:12:00.526578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:00.526578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:12:00.526578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:12:00.526578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:12:00.526578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:12:00.526578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:12:00.526578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:00.526578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 20:12:00.526578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:00.526578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:12:00.526578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:00.526578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:00.526578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:00.526578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:00.526578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:00.526578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:00.527657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:00.527657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:00.527657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:00.527657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:00.527657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:00.527657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:00.527657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:12:00.527657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:12:00.527657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:12:00.527657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:12:00.527657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:00.527657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:00.527657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:00.527657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:00.527657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:00.527657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:00.528551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:00.528551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:00.528551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:00.528551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:00.528551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:00.528551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:00.528551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:00.528551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:00.528551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:00.528551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:00.528551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:12:00.528551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:00.528551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 20:12:00.528551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:00.535874 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 391/780] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:12:00 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:00.535874 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2830ff-6e17-48de-b7af-fcc0bdd151e7 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:00.536355 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 389/780] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:00.537181 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b879d8b-803c-43a4-8de1-6402f6ec4e7e None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:00.670602 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2830ff-6e17-48de-b7af-fcc0bdd151e7 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:00.680995 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b879d8b-803c-43a4-8de1-6402f6ec4e7e None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:00.711590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1917f43-2278-4dd2-823d-314621f5b2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:00.712327 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1917f43-2278-4dd2-823d-314621f5b2a0 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:00.712611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1917f43-2278-4dd2-823d-314621f5b2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:00.713362 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1917f43-2278-4dd2-823d-314621f5b2a0 None admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:00.714162 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1917f43-2278-4dd2-823d-314621f5b2a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:00.714478 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1917f43-2278-4dd2-823d-314621f5b2a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:00.716224 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1917f43-2278-4dd2-823d-314621f5b2a0 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:00.731413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 392/781] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:12:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:00.732308 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1917f43-2278-4dd2-823d-314621f5b2a0 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:00.734458 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b6001-a26e-489d-8274-8c8f50fc7549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:00.736025 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b6001-a26e-489d-8274-8c8f50fc7549 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:00.736546 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b6001-a26e-489d-8274-8c8f50fc7549 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:00.737130 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b6001-a26e-489d-8274-8c8f50fc7549 None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:00.738385 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b6001-a26e-489d-8274-8c8f50fc7549 None admin] RBAC: Adding query filter params (name=network) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:00.738920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b6001-a26e-489d-8274-8c8f50fc7549 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:00.741567 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b6001-a26e-489d-8274-8c8f50fc7549 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:00.753542 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 390/782] 10.222.0.71 () {56 vars in 1112 bytes} [Mon May 16 20:12:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:00.754514 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b6001-a26e-489d-8274-8c8f50fc7549 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:00.858142 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1917f43-2278-4dd2-823d-314621f5b2a0 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:00.864687 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b6001-a26e-489d-8274-8c8f50fc7549 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:00.905211 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a89a1c-e480-48cb-ac50-e3f38805d034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:00.906031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a89a1c-e480-48cb-ac50-e3f38805d034 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:00.906333 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a89a1c-e480-48cb-ac50-e3f38805d034 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:00.906615 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a89a1c-e480-48cb-ac50-e3f38805d034 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:00.917147 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a89a1c-e480-48cb-ac50-e3f38805d034 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:00.918690 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc7ca9-1840-4f90-8a48-d3388e47a0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:00.918824 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a89a1c-e480-48cb-ac50-e3f38805d034 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:00.919798 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc7ca9-1840-4f90-8a48-d3388e47a0c3 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:00.920328 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc7ca9-1840-4f90-8a48-d3388e47a0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:00.920875 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc7ca9-1840-4f90-8a48-d3388e47a0c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:00.921841 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc7ca9-1840-4f90-8a48-d3388e47a0c3 None admin] RBAC: Adding query filter params (role.id=bd4b3497427646f48a7c4d949e498ebc, scope.project.id=121ed31a143d49b3a16ac6c5c6b28955, user.id=38a56f3572874938ad4642fa34751a9a) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:00.922192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc7ca9-1840-4f90-8a48-d3388e47a0c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:00.928043 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc7ca9-1840-4f90-8a48-d3388e47a0c3 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:00.934586 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 391/783] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:12:00 2022] GET /identity/v3/role_assignments?user.id=38a56f3572874938ad4642fa34751a9a&scope.project.id=121ed31a143d49b3a16ac6c5c6b28955&role.id=bd4b3497427646f48a7c4d949e498ebc => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:00.935440 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc7ca9-1840-4f90-8a48-d3388e47a0c3 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:00.935749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-d0a89a1c-e480-48cb-ac50-e3f38805d034 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 20:12:00.935749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:00.935749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:00.935749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:00.935749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:00.935749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:00.935749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:00.935749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:00.935749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:00.935749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:00.935749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:00.935749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:00.935749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:12:00.935749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:12:00.935749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:12:00.935749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:12:00.938234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:00.938234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:00.938234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:12:00.938234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:00.938234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:12:00.938234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:00.938234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:00.938234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:00.938234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:00.938234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:00.938234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:00.938234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:00.938234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:00.938234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:00.938234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:00.938234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:00.938234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:00.938234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:00.940737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:00.940737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:00.940737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:12:00.940737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:12:00.940737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:12:00.940737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:12:00.940737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:12:00.940737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:12:00.940737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 20:12:00.940737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:00.940737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 393/784] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:12:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:00.963152 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a89a1c-e480-48cb-ac50-e3f38805d034 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:01.083423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc7ca9-1840-4f90-8a48-d3388e47a0c3 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:01.137086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e906fb1-a802-47bf-80f3-f778b0de3834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:01.137825 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e906fb1-a802-47bf-80f3-f778b0de3834 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:01.138107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e906fb1-a802-47bf-80f3-f778b0de3834 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:01.138429 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e906fb1-a802-47bf-80f3-f778b0de3834 None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:01.139154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e906fb1-a802-47bf-80f3-f778b0de3834 None admin] RBAC: Adding query filter params (type=network) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:01.139454 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e906fb1-a802-47bf-80f3-f778b0de3834 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:01.141142 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e906fb1-a802-47bf-80f3-f778b0de3834 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:01.156314 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 392/785] 10.222.0.71 () {56 vars in 1112 bytes} [Mon May 16 20:12:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:01.157394 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e906fb1-a802-47bf-80f3-f778b0de3834 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:01.163292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a89a1c-e480-48cb-ac50-e3f38805d034 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:01.214061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc59a3c-dd46-439f-b9e9-c11ae9b13cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:01.214655 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc59a3c-dd46-439f-b9e9-c11ae9b13cad None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:01.214958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc59a3c-dd46-439f-b9e9-c11ae9b13cad None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:01.215207 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc59a3c-dd46-439f-b9e9-c11ae9b13cad None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:01.216042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc59a3c-dd46-439f-b9e9-c11ae9b13cad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:01.216380 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc59a3c-dd46-439f-b9e9-c11ae9b13cad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:01.217820 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc59a3c-dd46-439f-b9e9-c11ae9b13cad None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:01.275427 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 394/786] 10.222.0.71 () {56 vars in 1135 bytes} [Mon May 16 20:12:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:01.282333 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc59a3c-dd46-439f-b9e9-c11ae9b13cad None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:01.341315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e906fb1-a802-47bf-80f3-f778b0de3834 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:01.437068 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a9fe4-16e4-4d01-9e39-dd1bc2451249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:01.437740 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a9fe4-16e4-4d01-9e39-dd1bc2451249 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:01.438016 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a9fe4-16e4-4d01-9e39-dd1bc2451249 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:01.438374 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a9fe4-16e4-4d01-9e39-dd1bc2451249 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:01.440185 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a9fe4-16e4-4d01-9e39-dd1bc2451249 None admin] RBAC: Adding query filter params (interface=public, service_id=ecff7a626e8a4fda8bb101d9732d1e83, region_id=RegionOne) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:01.440504 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a9fe4-16e4-4d01-9e39-dd1bc2451249 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:01.441895 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a9fe4-16e4-4d01-9e39-dd1bc2451249 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:01.462589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 393/787] 10.222.0.71 () {56 vars in 1251 bytes} [Mon May 16 20:12:01 2022] GET /identity/v3/endpoints?service_id=ecff7a626e8a4fda8bb101d9732d1e83&interface=public®ion_id=RegionOne => generated 194 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:01.467669 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a9fe4-16e4-4d01-9e39-dd1bc2451249 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:01.526674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc59a3c-dd46-439f-b9e9-c11ae9b13cad None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:01.602088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a759b-2fb9-4987-a948-2ab28b3faf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:01.602881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a759b-2fb9-4987-a948-2ab28b3faf54 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:01.603163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a759b-2fb9-4987-a948-2ab28b3faf54 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:01.603432 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a759b-2fb9-4987-a948-2ab28b3faf54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:01.626681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a759b-2fb9-4987-a948-2ab28b3faf54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:01.628180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a759b-2fb9-4987-a948-2ab28b3faf54 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:01.670781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-c08a759b-2fb9-4987-a948-2ab28b3faf54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:01.670781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:01.670781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:01.670781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:01.670781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:01.670781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:01.670781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:01.670781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:01.670781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:01.670781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:01.670781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:01.670781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:01.670781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:12:01.670781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:12:01.670781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:12:01.671755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:12:01.671755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:01.671755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:01.671755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:01.671755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:01.671755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:01.671755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:01.671755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:01.671755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:01.671755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:01.671755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:01.671755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:01.671755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:01.671755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:01.671755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:01.671755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:01.671755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:01.672680 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:12:01.672680 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:12:01.672680 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:01.672680 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:01.677058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 395/788] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:12:01.680047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a759b-2fb9-4987-a948-2ab28b3faf54 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:01.685285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a9fe4-16e4-4d01-9e39-dd1bc2451249 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:01.739685 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06a614-80b4-4640-86c8-8573c2e67a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:01.740766 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06a614-80b4-4640-86c8-8573c2e67a45 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:01.741269 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06a614-80b4-4640-86c8-8573c2e67a45 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:01.741742 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06a614-80b4-4640-86c8-8573c2e67a45 None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:01.742643 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06a614-80b4-4640-86c8-8573c2e67a45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:01.744272 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06a614-80b4-4640-86c8-8573c2e67a45 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:01.756781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 394/789] 10.222.0.71 () {56 vars in 1087 bytes} [Mon May 16 20:12:01 2022] GET /identity/v3/services => generated 772 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:01.770296 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a19697-4d9a-4e28-b74e-abd8d3d75d25 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:01.770924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a19697-4d9a-4e28-b74e-abd8d3d75d25 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:01.771430 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a19697-4d9a-4e28-b74e-abd8d3d75d25 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:01.773329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 395/790] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:12:01.779017 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440f9e7-ba71-42d2-adb2-a57b94d825cb None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:01.779610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440f9e7-ba71-42d2-adb2-a57b94d825cb None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:01.780113 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440f9e7-ba71-42d2-adb2-a57b94d825cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:01.798799 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-c440f9e7-ba71-42d2-adb2-a57b94d825cb None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:01.800551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c440f9e7-ba71-42d2-adb2-a57b94d825cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:01.827559 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a759b-2fb9-4987-a948-2ab28b3faf54 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:01.875782 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992d08b-662d-4efa-9726-111438b10a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:01.878024 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992d08b-662d-4efa-9726-111438b10a1e None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:01.879328 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992d08b-662d-4efa-9726-111438b10a1e None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:01.881366 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992d08b-662d-4efa-9726-111438b10a1e None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:01.884044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 396/791] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:12:01.885557 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992d08b-662d-4efa-9726-111438b10a1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:01.886095 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992d08b-662d-4efa-9726-111438b10a1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:01.887796 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992d08b-662d-4efa-9726-111438b10a1e None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:01.902289 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 396/792] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:01.909165 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440f9e7-ba71-42d2-adb2-a57b94d825cb None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:01.924965 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992d08b-662d-4efa-9726-111438b10a1e None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:02.082690 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440f9e7-ba71-42d2-adb2-a57b94d825cb None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:02.092922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992d08b-662d-4efa-9726-111438b10a1e None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:02.118125 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2167c-1ee3-4e42-8fff-ac9b2f20f060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:02.119369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2167c-1ee3-4e42-8fff-ac9b2f20f060 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:02.119852 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2167c-1ee3-4e42-8fff-ac9b2f20f060 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:02.120363 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2167c-1ee3-4e42-8fff-ac9b2f20f060 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:02.128891 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2167c-1ee3-4e42-8fff-ac9b2f20f060 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:02.130606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2167c-1ee3-4e42-8fff-ac9b2f20f060 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:02.133520 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f58171-8bb1-40ea-9882-c0f559941519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:02.134504 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f58171-8bb1-40ea-9882-c0f559941519 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:02.134929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f58171-8bb1-40ea-9882-c0f559941519 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:02.135376 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f58171-8bb1-40ea-9882-c0f559941519 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:02.136188 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f58171-8bb1-40ea-9882-c0f559941519 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:02.137934 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f58171-8bb1-40ea-9882-c0f559941519 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:02.146940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-8be2167c-1ee3-4e42-8fff-ac9b2f20f060 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:02.146940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:02.146940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:02.146940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:02.146940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:02.146940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:02.146940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:02.146940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:02.146940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:02.146940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:02.146940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:02.146940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:02.146940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:12:02.146940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:12:02.146940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:12:02.148026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:12:02.148026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:02.148026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:02.148026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:02.148026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:02.148026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:02.148026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:02.148026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:02.148026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:02.148026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:02.148026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:02.148026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:02.148026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:02.148026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:02.148026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:02.148026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:02.148026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:02.148954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:12:02.148954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:12:02.148954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:12:02.148954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:12:02.148954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:12:02.148954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:12:02.148954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:02.148954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:02.148954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 397/793] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:12:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:02.149540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab50f0-8c4d-48b6-a556-3ce7533e4088 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:02.149819 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab50f0-8c4d-48b6-a556-3ce7533e4088 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:02.150093 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab50f0-8c4d-48b6-a556-3ce7533e4088 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:02.151593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 398/794] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:02.155484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-66f58171-8bb1-40ea-9882-c0f559941519 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 20:12:02.155484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:02.155484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:12:02.155484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:12:02.155484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:12:02.155484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:12:02.155484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:12:02.155484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:02.155484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 20:12:02.155484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:02.155484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:12:02.155484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:02.155484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:02.155484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:02.155484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:02.155484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:02.156611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:02.156611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:02.156611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:02.156611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:02.156611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:02.156611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:02.156611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:02.156611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:12:02.156611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:12:02.156611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:12:02.156611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:12:02.156611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:02.156611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:02.156611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:02.156611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:02.156611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:02.157633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:02.157633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:02.157633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:02.157633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:02.157633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:02.157633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:02.157633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:02.157633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:02.157633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:02.157633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:02.157633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:02.157633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:12:02.157633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:02.157633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 20:12:02.157633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:02.158411 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab50f0-8c4d-48b6-a556-3ce7533e4088 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:02.159112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 397/795] 10.222.0.71 () {56 vars in 1129 bytes} [Mon May 16 20:12:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:02.160811 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735816c-b3e3-41f3-b5ac-81451d8bb333 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:02.161101 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735816c-b3e3-41f3-b5ac-81451d8bb333 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:02.161381 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735816c-b3e3-41f3-b5ac-81451d8bb333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:02.179385 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-2735816c-b3e3-41f3-b5ac-81451d8bb333 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:02.180591 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-2735816c-b3e3-41f3-b5ac-81451d8bb333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:02.249746 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 398/796] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:02.250597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735816c-b3e3-41f3-b5ac-81451d8bb333 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:02.278349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab50f0-8c4d-48b6-a556-3ce7533e4088 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:02.323785 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbe37c-14a4-40a1-830b-d13eab811fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:02.324870 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbe37c-14a4-40a1-830b-d13eab811fb9 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:02.325359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbe37c-14a4-40a1-830b-d13eab811fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:02.325868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbe37c-14a4-40a1-830b-d13eab811fb9 None admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:02.327404 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbe37c-14a4-40a1-830b-d13eab811fb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:02.327941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbe37c-14a4-40a1-830b-d13eab811fb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:02.330934 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbe37c-14a4-40a1-830b-d13eab811fb9 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:02.352696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 399/797] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:12:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:02.353494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbe37c-14a4-40a1-830b-d13eab811fb9 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:02.359089 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735816c-b3e3-41f3-b5ac-81451d8bb333 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:02.396235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6706f4-03ed-4d76-8918-11f6b35c911f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:02.396974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6706f4-03ed-4d76-8918-11f6b35c911f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:02.397261 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6706f4-03ed-4d76-8918-11f6b35c911f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:02.397537 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6706f4-03ed-4d76-8918-11f6b35c911f None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:02.398259 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6706f4-03ed-4d76-8918-11f6b35c911f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:02.398568 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6706f4-03ed-4d76-8918-11f6b35c911f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:02.399972 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6706f4-03ed-4d76-8918-11f6b35c911f None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:02.405588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 399/798] 10.222.0.71 () {56 vars in 1124 bytes} [Mon May 16 20:12:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:02.406456 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6706f4-03ed-4d76-8918-11f6b35c911f None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:02.475511 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbe37c-14a4-40a1-830b-d13eab811fb9 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:02.528181 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc5159-7ab6-48b1-8b33-7757270ce5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:02.528869 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc5159-7ab6-48b1-8b33-7757270ce5d5 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:02.529152 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc5159-7ab6-48b1-8b33-7757270ce5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:02.529418 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc5159-7ab6-48b1-8b33-7757270ce5d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:02.540872 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc5159-7ab6-48b1-8b33-7757270ce5d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:12:02.549191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-d0bc5159-7ab6-48b1-8b33-7757270ce5d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:12:02.549191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:02.549191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:02.549191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:02.549191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:02.549191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:02.549191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:02.549191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:02.549191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:02.549191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:02.549191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:02.549191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:02.549191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:12:02.549191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:12:02.549191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:12:02.549191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:12:02.551077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:12:02.551077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:12:02.551077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:12:02.551077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:12:02.551077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:02.551077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:02.551077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:02.551077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:02.551077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:02.551077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:02.551077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:02.551077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:02.551077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:02.551077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:02.551077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:02.551077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:02.552119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:02.552119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:02.552119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:02.552119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:02.552119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:12:02.552119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:12:02.552119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:12:02.552119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:12:02.552119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:12:02.552119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:12:02.552119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:12:02.552119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:02.552119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 400/799] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:12:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:02.552119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc5159-7ab6-48b1-8b33-7757270ce5d5 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:02.568511 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6706f4-03ed-4d76-8918-11f6b35c911f None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:02.606589 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37b901-1cfc-4e59-8399-f800221659db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:02.607790 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37b901-1cfc-4e59-8399-f800221659db None admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:02.608311 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37b901-1cfc-4e59-8399-f800221659db None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:02.608801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37b901-1cfc-4e59-8399-f800221659db None admin] PATH_INFO: `/v3/projects/121ed31a143d49b3a16ac6c5c6b28955/users/7e701cf55d13410aa259ec72578ed27a/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:02.611971 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37b901-1cfc-4e59-8399-f800221659db None admin] RBAC: Authorizing `identity:create_grant(project_id=121ed31a143d49b3a16ac6c5c6b28955, user_id=7e701cf55d13410aa259ec72578ed27a, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:02.613713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37b901-1cfc-4e59-8399-f800221659db None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:02.641492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 400/800] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:12:02 2022] PUT /identity/v3/projects/121ed31a143d49b3a16ac6c5c6b28955/users/7e701cf55d13410aa259ec72578ed27a/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:12:02.644803 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37b901-1cfc-4e59-8399-f800221659db None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:02.671093 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc5159-7ab6-48b1-8b33-7757270ce5d5 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:02.742489 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a08361-24a6-417c-bbcc-23a70396d855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:02.743174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a08361-24a6-417c-bbcc-23a70396d855 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:02.743455 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a08361-24a6-417c-bbcc-23a70396d855 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:02.743722 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a08361-24a6-417c-bbcc-23a70396d855 None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:02.744521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a08361-24a6-417c-bbcc-23a70396d855 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:02.746948 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a08361-24a6-417c-bbcc-23a70396d855 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:02.752783 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a08361-24a6-417c-bbcc-23a70396d855 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:02.767026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 401/801] 10.222.0.71 () {56 vars in 1124 bytes} [Mon May 16 20:12:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:02.772487 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a08361-24a6-417c-bbcc-23a70396d855 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:02.865453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37b901-1cfc-4e59-8399-f800221659db None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:02.911641 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27f1b3-931b-4da3-a701-adea8cef1620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:02.912544 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27f1b3-931b-4da3-a701-adea8cef1620 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:02.912829 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27f1b3-931b-4da3-a701-adea8cef1620 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:02.913510 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27f1b3-931b-4da3-a701-adea8cef1620 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:02.914572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27f1b3-931b-4da3-a701-adea8cef1620 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:02.914881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27f1b3-931b-4da3-a701-adea8cef1620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:02.917066 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27f1b3-931b-4da3-a701-adea8cef1620 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:02.921352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a08361-24a6-417c-bbcc-23a70396d855 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:02.928700 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 401/802] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:12:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:02.934247 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27f1b3-931b-4da3-a701-adea8cef1620 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:02.960114 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def82896-faa8-48b7-bf86-ae2cbf448afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:02.960799 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def82896-faa8-48b7-bf86-ae2cbf448afb None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:02.961124 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def82896-faa8-48b7-bf86-ae2cbf448afb None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:02.961393 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def82896-faa8-48b7-bf86-ae2cbf448afb None admin] PATH_INFO: `/v3/endpoints` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:02.962142 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def82896-faa8-48b7-bf86-ae2cbf448afb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:02.963523 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def82896-faa8-48b7-bf86-ae2cbf448afb None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:02.999022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 402/803] 10.222.0.71 () {60 vars in 1144 bytes} [Mon May 16 20:12:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:12:03.051858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27f1b3-931b-4da3-a701-adea8cef1620 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:03.101837 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41decd6-df39-4ff7-896a-07d8d12439f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:03.102648 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41decd6-df39-4ff7-896a-07d8d12439f9 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:03.102929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41decd6-df39-4ff7-896a-07d8d12439f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:03.103200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41decd6-df39-4ff7-896a-07d8d12439f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:03.114861 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41decd6-df39-4ff7-896a-07d8d12439f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:03.116415 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41decd6-df39-4ff7-896a-07d8d12439f9 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:03.135270 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-a41decd6-df39-4ff7-896a-07d8d12439f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:03.135270 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:03.135270 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:03.135270 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:03.135270 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:03.135270 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:03.135270 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:03.135270 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:03.135270 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:03.135270 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:03.135270 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:03.135270 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:03.135270 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:12:03.135270 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:12:03.135270 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:12:03.137406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:12:03.137406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:03.137406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:03.137406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:03.137406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:03.137406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:03.137406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:03.137406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:03.137406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:03.137406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:03.137406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:03.137406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:03.137406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:03.137406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:03.137406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:03.137406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:03.137406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:03.139595 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:12:03.139595 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:12:03.139595 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:03.139595 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:03.139595 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 402/804] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:12:03.143736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def82896-faa8-48b7-bf86-ae2cbf448afb None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:03.333455 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def82896-faa8-48b7-bf86-ae2cbf448afb None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:03.369486 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0079cd5-3a38-4ab1-a0d6-03833410bc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:03.370916 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0079cd5-3a38-4ab1-a0d6-03833410bc90 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:03.371424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0079cd5-3a38-4ab1-a0d6-03833410bc90 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:03.371901 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0079cd5-3a38-4ab1-a0d6-03833410bc90 None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:03.372911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0079cd5-3a38-4ab1-a0d6-03833410bc90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:03.373455 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0079cd5-3a38-4ab1-a0d6-03833410bc90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:03.375201 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0079cd5-3a38-4ab1-a0d6-03833410bc90 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:03.389292 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 403/805] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:03.395969 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41decd6-df39-4ff7-896a-07d8d12439f9 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:03.516132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41decd6-df39-4ff7-896a-07d8d12439f9 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:03.555979 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8599af-98ae-4cb9-8c84-40576106fa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:03.556824 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8599af-98ae-4cb9-8c84-40576106fa30 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:03.557107 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8599af-98ae-4cb9-8c84-40576106fa30 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:03.557384 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8599af-98ae-4cb9-8c84-40576106fa30 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:03.565576 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8599af-98ae-4cb9-8c84-40576106fa30 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:03.567030 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8599af-98ae-4cb9-8c84-40576106fa30 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:03.582086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-ba8599af-98ae-4cb9-8c84-40576106fa30 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 20:12:03.582086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:03.582086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:03.582086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:03.582086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:03.582086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:03.582086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:03.582086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:03.582086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:03.582086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:03.582086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:03.582086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:03.582086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:12:03.582086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:12:03.582086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:12:03.582086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:12:03.583140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:03.583140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:03.583140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:12:03.583140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:03.583140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:12:03.583140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:03.583140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:03.583140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:03.583140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:03.583140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:03.583140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:03.583140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:03.583140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:03.583140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:03.583140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:03.583140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:03.583140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:03.583140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:03.584110 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:03.584110 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:03.584110 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:12:03.584110 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:12:03.584110 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:12:03.584110 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:12:03.584110 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:12:03.584110 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:12:03.584110 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 20:12:03.584110 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:03.584110 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 403/806] 10.222.0.71 () {56 vars in 1093 bytes} [Mon May 16 20:12:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:03.589285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0079cd5-3a38-4ab1-a0d6-03833410bc90 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:03.666652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c2262-d2f9-4953-b092-0085f4991e48 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:03.666888 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c2262-d2f9-4953-b092-0085f4991e48 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:03.667222 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c2262-d2f9-4953-b092-0085f4991e48 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:03.668981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 404/807] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:03.674826 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc27e41-b6e9-4d4a-aa18-f9a1f3dfa9a7 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:03.675064 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc27e41-b6e9-4d4a-aa18-f9a1f3dfa9a7 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:03.675336 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc27e41-b6e9-4d4a-aa18-f9a1f3dfa9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:03.693237 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-cfc27e41-b6e9-4d4a-aa18-f9a1f3dfa9a7 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:03.694443 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-cfc27e41-b6e9-4d4a-aa18-f9a1f3dfa9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:03.767786 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0079cd5-3a38-4ab1-a0d6-03833410bc90 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:03.815729 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 405/808] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:03.827140 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0f308-9916-4866-ad59-2a9aa937944c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:03.827809 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0f308-9916-4866-ad59-2a9aa937944c None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:03.828090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0f308-9916-4866-ad59-2a9aa937944c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:03.828388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0f308-9916-4866-ad59-2a9aa937944c None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:03.829981 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0f308-9916-4866-ad59-2a9aa937944c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:03.830353 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0f308-9916-4866-ad59-2a9aa937944c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:03.831788 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0f308-9916-4866-ad59-2a9aa937944c None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:03.852457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 404/809] 10.222.0.71 () {56 vars in 1133 bytes} [Mon May 16 20:12:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:03.861628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc27e41-b6e9-4d4a-aa18-f9a1f3dfa9a7 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:03.865730 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0f308-9916-4866-ad59-2a9aa937944c None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:03.994635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0f308-9916-4866-ad59-2a9aa937944c None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:04.044981 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070a40e-0fe5-454d-93df-42f6d24a4862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:04.046197 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070a40e-0fe5-454d-93df-42f6d24a4862 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:04.046684 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070a40e-0fe5-454d-93df-42f6d24a4862 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:04.047168 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070a40e-0fe5-454d-93df-42f6d24a4862 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:04.073191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070a40e-0fe5-454d-93df-42f6d24a4862 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:12:04.086298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-c070a40e-0fe5-454d-93df-42f6d24a4862 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:12:04.086298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:04.086298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:04.086298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:04.086298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:04.086298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:04.086298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:04.086298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:04.086298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:04.086298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:04.086298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:04.086298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:04.086298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:12:04.086298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:12:04.086298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:12:04.086298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:12:04.087315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:12:04.087315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:12:04.087315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:12:04.087315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:12:04.087315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:04.087315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:04.087315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:04.087315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:04.087315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:04.087315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:04.087315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:04.087315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:04.087315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:04.087315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:04.087315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:04.087315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:04.088338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:04.088338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:04.088338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:04.088338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:04.088338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:12:04.088338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:12:04.088338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:12:04.088338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:12:04.088338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:12:04.088338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:12:04.088338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:12:04.088338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:04.096655 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc27e41-b6e9-4d4a-aa18-f9a1f3dfa9a7 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:04.098011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 405/810] 10.222.0.71 () {56 vars in 1102 bytes} [Mon May 16 20:12:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:04.106292 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070a40e-0fe5-454d-93df-42f6d24a4862 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:04.139385 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7980a-1f5f-4f7f-bb48-0bac064a0c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:04.140694 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7980a-1f5f-4f7f-bb48-0bac064a0c9b None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:04.142545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7980a-1f5f-4f7f-bb48-0bac064a0c9b None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:04.143053 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7980a-1f5f-4f7f-bb48-0bac064a0c9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:04.230158 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7980a-1f5f-4f7f-bb48-0bac064a0c9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:04.232579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7980a-1f5f-4f7f-bb48-0bac064a0c9b None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:04.356633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 406/811] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:12:03 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:12:04.362946 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7980a-1f5f-4f7f-bb48-0bac064a0c9b None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:04.364509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070a40e-0fe5-454d-93df-42f6d24a4862 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:04.406356 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21811e-8849-4146-9bc7-a2c46b350e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:04.408126 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21811e-8849-4146-9bc7-a2c46b350e89 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:04.408400 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21811e-8849-4146-9bc7-a2c46b350e89 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:04.408604 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21811e-8849-4146-9bc7-a2c46b350e89 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:04.409297 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21811e-8849-4146-9bc7-a2c46b350e89 None admin] RBAC: Adding query filter params (name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:04.409602 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21811e-8849-4146-9bc7-a2c46b350e89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:04.410988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21811e-8849-4146-9bc7-a2c46b350e89 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:04.428977 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 406/812] 10.222.0.71 () {56 vars in 1103 bytes} [Mon May 16 20:12:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:04.434398 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21811e-8849-4146-9bc7-a2c46b350e89 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:04.544543 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7980a-1f5f-4f7f-bb48-0bac064a0c9b None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:04.586877 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21811e-8849-4146-9bc7-a2c46b350e89 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:04.591827 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e57135-3011-4f46-8a31-b9ccf5f5cfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:04.592697 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e57135-3011-4f46-8a31-b9ccf5f5cfeb None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:04.592980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e57135-3011-4f46-8a31-b9ccf5f5cfeb None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:04.593251 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e57135-3011-4f46-8a31-b9ccf5f5cfeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:04.605953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e57135-3011-4f46-8a31-b9ccf5f5cfeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:04.608402 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e57135-3011-4f46-8a31-b9ccf5f5cfeb None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:04.620997 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c965b-2a06-49a8-ac74-71efd9b798e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:04.621823 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c965b-2a06-49a8-ac74-71efd9b798e0 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:04.622104 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c965b-2a06-49a8-ac74-71efd9b798e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:04.622375 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c965b-2a06-49a8-ac74-71efd9b798e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:04.629629 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-b6e57135-3011-4f46-8a31-b9ccf5f5cfeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:04.629629 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:04.629629 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:04.629629 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:04.629629 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:04.629629 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:04.629629 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:04.629629 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:04.629629 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:04.629629 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:04.629629 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:04.629629 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:04.629629 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:12:04.629629 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:12:04.629629 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:12:04.630545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:12:04.630545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:04.630545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:04.630545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:04.630545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:04.630545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:04.630545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:04.630545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:04.630545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:04.630545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:04.630545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:04.630545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:04.630545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:04.630545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:04.630545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:04.630545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:04.630545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:04.631433 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:12:04.631433 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:12:04.631433 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:04.631433 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:04.631652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 407/813] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:12:04.636172 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb8b4d-6bc7-4795-b4ae-b38ee772906e None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:04.636172 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb8b4d-6bc7-4795-b4ae-b38ee772906e None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:04.636172 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb8b4d-6bc7-4795-b4ae-b38ee772906e None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:04.636172 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 408/814] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:04.637876 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb8b4d-6bc7-4795-b4ae-b38ee772906e None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:04.644481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c965b-2a06-49a8-ac74-71efd9b798e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:04.645984 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c965b-2a06-49a8-ac74-71efd9b798e0 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:04.664208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-d08c965b-2a06-49a8-ac74-71efd9b798e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:04.664208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:04.664208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:04.664208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:04.664208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:04.664208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:04.664208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:04.664208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:04.664208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:04.664208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:04.664208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:04.664208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:04.664208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:12:04.664208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:12:04.664208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:12:04.666319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:12:04.666319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:04.666319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:04.666319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:04.666319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:04.666319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:04.666319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:04.666319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:04.666319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:04.666319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:04.666319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:04.666319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:04.666319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:04.666319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:04.666319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:04.666319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:04.666319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:04.668479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:12:04.668479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:12:04.668479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:04.668479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:04.668479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 407/815] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:12:04.668479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5155947-ff3e-4eea-9e8b-2e6af4b96ea6 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:04.668479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5155947-ff3e-4eea-9e8b-2e6af4b96ea6 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:04.668479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5155947-ff3e-4eea-9e8b-2e6af4b96ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:04.753818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb8b4d-6bc7-4795-b4ae-b38ee772906e None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:04.792618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc5f53-16b7-47de-8923-778afb2eb42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:04.793280 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc5f53-16b7-47de-8923-778afb2eb42b None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:04.793727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc5f53-16b7-47de-8923-778afb2eb42b None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:04.794149 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc5f53-16b7-47de-8923-778afb2eb42b None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:04.795014 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc5f53-16b7-47de-8923-778afb2eb42b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:04.795496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc5f53-16b7-47de-8923-778afb2eb42b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:04.797082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc5f53-16b7-47de-8923-778afb2eb42b None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:04.811194 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-b5155947-ff3e-4eea-9e8b-2e6af4b96ea6 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:04.812486 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 409/816] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:04.812486 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc5f53-16b7-47de-8923-778afb2eb42b None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:04.817628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-b5155947-ff3e-4eea-9e8b-2e6af4b96ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:04.909877 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 408/817] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:04.911005 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5155947-ff3e-4eea-9e8b-2e6af4b96ea6 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:04.946175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc5f53-16b7-47de-8923-778afb2eb42b None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:04.983946 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd9eab-8973-41e7-8537-919735291155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:04.984971 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd9eab-8973-41e7-8537-919735291155 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:04.985971 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd9eab-8973-41e7-8537-919735291155 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:04.986506 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd9eab-8973-41e7-8537-919735291155 None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:04.987383 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd9eab-8973-41e7-8537-919735291155 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:04.987841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd9eab-8973-41e7-8537-919735291155 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:04.989544 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd9eab-8973-41e7-8537-919735291155 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:05.002868 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 410/818] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:05.004082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd9eab-8973-41e7-8537-919735291155 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:05.032981 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5155947-ff3e-4eea-9e8b-2e6af4b96ea6 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:05.067244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb404fdf-8bdc-43e3-8947-d4faad6fbcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:05.068387 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb404fdf-8bdc-43e3-8947-d4faad6fbcf3 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:05.068817 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb404fdf-8bdc-43e3-8947-d4faad6fbcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:05.069283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb404fdf-8bdc-43e3-8947-d4faad6fbcf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:05.076324 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb404fdf-8bdc-43e3-8947-d4faad6fbcf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:05.077939 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb404fdf-8bdc-43e3-8947-d4faad6fbcf3 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:05.093589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-eb404fdf-8bdc-43e3-8947-d4faad6fbcf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:05.093589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:05.093589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:05.093589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:05.093589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:05.093589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:05.093589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:05.093589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:05.093589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:05.093589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:05.093589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:05.093589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:05.093589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:12:05.093589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:12:05.093589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:12:05.095166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:12:05.095166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:05.095166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:05.095166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:05.095166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:05.095166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:05.095166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:05.095166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:05.095166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:05.095166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:05.095166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:05.095166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:05.095166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:05.095166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:05.095166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:05.095166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:05.095166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:05.096355 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:12:05.096355 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:12:05.096355 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:12:05.096355 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:12:05.096355 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:12:05.096355 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:12:05.096355 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:05.096355 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:05.102780 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 409/819] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:12:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:05.103865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb404fdf-8bdc-43e3-8947-d4faad6fbcf3 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:05.117715 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd9eab-8973-41e7-8537-919735291155 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:05.161949 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97da873-0a6e-47f0-b38c-c88d1e271755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:05.162974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97da873-0a6e-47f0-b38c-c88d1e271755 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:05.163502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97da873-0a6e-47f0-b38c-c88d1e271755 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:05.163924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97da873-0a6e-47f0-b38c-c88d1e271755 None admin] PATH_INFO: `/v3/services/network` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:05.164756 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97da873-0a6e-47f0-b38c-c88d1e271755 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:05.166259 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97da873-0a6e-47f0-b38c-c88d1e271755 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:05.179139 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-a97da873-0a6e-47f0-b38c-c88d1e271755 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 20:12:05.179139 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:05.179139 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:12:05.179139 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:12:05.179139 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:12:05.179139 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:12:05.179139 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:12:05.179139 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:05.179139 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 20:12:05.179139 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:05.179139 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:12:05.179139 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:05.179139 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:05.179139 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:05.179139 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:05.179139 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:05.179139 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:05.180452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:05.180452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:05.180452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:05.180452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:05.180452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:05.180452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:05.180452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:12:05.180452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:12:05.180452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:12:05.180452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:12:05.180452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:05.180452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:05.180452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:05.180452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:05.180452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:05.180452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:05.181323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:05.181323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:05.181323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:05.181323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:05.181323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:05.181323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:05.181323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:05.181323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:05.181323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:05.181323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:05.181323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:12:05.181323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:05.181323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 20:12:05.181323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:05.189167 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 411/820] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:12:05 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:05.190722 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97da873-0a6e-47f0-b38c-c88d1e271755 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:05.213210 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb404fdf-8bdc-43e3-8947-d4faad6fbcf3 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:05.252775 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ac70e-9d47-48e4-8f2e-7db43b2c7db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:05.253593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ac70e-9d47-48e4-8f2e-7db43b2c7db8 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:05.253862 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ac70e-9d47-48e4-8f2e-7db43b2c7db8 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:05.254118 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ac70e-9d47-48e4-8f2e-7db43b2c7db8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:05.261982 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ac70e-9d47-48e4-8f2e-7db43b2c7db8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:05.263407 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ac70e-9d47-48e4-8f2e-7db43b2c7db8 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:05.281919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-348ac70e-9d47-48e4-8f2e-7db43b2c7db8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 20:12:05.281919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:05.281919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:05.281919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:05.281919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:05.281919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:05.281919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:05.281919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:05.281919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:05.281919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:05.281919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:05.281919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:05.281919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:12:05.281919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:12:05.281919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:12:05.281919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:12:05.284420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:05.284420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:05.284420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:12:05.284420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:05.284420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:12:05.284420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:05.284420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:05.284420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:05.284420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:05.284420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:05.284420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:05.284420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:05.284420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:05.284420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:05.284420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:05.284420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:05.284420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:05.284420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:05.285589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:05.285589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:05.285589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:12:05.285589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:12:05.285589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:12:05.285589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:12:05.285589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:12:05.285589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:12:05.285589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 20:12:05.285589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:05.285589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 410/821] 10.222.0.71 () {56 vars in 1117 bytes} [Mon May 16 20:12:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:05.285589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ac70e-9d47-48e4-8f2e-7db43b2c7db8 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:05.315514 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97da873-0a6e-47f0-b38c-c88d1e271755 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:05.353377 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d98d1a-cf53-4a8c-8915-b1344ed0f982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:05.355237 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d98d1a-cf53-4a8c-8915-b1344ed0f982 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:05.355937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d98d1a-cf53-4a8c-8915-b1344ed0f982 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:05.356585 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d98d1a-cf53-4a8c-8915-b1344ed0f982 None admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:05.357841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d98d1a-cf53-4a8c-8915-b1344ed0f982 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:05.358309 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d98d1a-cf53-4a8c-8915-b1344ed0f982 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:05.361633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d98d1a-cf53-4a8c-8915-b1344ed0f982 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:05.384251 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 412/822] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:12:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:05.385246 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d98d1a-cf53-4a8c-8915-b1344ed0f982 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:05.398012 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ac70e-9d47-48e4-8f2e-7db43b2c7db8 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:05.433226 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212fdbf-3a7f-4c05-a05b-4e1475a7e356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:05.433878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212fdbf-3a7f-4c05-a05b-4e1475a7e356 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:05.434230 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212fdbf-3a7f-4c05-a05b-4e1475a7e356 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:05.434503 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212fdbf-3a7f-4c05-a05b-4e1475a7e356 None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:05.435208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212fdbf-3a7f-4c05-a05b-4e1475a7e356 None admin] RBAC: Adding query filter params (name=network) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:05.435516 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212fdbf-3a7f-4c05-a05b-4e1475a7e356 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:05.436912 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212fdbf-3a7f-4c05-a05b-4e1475a7e356 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:05.446154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 411/823] 10.222.0.71 () {56 vars in 1112 bytes} [Mon May 16 20:12:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:05.446154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212fdbf-3a7f-4c05-a05b-4e1475a7e356 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:05.494117 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d98d1a-cf53-4a8c-8915-b1344ed0f982 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:05.532507 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f88ac7-7ca6-444a-b63f-59b1b021e97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:05.533261 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f88ac7-7ca6-444a-b63f-59b1b021e97b None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:05.533538 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f88ac7-7ca6-444a-b63f-59b1b021e97b None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:05.533833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f88ac7-7ca6-444a-b63f-59b1b021e97b None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:05.534633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f88ac7-7ca6-444a-b63f-59b1b021e97b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:05.534935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f88ac7-7ca6-444a-b63f-59b1b021e97b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:05.536353 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f88ac7-7ca6-444a-b63f-59b1b021e97b None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:05.542211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212fdbf-3a7f-4c05-a05b-4e1475a7e356 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:05.558469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 413/824] 10.222.0.71 () {56 vars in 1149 bytes} [Mon May 16 20:12:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:05.558469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e39f14-0d89-4ea5-9abf-7724d6d8bca9 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:05.558469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e39f14-0d89-4ea5-9abf-7724d6d8bca9 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:05.558469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e39f14-0d89-4ea5-9abf-7724d6d8bca9 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:05.560295 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 414/825] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:05.561624 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e39f14-0d89-4ea5-9abf-7724d6d8bca9 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:05.584392 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c927c8-22b5-4267-98f6-eede9fc6b973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:05.585335 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c927c8-22b5-4267-98f6-eede9fc6b973 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:05.585585 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c927c8-22b5-4267-98f6-eede9fc6b973 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:05.585880 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c927c8-22b5-4267-98f6-eede9fc6b973 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:05.586712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c927c8-22b5-4267-98f6-eede9fc6b973 None admin] RBAC: Adding query filter params (role.id=6576d9225a0946de877f527e3d15db05, scope.project.id=121ed31a143d49b3a16ac6c5c6b28955, user.id=242d4f9634a74013af05f50981280864) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:05.587044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c927c8-22b5-4267-98f6-eede9fc6b973 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:05.588495 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c927c8-22b5-4267-98f6-eede9fc6b973 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:05.594935 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 412/826] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:12:05 2022] GET /identity/v3/role_assignments?user.id=242d4f9634a74013af05f50981280864&scope.project.id=121ed31a143d49b3a16ac6c5c6b28955&role.id=6576d9225a0946de877f527e3d15db05 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:05.595786 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c927c8-22b5-4267-98f6-eede9fc6b973 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:05.699116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e39f14-0d89-4ea5-9abf-7724d6d8bca9 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:05.727156 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c927c8-22b5-4267-98f6-eede9fc6b973 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:05.740523 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89dcf7b-06c0-4081-939b-126bd7baedee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:05.741216 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89dcf7b-06c0-4081-939b-126bd7baedee None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:05.741526 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89dcf7b-06c0-4081-939b-126bd7baedee None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:05.742125 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89dcf7b-06c0-4081-939b-126bd7baedee None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:05.742508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89dcf7b-06c0-4081-939b-126bd7baedee None admin] RBAC: Adding query filter params (type=network) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:05.742817 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89dcf7b-06c0-4081-939b-126bd7baedee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:05.744295 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89dcf7b-06c0-4081-939b-126bd7baedee None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:05.752104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 415/827] 10.222.0.71 () {56 vars in 1112 bytes} [Mon May 16 20:12:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:05.753688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c1555-2063-4b6b-afe2-3962a362a2e9 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:05.753979 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c1555-2063-4b6b-afe2-3962a362a2e9 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:05.754257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c1555-2063-4b6b-afe2-3962a362a2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:05.771803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae32af-92a2-4f14-93b4-2bebf036950c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:05.773109 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae32af-92a2-4f14-93b4-2bebf036950c None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:05.773610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae32af-92a2-4f14-93b4-2bebf036950c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:05.773718 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-cb3c1555-2063-4b6b-afe2-3962a362a2e9 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:05.774186 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae32af-92a2-4f14-93b4-2bebf036950c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:05.774872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-cb3c1555-2063-4b6b-afe2-3962a362a2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:05.787268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae32af-92a2-4f14-93b4-2bebf036950c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:05.789152 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae32af-92a2-4f14-93b4-2bebf036950c None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:05.808097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-7aae32af-92a2-4f14-93b4-2bebf036950c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:05.808097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:05.808097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:05.808097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:05.808097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:05.808097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:05.808097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:05.808097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:05.808097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:05.808097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:05.808097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:05.808097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:05.808097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:12:05.808097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:12:05.808097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:12:05.809108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:12:05.809108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:05.809108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:05.809108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:05.809108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:05.809108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:05.809108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:05.809108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:05.809108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:05.809108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:05.809108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:05.809108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:05.809108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:05.809108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:05.809108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:05.809108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:05.809108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:05.810021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:12:05.810021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:12:05.810021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:05.810021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:05.817795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 413/828] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:05.818726 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae32af-92a2-4f14-93b4-2bebf036950c None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:05.857151 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 416/829] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:05.858069 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c1555-2063-4b6b-afe2-3962a362a2e9 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:05.940015 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae32af-92a2-4f14-93b4-2bebf036950c None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:05.973473 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736aca0-aa36-4caa-a6b7-f2233c4fa770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:05.974039 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736aca0-aa36-4caa-a6b7-f2233c4fa770 None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:05.974317 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736aca0-aa36-4caa-a6b7-f2233c4fa770 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:05.974582 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736aca0-aa36-4caa-a6b7-f2233c4fa770 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:05.975306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736aca0-aa36-4caa-a6b7-f2233c4fa770 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:05.976711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736aca0-aa36-4caa-a6b7-f2233c4fa770 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:05.988957 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c1555-2063-4b6b-afe2-3962a362a2e9 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:06.004192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 414/830] 10.222.0.71 () {60 vars in 1144 bytes} [Mon May 16 20:12:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:12:06.004192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736aca0-aa36-4caa-a6b7-f2233c4fa770 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:06.046224 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eff19e-4c56-4aeb-a59b-3dc6602f0388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:06.047308 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eff19e-4c56-4aeb-a59b-3dc6602f0388 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:06.047661 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eff19e-4c56-4aeb-a59b-3dc6602f0388 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:06.048171 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eff19e-4c56-4aeb-a59b-3dc6602f0388 None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:06.050253 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eff19e-4c56-4aeb-a59b-3dc6602f0388 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:06.050570 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eff19e-4c56-4aeb-a59b-3dc6602f0388 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:06.053416 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eff19e-4c56-4aeb-a59b-3dc6602f0388 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:06.072737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 417/831] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:06.074460 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c321c-ba93-4b83-8ff0-6f8f67cd97da None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:06.074751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c321c-ba93-4b83-8ff0-6f8f67cd97da None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:06.075367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c321c-ba93-4b83-8ff0-6f8f67cd97da None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:06.077317 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 418/832] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:06.079205 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c321c-ba93-4b83-8ff0-6f8f67cd97da None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:06.116311 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736aca0-aa36-4caa-a6b7-f2233c4fa770 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:06.152777 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cc4e2-c855-44d0-b1cd-bad8d882f4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:06.153569 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cc4e2-c855-44d0-b1cd-bad8d882f4b7 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:06.154391 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cc4e2-c855-44d0-b1cd-bad8d882f4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:06.154673 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cc4e2-c855-44d0-b1cd-bad8d882f4b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:06.169741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38cc4e2-c855-44d0-b1cd-bad8d882f4b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:12:06.180556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-e38cc4e2-c855-44d0-b1cd-bad8d882f4b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:12:06.180556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:06.180556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:06.180556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:06.180556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:06.180556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:06.180556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:06.180556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:06.180556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:06.180556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:06.180556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:06.180556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:06.180556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:12:06.180556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:12:06.180556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:12:06.180556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:12:06.181606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:12:06.181606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:12:06.181606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:12:06.181606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:12:06.181606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:06.181606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:06.181606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:06.181606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:06.181606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:06.181606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:06.181606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:06.181606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:06.181606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:06.181606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:06.181606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:06.181606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:06.182437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:06.182437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:06.182437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:06.182437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:06.182437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:12:06.182437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:12:06.182437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:12:06.182437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:12:06.182437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:12:06.182437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:12:06.182437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:12:06.182437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:06.184909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 415/833] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:12:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:06.185977 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee717b-c221-47f6-a385-e045deccc6c1 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:06.186365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee717b-c221-47f6-a385-e045deccc6c1 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:06.186935 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee717b-c221-47f6-a385-e045deccc6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:06.219042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c321c-ba93-4b83-8ff0-6f8f67cd97da None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:06.220528 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-13ee717b-c221-47f6-a385-e045deccc6c1 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:06.221785 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-13ee717b-c221-47f6-a385-e045deccc6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:06.271427 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8585aa6-9022-41db-8037-bd15c85994fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:06.273028 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8585aa6-9022-41db-8037-bd15c85994fa None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:06.273028 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8585aa6-9022-41db-8037-bd15c85994fa None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:06.273028 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8585aa6-9022-41db-8037-bd15c85994fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:06.281672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8585aa6-9022-41db-8037-bd15c85994fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:06.283692 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8585aa6-9022-41db-8037-bd15c85994fa None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:06.302217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-c8585aa6-9022-41db-8037-bd15c85994fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:06.302217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:06.302217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:06.302217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:06.302217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:06.302217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:06.302217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:06.302217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:06.302217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:06.302217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:06.302217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:06.302217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:06.302217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:12:06.302217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:12:06.302217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:12:06.303180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:12:06.303180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:06.303180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:06.303180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:06.303180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:06.303180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:06.303180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:06.303180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:06.303180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:06.303180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:06.303180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:06.303180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:06.303180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:06.303180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:06.303180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:06.303180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:06.303180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:06.304077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:12:06.304077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:12:06.304077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:12:06.304077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:12:06.304077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:12:06.304077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:12:06.304077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:06.304077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:06.304077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 419/834] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:12:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:06.305623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8585aa6-9022-41db-8037-bd15c85994fa None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:06.316411 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 416/835] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:06.317764 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee717b-c221-47f6-a385-e045deccc6c1 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:06.435997 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8585aa6-9022-41db-8037-bd15c85994fa None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:06.436462 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee717b-c221-47f6-a385-e045deccc6c1 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:06.473129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174f79b-15fb-4be6-87bb-a0dab30c2a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:06.473919 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174f79b-15fb-4be6-87bb-a0dab30c2a55 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:06.474349 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174f79b-15fb-4be6-87bb-a0dab30c2a55 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:06.474666 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174f79b-15fb-4be6-87bb-a0dab30c2a55 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:06.475610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174f79b-15fb-4be6-87bb-a0dab30c2a55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:06.475982 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174f79b-15fb-4be6-87bb-a0dab30c2a55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:06.477541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174f79b-15fb-4be6-87bb-a0dab30c2a55 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:06.478119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12f5ab-581c-4ca2-8fd6-bad8940c2e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:06.479134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12f5ab-581c-4ca2-8fd6-bad8940c2e9b None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:06.479622 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12f5ab-581c-4ca2-8fd6-bad8940c2e9b None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:06.479850 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12f5ab-581c-4ca2-8fd6-bad8940c2e9b None admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:06.480762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12f5ab-581c-4ca2-8fd6-bad8940c2e9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:06.481101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12f5ab-581c-4ca2-8fd6-bad8940c2e9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:06.482722 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12f5ab-581c-4ca2-8fd6-bad8940c2e9b None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:06.492659 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 420/836] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:12:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:06.492659 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174f79b-15fb-4be6-87bb-a0dab30c2a55 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:06.497798 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 417/837] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:12:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:06.498677 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12f5ab-581c-4ca2-8fd6-bad8940c2e9b None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:06.616337 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12f5ab-581c-4ca2-8fd6-bad8940c2e9b None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:06.623081 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174f79b-15fb-4be6-87bb-a0dab30c2a55 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:06.652567 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d56ea3-c34e-4bc1-999f-9c29bf035eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:06.653357 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d56ea3-c34e-4bc1-999f-9c29bf035eb4 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:06.653633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d56ea3-c34e-4bc1-999f-9c29bf035eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:06.653904 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d56ea3-c34e-4bc1-999f-9c29bf035eb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:06.656976 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698322e-f45a-44af-840d-d0bb5b0fd58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:06.658656 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698322e-f45a-44af-840d-d0bb5b0fd58a None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:06.658940 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698322e-f45a-44af-840d-d0bb5b0fd58a None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:06.659214 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698322e-f45a-44af-840d-d0bb5b0fd58a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:06.659865 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698322e-f45a-44af-840d-d0bb5b0fd58a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:06.661263 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698322e-f45a-44af-840d-d0bb5b0fd58a None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:06.665663 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d56ea3-c34e-4bc1-999f-9c29bf035eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:06.667090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d56ea3-c34e-4bc1-999f-9c29bf035eb4 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:06.673485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-5698322e-f45a-44af-840d-d0bb5b0fd58a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 20:12:06.673485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:06.673485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:12:06.673485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:12:06.673485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:12:06.673485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:12:06.673485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:12:06.673485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:06.673485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 20:12:06.673485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:06.673485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:12:06.673485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:06.673485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:06.673485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:06.673485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:06.673485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:06.673485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:06.680061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:06.680061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:06.680061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:06.680061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:06.680061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:06.680061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:06.680061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:12:06.680061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:12:06.680061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:12:06.680061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:12:06.680061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:06.680061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:06.680061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:06.680061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:06.680061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:06.680061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:06.681006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:06.681006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:06.681006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:06.681006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:06.681006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:06.681006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:06.681006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:06.681006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:06.681006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:06.681006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:06.681006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:12:06.681006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:06.681006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 20:12:06.681006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:06.681006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 421/838] 10.222.0.71 () {56 vars in 1114 bytes} [Mon May 16 20:12:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:06.681795 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698322e-f45a-44af-840d-d0bb5b0fd58a None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:06.693538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-92d56ea3-c34e-4bc1-999f-9c29bf035eb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:06.693538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:06.693538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:06.693538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:06.693538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:06.693538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:06.693538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:06.693538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:06.693538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:06.693538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:06.693538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:06.693538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:06.693538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:12:06.693538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:12:06.693538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:12:06.694457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:12:06.694457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:06.694457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:06.694457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:06.694457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:06.694457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:06.694457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:06.694457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:06.694457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:06.694457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:06.694457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:06.694457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:06.694457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:06.694457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:06.694457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:06.694457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:06.694457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:06.695359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:12:06.695359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:12:06.695359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:06.695359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:06.695359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 418/839] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:06.695648 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d56ea3-c34e-4bc1-999f-9c29bf035eb4 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:06.798103 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698322e-f45a-44af-840d-d0bb5b0fd58a None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:06.798383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d56ea3-c34e-4bc1-999f-9c29bf035eb4 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:06.840236 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2dcfe-b2af-4977-b887-750f25715957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:06.840674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b68cd-53f1-4484-9deb-c3d86ecca845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:06.840971 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2dcfe-b2af-4977-b887-750f25715957 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:06.841256 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2dcfe-b2af-4977-b887-750f25715957 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:06.841455 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b68cd-53f1-4484-9deb-c3d86ecca845 None admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:06.841558 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2dcfe-b2af-4977-b887-750f25715957 None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:06.841728 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b68cd-53f1-4484-9deb-c3d86ecca845 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:06.841999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b68cd-53f1-4484-9deb-c3d86ecca845 None admin] PATH_INFO: `/v3/projects/121ed31a143d49b3a16ac6c5c6b28955/users/38a56f3572874938ad4642fa34751a9a/roles/bd4b3497427646f48a7c4d949e498ebc` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:06.842285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2dcfe-b2af-4977-b887-750f25715957 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:06.842595 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2dcfe-b2af-4977-b887-750f25715957 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:06.843975 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2dcfe-b2af-4977-b887-750f25715957 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:06.853681 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 419/840] 10.222.0.71 () {56 vars in 1114 bytes} [Mon May 16 20:12:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:06.853681 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2dcfe-b2af-4977-b887-750f25715957 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:06.862253 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b68cd-53f1-4484-9deb-c3d86ecca845 None admin] RBAC: Authorizing `identity:create_grant(project_id=121ed31a143d49b3a16ac6c5c6b28955, user_id=38a56f3572874938ad4642fa34751a9a, role_id=bd4b3497427646f48a7c4d949e498ebc)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:06.863701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b68cd-53f1-4484-9deb-c3d86ecca845 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:06.878801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 422/841] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:12:06 2022] PUT /identity/v3/projects/121ed31a143d49b3a16ac6c5c6b28955/users/38a56f3572874938ad4642fa34751a9a/roles/bd4b3497427646f48a7c4d949e498ebc => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:12:06.880118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b68cd-53f1-4484-9deb-c3d86ecca845 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:07.008719 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2dcfe-b2af-4977-b887-750f25715957 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:07.009540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b68cd-53f1-4484-9deb-c3d86ecca845 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:07.046975 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9621be-f5ff-4458-a0e1-58fbd0346f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:07.048660 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9621be-f5ff-4458-a0e1-58fbd0346f7b None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:07.049373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9621be-f5ff-4458-a0e1-58fbd0346f7b None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:07.049869 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9621be-f5ff-4458-a0e1-58fbd0346f7b None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:07.050848 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9621be-f5ff-4458-a0e1-58fbd0346f7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:07.051311 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9621be-f5ff-4458-a0e1-58fbd0346f7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:07.051429 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258e9fe-0186-4960-80a0-a6adfd191c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:07.052291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258e9fe-0186-4960-80a0-a6adfd191c7c None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:07.052684 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258e9fe-0186-4960-80a0-a6adfd191c7c None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:07.053057 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258e9fe-0186-4960-80a0-a6adfd191c7c None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:07.053580 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9621be-f5ff-4458-a0e1-58fbd0346f7b None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:07.053974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258e9fe-0186-4960-80a0-a6adfd191c7c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:07.054402 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258e9fe-0186-4960-80a0-a6adfd191c7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:07.055892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258e9fe-0186-4960-80a0-a6adfd191c7c None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:07.068190 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 423/842] 10.222.0.71 () {56 vars in 1114 bytes} [Mon May 16 20:12:06 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:07.080751 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 420/843] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:07.086255 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258e9fe-0186-4960-80a0-a6adfd191c7c None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:07.201727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258e9fe-0186-4960-80a0-a6adfd191c7c None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:07.240548 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac9480-61cf-4094-a74b-294e2c312e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:07.241420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac9480-61cf-4094-a74b-294e2c312e50 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:07.241708 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac9480-61cf-4094-a74b-294e2c312e50 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:07.241990 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac9480-61cf-4094-a74b-294e2c312e50 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:07.250108 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac9480-61cf-4094-a74b-294e2c312e50 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:07.251700 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac9480-61cf-4094-a74b-294e2c312e50 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:07.268303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-02ac9480-61cf-4094-a74b-294e2c312e50 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 20:12:07.268303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:07.268303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:07.268303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:07.268303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:07.268303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:07.268303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:07.268303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:07.268303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:07.268303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:07.268303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:07.268303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:07.268303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:12:07.268303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:12:07.268303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:12:07.268303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:12:07.269292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:07.269292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:07.269292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:12:07.269292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:07.269292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:12:07.269292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:07.269292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:07.269292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:07.269292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:07.269292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:07.269292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:07.269292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:07.269292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:07.269292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:07.269292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:07.269292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:07.269292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:07.269292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:07.270892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:07.270892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:07.270892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:12:07.270892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:12:07.270892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:12:07.270892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:12:07.270892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:12:07.270892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:12:07.270892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 20:12:07.270892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:07.270892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 424/844] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:12:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:07.275799 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9621be-f5ff-4458-a0e1-58fbd0346f7b None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:07.388466 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9621be-f5ff-4458-a0e1-58fbd0346f7b None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:07.424636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e88545-d6e8-4c2a-89c1-d508905c12e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:07.425694 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e88545-d6e8-4c2a-89c1-d508905c12e2 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:07.426183 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e88545-d6e8-4c2a-89c1-d508905c12e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:07.426702 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e88545-d6e8-4c2a-89c1-d508905c12e2 None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:07.427761 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e88545-d6e8-4c2a-89c1-d508905c12e2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:07.428312 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e88545-d6e8-4c2a-89c1-d508905c12e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:07.429964 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e88545-d6e8-4c2a-89c1-d508905c12e2 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:07.452713 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 421/845] 10.222.0.71 () {56 vars in 1135 bytes} [Mon May 16 20:12:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:07.461267 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac9480-61cf-4094-a74b-294e2c312e50 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:07.561143 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac9480-61cf-4094-a74b-294e2c312e50 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:07.601695 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3b094-192d-4ac6-bc69-02f70e44988d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:07.602405 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3b094-192d-4ac6-bc69-02f70e44988d None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:07.602841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3b094-192d-4ac6-bc69-02f70e44988d None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:07.603148 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3b094-192d-4ac6-bc69-02f70e44988d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:07.676472 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3b094-192d-4ac6-bc69-02f70e44988d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:07.677905 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3b094-192d-4ac6-bc69-02f70e44988d None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:07.784810 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 425/846] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:12:07 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:12:07.790559 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e88545-d6e8-4c2a-89c1-d508905c12e2 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:07.908381 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e88545-d6e8-4c2a-89c1-d508905c12e2 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:07.942442 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c75a2e-8cff-4705-9cf0-6508ff1d8479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:07.943460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c75a2e-8cff-4705-9cf0-6508ff1d8479 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:07.943887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c75a2e-8cff-4705-9cf0-6508ff1d8479 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:07.944333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c75a2e-8cff-4705-9cf0-6508ff1d8479 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:07.954838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c75a2e-8cff-4705-9cf0-6508ff1d8479 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:07.956525 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c75a2e-8cff-4705-9cf0-6508ff1d8479 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:07.974032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-49c75a2e-8cff-4705-9cf0-6508ff1d8479 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:07.974032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:07.974032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:07.974032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:07.974032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:07.974032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:07.974032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:07.974032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:07.974032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:07.974032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:07.974032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:07.974032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:07.974032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:12:07.974032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:12:07.974032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:12:07.975132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:12:07.975132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:07.975132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:07.975132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:07.975132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:07.975132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:07.975132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:07.975132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:07.975132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:07.975132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:07.975132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:07.975132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:07.975132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:07.975132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:07.975132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:07.975132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:07.975132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:07.976246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:12:07.976246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:12:07.976246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:07.976246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:07.978086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 422/847] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:07.984184 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3b094-192d-4ac6-bc69-02f70e44988d None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:08.044509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d86d1b-eca9-4e7e-89b1-ed660d20b5c8 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:08.045151 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d86d1b-eca9-4e7e-89b1-ed660d20b5c8 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:08.045628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d86d1b-eca9-4e7e-89b1-ed660d20b5c8 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:08.047434 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 423/848] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:12:08.053264 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fca3f8-2346-4e3f-8c29-973c440fe724 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:08.053823 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fca3f8-2346-4e3f-8c29-973c440fe724 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:08.054297 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fca3f8-2346-4e3f-8c29-973c440fe724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:08.074174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-a6fca3f8-2346-4e3f-8c29-973c440fe724 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:08.075788 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-a6fca3f8-2346-4e3f-8c29-973c440fe724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:08.093149 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3b094-192d-4ac6-bc69-02f70e44988d None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:08.135080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd6d25-cc05-4fb0-8bf4-c244de89e553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:08.135752 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd6d25-cc05-4fb0-8bf4-c244de89e553 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:08.136034 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd6d25-cc05-4fb0-8bf4-c244de89e553 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:08.136363 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd6d25-cc05-4fb0-8bf4-c244de89e553 None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:08.137098 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd6d25-cc05-4fb0-8bf4-c244de89e553 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:08.137407 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd6d25-cc05-4fb0-8bf4-c244de89e553 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:08.138757 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd6d25-cc05-4fb0-8bf4-c244de89e553 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:08.156391 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 426/850] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:08.156576 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 424/850] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:12:08.158009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd6d25-cc05-4fb0-8bf4-c244de89e553 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:08.172634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fca3f8-2346-4e3f-8c29-973c440fe724 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:08.281273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fca3f8-2346-4e3f-8c29-973c440fe724 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:08.283408 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd6d25-cc05-4fb0-8bf4-c244de89e553 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:08.316106 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b8c3b-910f-4b27-94d3-1887ad8c911b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:08.316961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b8c3b-910f-4b27-94d3-1887ad8c911b None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:08.317232 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b8c3b-910f-4b27-94d3-1887ad8c911b None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:08.317600 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b8c3b-910f-4b27-94d3-1887ad8c911b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:08.318357 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b8c3b-910f-4b27-94d3-1887ad8c911b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:08.318927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d163d-4e89-443d-82d4-1b1dca8b9790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:08.319720 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b8c3b-910f-4b27-94d3-1887ad8c911b None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:08.319828 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d163d-4e89-443d-82d4-1b1dca8b9790 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:08.319995 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d163d-4e89-443d-82d4-1b1dca8b9790 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:08.320312 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d163d-4e89-443d-82d4-1b1dca8b9790 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:08.327210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d163d-4e89-443d-82d4-1b1dca8b9790 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:08.328669 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d163d-4e89-443d-82d4-1b1dca8b9790 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:08.332691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-5a9b8c3b-910f-4b27-94d3-1887ad8c911b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 20:12:08.332691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:08.332691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:12:08.332691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:12:08.332691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:12:08.332691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:12:08.332691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:12:08.332691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:08.332691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 20:12:08.332691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:08.332691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:12:08.332691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:08.332691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:08.332691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:08.332691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:08.332691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:08.333686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:08.333686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:08.333686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:08.333686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:08.333686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:08.333686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:08.333686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:08.333686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:12:08.333686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:12:08.333686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:12:08.333686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:12:08.333686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:08.333686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:08.333686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:08.333686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:08.333686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:08.334510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:08.334510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:08.334510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:08.334510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:08.334510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:08.334510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:08.334510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:08.334510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:08.334510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:08.334510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:08.334510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:08.334510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:12:08.334510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:08.334510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 20:12:08.334510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:08.334510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 425/851] 10.222.0.71 () {56 vars in 1132 bytes} [Mon May 16 20:12:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:12:08.344953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-c51d163d-4e89-443d-82d4-1b1dca8b9790 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:08.344953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:08.344953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:08.344953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:08.344953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:08.344953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:08.344953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:08.344953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:08.344953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:08.344953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:08.344953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:08.344953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:08.344953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:12:08.344953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:12:08.344953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:12:08.345927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:12:08.345927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:08.345927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:08.345927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:08.345927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:08.345927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:08.345927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:08.345927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:08.345927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:08.345927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:08.345927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:08.345927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:08.345927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:08.345927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:08.345927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:08.345927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:08.345927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:08.346851 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:12:08.346851 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:12:08.346851 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:12:08.346851 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:12:08.346851 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:12:08.346851 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:12:08.346851 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:08.346851 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:08.346851 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 427/852] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:12:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:08.347760 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b8c3b-910f-4b27-94d3-1887ad8c911b None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:08.352033 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d163d-4e89-443d-82d4-1b1dca8b9790 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:08.457117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b8c3b-910f-4b27-94d3-1887ad8c911b None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:08.477081 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d163d-4e89-443d-82d4-1b1dca8b9790 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:08.501382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53371173-789b-4c12-ab00-d5e023f61b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:08.502115 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53371173-789b-4c12-ab00-d5e023f61b4a None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:08.502916 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53371173-789b-4c12-ab00-d5e023f61b4a None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:08.503214 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53371173-789b-4c12-ab00-d5e023f61b4a None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:08.504261 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53371173-789b-4c12-ab00-d5e023f61b4a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:08.504578 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53371173-789b-4c12-ab00-d5e023f61b4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:08.506133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53371173-789b-4c12-ab00-d5e023f61b4a None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:08.512793 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 426/853] 10.222.0.71 () {56 vars in 1126 bytes} [Mon May 16 20:12:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:08.514370 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6f273-e55f-4b44-b6d4-5b9ce183e42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:08.515398 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6f273-e55f-4b44-b6d4-5b9ce183e42a None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:08.515740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6f273-e55f-4b44-b6d4-5b9ce183e42a None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:08.516080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6f273-e55f-4b44-b6d4-5b9ce183e42a None admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:08.517932 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6f273-e55f-4b44-b6d4-5b9ce183e42a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:08.518317 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6f273-e55f-4b44-b6d4-5b9ce183e42a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:08.519007 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53371173-789b-4c12-ab00-d5e023f61b4a None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:08.519871 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6f273-e55f-4b44-b6d4-5b9ce183e42a None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:08.537897 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 428/854] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:12:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:08.539200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6f273-e55f-4b44-b6d4-5b9ce183e42a None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:08.638089 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53371173-789b-4c12-ab00-d5e023f61b4a None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:08.652095 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6f273-e55f-4b44-b6d4-5b9ce183e42a None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:08.678641 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10ef8d-3ad8-4c39-b967-854b13074d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:08.680184 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10ef8d-3ad8-4c39-b967-854b13074d82 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:08.680653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10ef8d-3ad8-4c39-b967-854b13074d82 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:08.681317 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10ef8d-3ad8-4c39-b967-854b13074d82 None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:08.682805 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10ef8d-3ad8-4c39-b967-854b13074d82 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:08.683459 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10ef8d-3ad8-4c39-b967-854b13074d82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:08.686218 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10ef8d-3ad8-4c39-b967-854b13074d82 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:08.694456 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 427/855] 10.222.0.71 () {56 vars in 1126 bytes} [Mon May 16 20:12:08 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:08.703390 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4132758-fe6a-4452-a221-3f3dbd15e528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:08.703390 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4132758-fe6a-4452-a221-3f3dbd15e528 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:08.703390 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4132758-fe6a-4452-a221-3f3dbd15e528 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:08.703390 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4132758-fe6a-4452-a221-3f3dbd15e528 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:08.708185 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4132758-fe6a-4452-a221-3f3dbd15e528 None admin] RBAC: Adding query filter params (role.id=6576d9225a0946de877f527e3d15db05, scope.project.id=121ed31a143d49b3a16ac6c5c6b28955, user.id=7e701cf55d13410aa259ec72578ed27a) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:08.708185 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4132758-fe6a-4452-a221-3f3dbd15e528 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:08.708185 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4132758-fe6a-4452-a221-3f3dbd15e528 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:08.715481 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 429/856] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:12:08 2022] GET /identity/v3/role_assignments?user.id=7e701cf55d13410aa259ec72578ed27a&scope.project.id=121ed31a143d49b3a16ac6c5c6b28955&role.id=6576d9225a0946de877f527e3d15db05 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:09.243664 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ae9f4-4984-4a80-ae59-9f59b84fc144 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:09.244020 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ae9f4-4984-4a80-ae59-9f59b84fc144 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:09.244241 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ae9f4-4984-4a80-ae59-9f59b84fc144 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:09.245735 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 428/857] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:09.252252 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effd47a-596f-474c-9163-dd1220d8598c None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:09.252926 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effd47a-596f-474c-9163-dd1220d8598c None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:09.253425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effd47a-596f-474c-9163-dd1220d8598c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:09.272235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-4effd47a-596f-474c-9163-dd1220d8598c None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:09.273752 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-4effd47a-596f-474c-9163-dd1220d8598c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:09.349185 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 430/858] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:09.373254 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ae9f4-4984-4a80-ae59-9f59b84fc144 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:09.480537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ae9f4-4984-4a80-ae59-9f59b84fc144 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:09.517817 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a3835-fe9d-47e8-891f-2aff8ed186c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:09.518941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a3835-fe9d-47e8-891f-2aff8ed186c3 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:09.519436 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a3835-fe9d-47e8-891f-2aff8ed186c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:09.519915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a3835-fe9d-47e8-891f-2aff8ed186c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:09.531531 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a3835-fe9d-47e8-891f-2aff8ed186c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:12:09.540524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-859a3835-fe9d-47e8-891f-2aff8ed186c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:12:09.540524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:09.540524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:09.540524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:09.540524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:09.540524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:09.540524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:09.540524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:09.540524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:09.540524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:09.540524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:09.540524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:09.540524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:12:09.540524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:12:09.540524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:12:09.540524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:12:09.541494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:12:09.541494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:12:09.541494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:12:09.541494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:12:09.541494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:09.541494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:09.541494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:09.541494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:09.541494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:09.541494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:09.541494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:09.541494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:09.541494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:09.541494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:09.541494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:09.541494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:09.542350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:09.542350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:09.542350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:09.542350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:09.542350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:12:09.542350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:12:09.542350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:12:09.542350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:12:09.542350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:12:09.542350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:12:09.542350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:12:09.542350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:09.542981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9eb619-5ac6-410f-93bd-5c28defeec67 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:09.542981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9eb619-5ac6-410f-93bd-5c28defeec67 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:09.542981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9eb619-5ac6-410f-93bd-5c28defeec67 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:09.545270 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 429/860] 10.222.0.71 () {56 vars in 1102 bytes} [Mon May 16 20:12:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:09.545384 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 431/860] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:09.550162 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d2bba-be76-456f-8838-f53efe11367d None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:09.551054 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d2bba-be76-456f-8838-f53efe11367d None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:09.551545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d2bba-be76-456f-8838-f53efe11367d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:09.551751 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a3835-fe9d-47e8-891f-2aff8ed186c3 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:09.569318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-f56d2bba-be76-456f-8838-f53efe11367d None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:09.570845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f56d2bba-be76-456f-8838-f53efe11367d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:09.653988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 432/861] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:09.671357 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a3835-fe9d-47e8-891f-2aff8ed186c3 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:09.681017 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d2bba-be76-456f-8838-f53efe11367d None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:09.716372 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e08e8-d210-4e75-a74b-dc9df054b617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:09.717196 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e08e8-d210-4e75-a74b-dc9df054b617 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:09.717580 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e08e8-d210-4e75-a74b-dc9df054b617 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:09.717954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e08e8-d210-4e75-a74b-dc9df054b617 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:09.718808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e08e8-d210-4e75-a74b-dc9df054b617 None admin] RBAC: Adding query filter params (name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:09.719236 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e08e8-d210-4e75-a74b-dc9df054b617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:09.720785 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e08e8-d210-4e75-a74b-dc9df054b617 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:09.729999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 430/862] 10.222.0.71 () {56 vars in 1103 bytes} [Mon May 16 20:12:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:09.735763 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e08e8-d210-4e75-a74b-dc9df054b617 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:09.809339 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d2bba-be76-456f-8838-f53efe11367d None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:09.856116 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e08e8-d210-4e75-a74b-dc9df054b617 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:09.861614 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b817c-8aa6-4177-97bd-e5e7dbad33ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:09.862288 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b817c-8aa6-4177-97bd-e5e7dbad33ac None admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:09.862561 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b817c-8aa6-4177-97bd-e5e7dbad33ac None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:09.862828 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b817c-8aa6-4177-97bd-e5e7dbad33ac None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:09.863557 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b817c-8aa6-4177-97bd-e5e7dbad33ac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:09.864953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b817c-8aa6-4177-97bd-e5e7dbad33ac None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:09.892181 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 433/863] 10.222.0.71 () {60 vars in 1141 bytes} [Mon May 16 20:12:09 2022] POST /identity/v3/services => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:12:09.918002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c16cf2-5c97-4a22-a5f6-53184988a823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:09.918898 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c16cf2-5c97-4a22-a5f6-53184988a823 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:09.919177 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c16cf2-5c97-4a22-a5f6-53184988a823 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:09.919441 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c16cf2-5c97-4a22-a5f6-53184988a823 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:09.932857 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c16cf2-5c97-4a22-a5f6-53184988a823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:09.934343 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c16cf2-5c97-4a22-a5f6-53184988a823 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:09.954244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-23c16cf2-5c97-4a22-a5f6-53184988a823 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:09.954244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:09.954244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:09.954244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:09.954244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:09.954244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:09.954244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:09.954244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:09.954244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:09.954244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:09.954244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:09.954244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:09.954244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:12:09.954244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:12:09.954244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:12:09.955352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:12:09.955352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:09.955352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:09.955352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:09.955352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:09.955352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:09.955352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:09.955352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:09.955352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:09.955352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:09.955352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:09.955352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:09.955352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:09.955352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:09.955352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:09.955352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:09.955352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:09.956874 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:12:09.956874 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:12:09.956874 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:09.956874 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:09.956874 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 431/864] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:09.961402 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b817c-8aa6-4177-97bd-e5e7dbad33ac None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:10.075723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b817c-8aa6-4177-97bd-e5e7dbad33ac None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:10.110812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64687912-0d2e-4261-abd7-9d4819c6ce3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:10.111552 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64687912-0d2e-4261-abd7-9d4819c6ce3f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:10.111852 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64687912-0d2e-4261-abd7-9d4819c6ce3f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:10.112119 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64687912-0d2e-4261-abd7-9d4819c6ce3f None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:10.112866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64687912-0d2e-4261-abd7-9d4819c6ce3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:10.113169 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64687912-0d2e-4261-abd7-9d4819c6ce3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:10.114516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64687912-0d2e-4261-abd7-9d4819c6ce3f None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:10.127502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 434/865] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:10.133127 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c16cf2-5c97-4a22-a5f6-53184988a823 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:10.240417 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c16cf2-5c97-4a22-a5f6-53184988a823 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:10.274892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd963b-626b-4c30-8bca-00c560672390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:10.275689 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd963b-626b-4c30-8bca-00c560672390 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:10.275962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd963b-626b-4c30-8bca-00c560672390 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:10.276264 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd963b-626b-4c30-8bca-00c560672390 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:10.284350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd963b-626b-4c30-8bca-00c560672390 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:10.285788 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd963b-626b-4c30-8bca-00c560672390 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:10.300632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-7bdd963b-626b-4c30-8bca-00c560672390 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 20:12:10.300632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:10.300632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:10.300632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:10.300632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:10.300632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:10.300632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:10.300632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:10.300632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:10.300632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:10.300632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:10.300632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:10.300632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:12:10.300632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:12:10.300632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:12:10.300632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:12:10.301598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:10.301598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:10.301598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:12:10.301598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:10.301598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:12:10.301598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:10.301598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:10.301598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:10.301598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:10.301598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:10.301598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:10.301598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:10.301598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:10.301598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:10.301598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:10.301598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:10.301598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:10.301598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:10.302696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:10.302696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:10.302696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:12:10.302696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:12:10.302696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:12:10.302696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:12:10.302696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:12:10.302696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:12:10.302696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 20:12:10.302696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:10.302696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 432/866] 10.222.0.71 () {56 vars in 1117 bytes} [Mon May 16 20:12:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:10.309717 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64687912-0d2e-4261-abd7-9d4819c6ce3f None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:10.412806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64687912-0d2e-4261-abd7-9d4819c6ce3f None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:10.448529 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d91db-6951-460d-bb3e-acb44196304c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:10.449595 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d91db-6951-460d-bb3e-acb44196304c None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:10.450084 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d91db-6951-460d-bb3e-acb44196304c None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:10.450560 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d91db-6951-460d-bb3e-acb44196304c None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:10.451606 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d91db-6951-460d-bb3e-acb44196304c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:10.452134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d91db-6951-460d-bb3e-acb44196304c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:10.453859 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d91db-6951-460d-bb3e-acb44196304c None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:10.478151 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 435/867] 10.222.0.71 () {56 vars in 1149 bytes} [Mon May 16 20:12:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:10.479871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd963b-626b-4c30-8bca-00c560672390 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:10.589048 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd963b-626b-4c30-8bca-00c560672390 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:10.625232 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28d8fa-0d7f-4975-87d5-d1cea4971d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:10.626787 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28d8fa-0d7f-4975-87d5-d1cea4971d0e None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:10.627273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28d8fa-0d7f-4975-87d5-d1cea4971d0e None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:10.627747 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28d8fa-0d7f-4975-87d5-d1cea4971d0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:10.697968 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28d8fa-0d7f-4975-87d5-d1cea4971d0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:10.699872 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28d8fa-0d7f-4975-87d5-d1cea4971d0e None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:10.832297 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 433/868] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:12:10 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:12:10.834255 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d91db-6951-460d-bb3e-acb44196304c None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:10.958267 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d91db-6951-460d-bb3e-acb44196304c None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:10.994211 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff596b1f-cb3d-4e48-89d3-aef3fca24f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:10.995044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff596b1f-cb3d-4e48-89d3-aef3fca24f59 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:10.995326 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff596b1f-cb3d-4e48-89d3-aef3fca24f59 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:10.995636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff596b1f-cb3d-4e48-89d3-aef3fca24f59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:11.007370 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff596b1f-cb3d-4e48-89d3-aef3fca24f59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:11.008858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff596b1f-cb3d-4e48-89d3-aef3fca24f59 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:11.027343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-ff596b1f-cb3d-4e48-89d3-aef3fca24f59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:11.027343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:11.027343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:11.027343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:11.027343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:11.027343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:11.027343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:11.027343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:11.027343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:11.027343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:11.027343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:11.027343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:11.027343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:12:11.027343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:12:11.027343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:12:11.028335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:12:11.028335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:11.028335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:11.028335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:11.028335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:11.028335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:11.028335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:11.028335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:11.028335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:11.028335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:11.028335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:11.028335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:11.028335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:11.028335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:11.028335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:11.028335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:11.028335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:11.029451 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:12:11.029451 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:12:11.029451 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:11.029451 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:11.029451 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 436/869] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:11.035981 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28d8fa-0d7f-4975-87d5-d1cea4971d0e None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:11.075858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3567f68-b2bf-4f4d-a649-217c5b273afb None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:11.076206 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3567f68-b2bf-4f4d-a649-217c5b273afb None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:11.076436 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3567f68-b2bf-4f4d-a649-217c5b273afb None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:11.078140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 437/870] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:12:11.088181 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4615c0-9c31-4a1e-b94b-657eaf2988a5 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:11.088181 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4615c0-9c31-4a1e-b94b-657eaf2988a5 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:11.088181 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4615c0-9c31-4a1e-b94b-657eaf2988a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:11.111862 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-0f4615c0-9c31-4a1e-b94b-657eaf2988a5 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:11.113977 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-0f4615c0-9c31-4a1e-b94b-657eaf2988a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:11.143528 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28d8fa-0d7f-4975-87d5-d1cea4971d0e None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:11.180200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccfec5-ee18-427a-9a00-8e4fcdb1fe18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:11.181153 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccfec5-ee18-427a-9a00-8e4fcdb1fe18 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:11.181424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccfec5-ee18-427a-9a00-8e4fcdb1fe18 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:11.181687 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccfec5-ee18-427a-9a00-8e4fcdb1fe18 None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:11.182405 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccfec5-ee18-427a-9a00-8e4fcdb1fe18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:11.182702 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccfec5-ee18-427a-9a00-8e4fcdb1fe18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:11.184058 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccfec5-ee18-427a-9a00-8e4fcdb1fe18 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:11.196216 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 434/871] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:11.204173 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 438/872] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:11 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:12:11.204339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51cafc-8e4c-4cc8-bdee-6f8ea2ed9020 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:11.204339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51cafc-8e4c-4cc8-bdee-6f8ea2ed9020 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:11.204339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51cafc-8e4c-4cc8-bdee-6f8ea2ed9020 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:11.204559 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4615c0-9c31-4a1e-b94b-657eaf2988a5 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:11.207300 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 435/873] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:11 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:11.211724 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae646c95-d266-47c2-8554-81f8a87882c1 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:11.215512 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae646c95-d266-47c2-8554-81f8a87882c1 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:11.215512 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae646c95-d266-47c2-8554-81f8a87882c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:11.238071 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-ae646c95-d266-47c2-8554-81f8a87882c1 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:11.239283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-ae646c95-d266-47c2-8554-81f8a87882c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:11.307062 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 436/874] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:11 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:11.307883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae646c95-d266-47c2-8554-81f8a87882c1 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:11.325696 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4615c0-9c31-4a1e-b94b-657eaf2988a5 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:11.368121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6cca9-afd8-470a-bf52-ba3b2a10074b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:11.368936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6cca9-afd8-470a-bf52-ba3b2a10074b None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:11.369218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6cca9-afd8-470a-bf52-ba3b2a10074b None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:11.369649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6cca9-afd8-470a-bf52-ba3b2a10074b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:11.378029 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6cca9-afd8-470a-bf52-ba3b2a10074b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:11.378865 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6cca9-afd8-470a-bf52-ba3b2a10074b None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:11.394060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-f9f6cca9-afd8-470a-bf52-ba3b2a10074b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:11.394060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:11.394060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:11.394060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:11.394060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:11.394060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:11.394060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:11.394060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:11.394060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:11.394060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:11.394060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:11.394060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:11.394060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:12:11.394060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:12:11.394060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:12:11.394988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:12:11.394988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:11.394988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:11.394988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:11.394988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:11.394988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:11.394988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:11.394988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:11.394988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:11.394988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:11.394988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:11.394988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:11.394988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:11.394988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:11.394988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:11.394988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:11.394988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:11.395872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:12:11.395872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:12:11.395872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:12:11.395872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:12:11.395872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:12:11.395872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:12:11.395872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:11.395872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:11.395872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 439/875] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:12:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:11.396481 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6cca9-afd8-470a-bf52-ba3b2a10074b None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:11.411203 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae646c95-d266-47c2-8554-81f8a87882c1 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:11.445655 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e6bc7-7907-46b4-b0ad-e876ca0a127e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:11.446325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e6bc7-7907-46b4-b0ad-e876ca0a127e None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:11.446595 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e6bc7-7907-46b4-b0ad-e876ca0a127e None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:11.446867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e6bc7-7907-46b4-b0ad-e876ca0a127e None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:11.447578 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e6bc7-7907-46b4-b0ad-e876ca0a127e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:11.448970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e6bc7-7907-46b4-b0ad-e876ca0a127e None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:11.462545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 437/876] 10.222.0.71 () {60 vars in 1141 bytes} [Mon May 16 20:12:11 2022] POST /identity/v3/services => generated 269 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:12:11.463675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e6bc7-7907-46b4-b0ad-e876ca0a127e None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:11.516758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6cca9-afd8-470a-bf52-ba3b2a10074b None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:11.564590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd387cb1-f61b-4e10-bb53-19266adf5914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:11.565507 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd387cb1-f61b-4e10-bb53-19266adf5914 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:11.565787 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd387cb1-f61b-4e10-bb53-19266adf5914 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:11.566058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd387cb1-f61b-4e10-bb53-19266adf5914 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:11.567244 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd387cb1-f61b-4e10-bb53-19266adf5914 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:11.568176 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd387cb1-f61b-4e10-bb53-19266adf5914 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:11.581793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-cd387cb1-f61b-4e10-bb53-19266adf5914 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:12:11.581793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:11.581793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:12:11.581793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:12:11.581793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:12:11.581793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:12:11.581793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:12:11.581793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:11.581793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:12:11.581793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:11.581793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:12:11.581793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:11.581793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:11.581793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:11.581793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:11.581793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:11.581793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:11.582848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:11.582848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:11.582848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:11.582848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:11.582848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:11.582848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:11.582848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:12:11.582848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:12:11.582848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:12:11.582848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:12:11.582848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:11.582848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:11.582848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:11.582848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:11.582848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:11.582848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:11.583686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:11.583686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:11.583686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:11.583686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:11.583686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:11.583686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:11.583686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:11.583686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:11.583686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:11.583686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:11.583686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:12:11.583686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:11.583686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:12:11.583686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:11.588022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 440/877] 10.222.0.71 () {56 vars in 1126 bytes} [Mon May 16 20:12:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:11.589523 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd387cb1-f61b-4e10-bb53-19266adf5914 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:11.599651 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e6bc7-7907-46b4-b0ad-e876ca0a127e None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:11.638493 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1048d4d-92b5-46ae-9b36-62e6c6c1f15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:11.639568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1048d4d-92b5-46ae-9b36-62e6c6c1f15f None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:11.640341 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1048d4d-92b5-46ae-9b36-62e6c6c1f15f None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:11.640870 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1048d4d-92b5-46ae-9b36-62e6c6c1f15f None admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:11.642520 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1048d4d-92b5-46ae-9b36-62e6c6c1f15f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:11.643144 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1048d4d-92b5-46ae-9b36-62e6c6c1f15f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:11.644880 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1048d4d-92b5-46ae-9b36-62e6c6c1f15f None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:11.659635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 438/878] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:12:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:11.665804 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1048d4d-92b5-46ae-9b36-62e6c6c1f15f None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:11.722921 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd387cb1-f61b-4e10-bb53-19266adf5914 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:11.768660 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a45a53-afe3-4914-9785-a23f055fc38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:11.769529 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a45a53-afe3-4914-9785-a23f055fc38a None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:11.769926 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a45a53-afe3-4914-9785-a23f055fc38a None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:11.770299 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a45a53-afe3-4914-9785-a23f055fc38a None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:11.771101 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a45a53-afe3-4914-9785-a23f055fc38a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:11.771556 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a45a53-afe3-4914-9785-a23f055fc38a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:11.773069 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a45a53-afe3-4914-9785-a23f055fc38a None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:11.783158 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 441/879] 10.222.0.71 () {56 vars in 1122 bytes} [Mon May 16 20:12:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:11.784412 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a45a53-afe3-4914-9785-a23f055fc38a None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:11.811996 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1048d4d-92b5-46ae-9b36-62e6c6c1f15f None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:11.861726 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d54491-f02a-40a3-ba31-5f1cad44eabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:11.862678 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d54491-f02a-40a3-ba31-5f1cad44eabf None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:11.863107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d54491-f02a-40a3-ba31-5f1cad44eabf None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:11.863540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d54491-f02a-40a3-ba31-5f1cad44eabf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:11.864788 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d54491-f02a-40a3-ba31-5f1cad44eabf None admin] RBAC: Adding query filter params (role.id=bd4b3497427646f48a7c4d949e498ebc, scope.project.id=121ed31a143d49b3a16ac6c5c6b28955, user.id=38a56f3572874938ad4642fa34751a9a) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:11.865254 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d54491-f02a-40a3-ba31-5f1cad44eabf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:11.867506 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d54491-f02a-40a3-ba31-5f1cad44eabf None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:11.875830 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 439/880] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:12:11 2022] GET /identity/v3/role_assignments?user.id=38a56f3572874938ad4642fa34751a9a&scope.project.id=121ed31a143d49b3a16ac6c5c6b28955&role.id=bd4b3497427646f48a7c4d949e498ebc => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:11.915843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a45a53-afe3-4914-9785-a23f055fc38a None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:11.957526 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1328bba-3cab-4bb9-b345-74c20276d866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:11.958594 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1328bba-3cab-4bb9-b345-74c20276d866 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:11.959085 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1328bba-3cab-4bb9-b345-74c20276d866 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:11.959600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1328bba-3cab-4bb9-b345-74c20276d866 None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:11.960561 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1328bba-3cab-4bb9-b345-74c20276d866 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:11.961126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1328bba-3cab-4bb9-b345-74c20276d866 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:11.962740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1328bba-3cab-4bb9-b345-74c20276d866 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:11.968596 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 442/881] 10.222.0.71 () {56 vars in 1122 bytes} [Mon May 16 20:12:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:12.470257 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8b2ed-cda1-4bd6-aeed-cd76e1c46864 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:12.470457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8b2ed-cda1-4bd6-aeed-cd76e1c46864 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:12.470732 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8b2ed-cda1-4bd6-aeed-cd76e1c46864 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:12.472644 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 440/882] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:12.478389 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff63bd1-a6ee-415e-b7a9-208c249f7631 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:12.478975 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff63bd1-a6ee-415e-b7a9-208c249f7631 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:12.479448 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff63bd1-a6ee-415e-b7a9-208c249f7631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:12.498002 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-fff63bd1-a6ee-415e-b7a9-208c249f7631 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:12.499548 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-fff63bd1-a6ee-415e-b7a9-208c249f7631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:12.574227 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 443/883] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:12:12.597581 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8b2ed-cda1-4bd6-aeed-cd76e1c46864 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:12.713053 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8b2ed-cda1-4bd6-aeed-cd76e1c46864 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:12.751650 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2ca29-9c0a-4013-b6bd-4d2665ca7922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:12.752826 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2ca29-9c0a-4013-b6bd-4d2665ca7922 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:12.753301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2ca29-9c0a-4013-b6bd-4d2665ca7922 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:12.753794 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2ca29-9c0a-4013-b6bd-4d2665ca7922 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:12.754642 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2ca29-9c0a-4013-b6bd-4d2665ca7922 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:12.756230 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2ca29-9c0a-4013-b6bd-4d2665ca7922 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:12.769497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-d7b2ca29-9c0a-4013-b6bd-4d2665ca7922 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 20:12:12.769497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:12.769497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:12:12.769497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:12:12.769497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:12:12.769497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:12:12.769497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:12:12.769497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:12.769497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 20:12:12.769497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:12.769497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:12:12.769497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:12.769497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:12.769497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:12.769497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:12.769497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:12.769497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:12.770551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:12.770551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:12.770551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:12.770551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:12.770551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:12.770551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:12.770551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:12:12.770551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:12:12.770551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:12:12.770551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:12:12.770551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:12.770551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:12.770551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:12.770551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:12.770551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:12.770551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:12.771373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:12.771373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:12.771373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:12.771373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:12.771373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:12.771373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:12.771373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:12.771373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:12.771373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:12.771373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:12.771373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:12:12.771373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:12.771373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 20:12:12.771373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:12.774415 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 441/884] 10.222.0.71 () {56 vars in 1114 bytes} [Mon May 16 20:12:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:12.780904 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff63bd1-a6ee-415e-b7a9-208c249f7631 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:12.902317 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff63bd1-a6ee-415e-b7a9-208c249f7631 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:12.938878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487442a-2870-4400-9055-4800b1d63868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:12.940255 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487442a-2870-4400-9055-4800b1d63868 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:12.940255 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487442a-2870-4400-9055-4800b1d63868 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:12.940255 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487442a-2870-4400-9055-4800b1d63868 None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:12.944187 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487442a-2870-4400-9055-4800b1d63868 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:12.944187 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487442a-2870-4400-9055-4800b1d63868 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:12.944187 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487442a-2870-4400-9055-4800b1d63868 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:12.948136 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 444/885] 10.222.0.71 () {56 vars in 1114 bytes} [Mon May 16 20:12:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:12.954658 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2ca29-9c0a-4013-b6bd-4d2665ca7922 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:13.070672 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2ca29-9c0a-4013-b6bd-4d2665ca7922 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:13.120784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0018d52-20c7-4a7b-b4b1-9bf987c2c36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:13.121575 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0018d52-20c7-4a7b-b4b1-9bf987c2c36e None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:13.121862 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0018d52-20c7-4a7b-b4b1-9bf987c2c36e None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:13.122162 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0018d52-20c7-4a7b-b4b1-9bf987c2c36e None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:13.122891 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0018d52-20c7-4a7b-b4b1-9bf987c2c36e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:13.123192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0018d52-20c7-4a7b-b4b1-9bf987c2c36e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:13.124764 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0018d52-20c7-4a7b-b4b1-9bf987c2c36e None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:13.131362 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 442/886] 10.222.0.71 () {56 vars in 1114 bytes} [Mon May 16 20:12:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:13.138473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487442a-2870-4400-9055-4800b1d63868 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:13.263750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487442a-2870-4400-9055-4800b1d63868 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:13.303521 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067e458-4c93-409e-a070-6bc55f02603e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:13.304226 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067e458-4c93-409e-a070-6bc55f02603e None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:13.304510 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067e458-4c93-409e-a070-6bc55f02603e None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:13.304788 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067e458-4c93-409e-a070-6bc55f02603e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:13.305599 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067e458-4c93-409e-a070-6bc55f02603e None admin] RBAC: Adding query filter params (interface=public, service_id=98abcc241fc441e2ae28baa313d0de3f, region_id=RegionOne) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:13.305910 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067e458-4c93-409e-a070-6bc55f02603e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:13.307337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067e458-4c93-409e-a070-6bc55f02603e None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:13.314650 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 445/887] 10.222.0.71 () {56 vars in 1251 bytes} [Mon May 16 20:12:13 2022] GET /identity/v3/endpoints?service_id=98abcc241fc441e2ae28baa313d0de3f&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:13.320807 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0018d52-20c7-4a7b-b4b1-9bf987c2c36e None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:13.439574 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0018d52-20c7-4a7b-b4b1-9bf987c2c36e None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:13.474783 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fa984-ab59-4b8e-9556-b91d1548d29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:13.475450 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fa984-ab59-4b8e-9556-b91d1548d29e None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:13.475743 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fa984-ab59-4b8e-9556-b91d1548d29e None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:13.475991 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fa984-ab59-4b8e-9556-b91d1548d29e None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:13.476708 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fa984-ab59-4b8e-9556-b91d1548d29e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:13.478097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fa984-ab59-4b8e-9556-b91d1548d29e None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:13.484600 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 443/888] 10.222.0.71 () {56 vars in 1087 bytes} [Mon May 16 20:12:13 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:12:13.892386 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68195c8d-59fc-4db0-84bb-ffc7b4711b06 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:13.893166 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68195c8d-59fc-4db0-84bb-ffc7b4711b06 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:13.893696 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68195c8d-59fc-4db0-84bb-ffc7b4711b06 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:13.895720 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 446/889] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:13.901906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a846852-dfe5-4d0c-ba05-24fd865b91fe None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:13.902946 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a846852-dfe5-4d0c-ba05-24fd865b91fe None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:13.903427 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a846852-dfe5-4d0c-ba05-24fd865b91fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:13.924657 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-1a846852-dfe5-4d0c-ba05-24fd865b91fe None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:13.926258 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-1a846852-dfe5-4d0c-ba05-24fd865b91fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:14.001282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 444/890] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:14.025305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68195c8d-59fc-4db0-84bb-ffc7b4711b06 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:14.149825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68195c8d-59fc-4db0-84bb-ffc7b4711b06 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:14.191244 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79a434-bf9d-4857-a3a8-18fad31352b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:14.192507 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79a434-bf9d-4857-a3a8-18fad31352b3 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:14.193000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79a434-bf9d-4857-a3a8-18fad31352b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:14.193581 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79a434-bf9d-4857-a3a8-18fad31352b3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:14.194455 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79a434-bf9d-4857-a3a8-18fad31352b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:14.196085 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79a434-bf9d-4857-a3a8-18fad31352b3 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:14.210010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-bd79a434-bf9d-4857-a3a8-18fad31352b3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 20:12:14.210010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:14.210010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:12:14.210010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:12:14.210010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:12:14.210010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:12:14.210010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:12:14.210010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:14.210010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 20:12:14.210010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:14.210010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:12:14.210010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:14.210010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:14.210010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:14.210010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:14.210010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:14.211009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:14.211009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:14.211009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:14.211009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:14.211009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:14.211009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:14.211009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:14.211009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:12:14.211009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:12:14.211009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:12:14.211009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:12:14.211009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:14.211009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:14.211009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:14.211009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:14.211009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:14.211894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:14.211894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:14.211894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:14.211894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:14.211894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:14.211894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:14.211894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:14.211894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:14.211894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:14.211894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:14.211894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:14.211894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:12:14.211894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:14.211894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 20:12:14.211894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:14.214950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 447/891] 10.222.0.71 () {56 vars in 1132 bytes} [Mon May 16 20:12:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:14.222036 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a846852-dfe5-4d0c-ba05-24fd865b91fe None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:14.388009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a846852-dfe5-4d0c-ba05-24fd865b91fe None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:14.441766 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0924e-66fd-4f1c-ad82-cae2b47341bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:14.442785 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0924e-66fd-4f1c-ad82-cae2b47341bd None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:14.443260 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0924e-66fd-4f1c-ad82-cae2b47341bd None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:14.443739 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0924e-66fd-4f1c-ad82-cae2b47341bd None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:14.445166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0924e-66fd-4f1c-ad82-cae2b47341bd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:14.445700 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0924e-66fd-4f1c-ad82-cae2b47341bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:14.448363 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0924e-66fd-4f1c-ad82-cae2b47341bd None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:14.455944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba0e7e-b43e-4aef-bc8d-1a49f04e4399 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:14.456618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba0e7e-b43e-4aef-bc8d-1a49f04e4399 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:14.457123 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba0e7e-b43e-4aef-bc8d-1a49f04e4399 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:14.458406 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 445/892] 10.222.0.71 () {56 vars in 1126 bytes} [Mon May 16 20:12:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:14.458919 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 448/893] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:14.463475 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f7ba2-89f3-4b4a-ab22-81e9c6a47d2e None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:14.464692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f7ba2-89f3-4b4a-ab22-81e9c6a47d2e None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:14.464692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f7ba2-89f3-4b4a-ab22-81e9c6a47d2e None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:14.464877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba0e7e-b43e-4aef-bc8d-1a49f04e4399 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:14.467152 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 446/894] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:14.470018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bb8b7-6f45-467f-8832-a6ad522ebdf0 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:14.470567 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bb8b7-6f45-467f-8832-a6ad522ebdf0 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:14.471044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bb8b7-6f45-467f-8832-a6ad522ebdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:14.491385 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-c87bb8b7-6f45-467f-8832-a6ad522ebdf0 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:14.492664 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c87bb8b7-6f45-467f-8832-a6ad522ebdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:14.569755 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 447/895] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:14.571443 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d7e51-56a9-4e23-8cbd-7f039e064c71 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:14.571929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d7e51-56a9-4e23-8cbd-7f039e064c71 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:14.572447 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d7e51-56a9-4e23-8cbd-7f039e064c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:14.590746 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-f51d7e51-56a9-4e23-8cbd-7f039e064c71 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:14.592391 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f51d7e51-56a9-4e23-8cbd-7f039e064c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:14.606231 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba0e7e-b43e-4aef-bc8d-1a49f04e4399 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:14.651179 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c34c2f-95bf-4935-a700-c0e47435dd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:14.651848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c34c2f-95bf-4935-a700-c0e47435dd87 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:14.652129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c34c2f-95bf-4935-a700-c0e47435dd87 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:14.652480 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c34c2f-95bf-4935-a700-c0e47435dd87 None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:14.653215 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c34c2f-95bf-4935-a700-c0e47435dd87 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:14.653626 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c34c2f-95bf-4935-a700-c0e47435dd87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:14.655123 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c34c2f-95bf-4935-a700-c0e47435dd87 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:14.661093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 449/896] 10.222.0.71 () {56 vars in 1126 bytes} [Mon May 16 20:12:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:14.661921 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c34c2f-95bf-4935-a700-c0e47435dd87 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:14.704304 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 448/897] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:14.704304 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d7e51-56a9-4e23-8cbd-7f039e064c71 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:14.809992 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c34c2f-95bf-4935-a700-c0e47435dd87 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:14.847935 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d7e51-56a9-4e23-8cbd-7f039e064c71 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:14.865188 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d3c24-8beb-4898-8ca9-655412f6bb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:14.866161 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d3c24-8beb-4898-8ca9-655412f6bb26 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:14.866490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d3c24-8beb-4898-8ca9-655412f6bb26 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:14.866765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d3c24-8beb-4898-8ca9-655412f6bb26 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:14.879479 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d3c24-8beb-4898-8ca9-655412f6bb26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:12:14.886105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd730c2-efac-4ceb-9d4a-67c1f12a67f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:14.886765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd730c2-efac-4ceb-9d4a-67c1f12a67f8 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:14.887046 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd730c2-efac-4ceb-9d4a-67c1f12a67f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:14.887321 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd730c2-efac-4ceb-9d4a-67c1f12a67f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:14.888122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd730c2-efac-4ceb-9d4a-67c1f12a67f8 None admin] RBAC: Adding query filter params (interface=public, service_id=40e751b6261349648be8b4b08302df9c, region_id=RegionOne) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:14.888461 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd730c2-efac-4ceb-9d4a-67c1f12a67f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:14.890104 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd730c2-efac-4ceb-9d4a-67c1f12a67f8 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:14.890265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-ce5d3c24-8beb-4898-8ca9-655412f6bb26 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 20:12:14.890265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:14.890265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:14.890265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:14.890265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:14.890265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:14.890265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:14.890265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:14.890265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:14.890265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:14.890265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:14.890265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:14.890265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:12:14.890265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:12:14.890265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:12:14.890265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:12:14.892023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:12:14.892023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:12:14.892023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:12:14.892023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:12:14.892023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:14.892023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:14.892023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:14.892023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:14.892023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:14.892023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:14.892023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:14.892023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:14.892023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:14.892023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:14.892023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:14.892023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:14.894599 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:14.894599 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:14.894599 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:14.894599 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:14.894599 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:12:14.894599 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:12:14.894599 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:12:14.894599 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:12:14.894599 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:12:14.894599 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:12:14.894599 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 20:12:14.894599 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:14.894599 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 450/898] 10.222.0.71 () {56 vars in 1120 bytes} [Mon May 16 20:12:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:14.894599 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d3c24-8beb-4898-8ca9-655412f6bb26 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:14.902599 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 449/899] 10.222.0.71 () {56 vars in 1251 bytes} [Mon May 16 20:12:14 2022] GET /identity/v3/endpoints?service_id=40e751b6261349648be8b4b08302df9c&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:14.908450 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd730c2-efac-4ceb-9d4a-67c1f12a67f8 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:15.025910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd730c2-efac-4ceb-9d4a-67c1f12a67f8 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:15.045310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d3c24-8beb-4898-8ca9-655412f6bb26 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:15.074199 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34faf992-accb-4eb7-8a3a-0adf50b9e031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:15.074871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34faf992-accb-4eb7-8a3a-0adf50b9e031 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:15.075151 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34faf992-accb-4eb7-8a3a-0adf50b9e031 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:15.075431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34faf992-accb-4eb7-8a3a-0adf50b9e031 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:15.076214 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34faf992-accb-4eb7-8a3a-0adf50b9e031 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:15.076520 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34faf992-accb-4eb7-8a3a-0adf50b9e031 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:15.077908 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34faf992-accb-4eb7-8a3a-0adf50b9e031 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:15.088928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65dfe95-e689-4d07-8db3-7a61a2ed9e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:15.097771 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65dfe95-e689-4d07-8db3-7a61a2ed9e06 None admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:15.098030 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 450/900] 10.222.0.71 () {56 vars in 1115 bytes} [Mon May 16 20:12:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:15.098345 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65dfe95-e689-4d07-8db3-7a61a2ed9e06 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:15.098345 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65dfe95-e689-4d07-8db3-7a61a2ed9e06 None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:15.098625 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34faf992-accb-4eb7-8a3a-0adf50b9e031 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:15.098775 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65dfe95-e689-4d07-8db3-7a61a2ed9e06 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:15.098775 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65dfe95-e689-4d07-8db3-7a61a2ed9e06 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:15.113645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 451/901] 10.222.0.71 () {60 vars in 1141 bytes} [Mon May 16 20:12:14 2022] POST /identity/v3/services => generated 241 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:12:15.115487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65dfe95-e689-4d07-8db3-7a61a2ed9e06 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:15.225114 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34faf992-accb-4eb7-8a3a-0adf50b9e031 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:15.275303 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba083e-4110-4fca-b7e9-7344c458efbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:15.276177 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba083e-4110-4fca-b7e9-7344c458efbe None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:15.276459 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba083e-4110-4fca-b7e9-7344c458efbe None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:15.276612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65dfe95-e689-4d07-8db3-7a61a2ed9e06 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:15.276776 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba083e-4110-4fca-b7e9-7344c458efbe None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:15.277333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba083e-4110-4fca-b7e9-7344c458efbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:15.278760 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba083e-4110-4fca-b7e9-7344c458efbe None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:15.286615 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 451/902] 10.222.0.71 () {56 vars in 1087 bytes} [Mon May 16 20:12:15 2022] GET /identity/v3/services => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:12:15.322881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed54604-d54a-4607-8cc4-fa4244f8125f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:15.323771 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed54604-d54a-4607-8cc4-fa4244f8125f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:15.324247 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed54604-d54a-4607-8cc4-fa4244f8125f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:15.324562 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed54604-d54a-4607-8cc4-fa4244f8125f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:15.339493 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed54604-d54a-4607-8cc4-fa4244f8125f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:15.341061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed54604-d54a-4607-8cc4-fa4244f8125f None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:15.364579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-fed54604-d54a-4607-8cc4-fa4244f8125f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:15.364579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:15.364579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:15.364579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:15.364579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:15.364579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:15.364579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:15.364579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:15.364579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:15.364579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:15.364579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:15.364579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:15.364579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:12:15.364579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:12:15.364579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:12:15.367826 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:12:15.367826 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:15.367826 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:15.367826 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:15.367826 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:15.367826 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:15.367826 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:15.367826 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:15.367826 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:15.367826 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:15.367826 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:15.367826 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:15.367826 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:15.367826 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:15.367826 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:15.367826 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:15.367826 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:15.371043 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:12:15.371043 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:12:15.371043 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:15.371043 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:15.371043 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 452/903] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:15.382112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba083e-4110-4fca-b7e9-7344c458efbe None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:15.591036 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba083e-4110-4fca-b7e9-7344c458efbe None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:15.660749 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5443353-d6ba-4886-9294-840bcae71f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:15.662392 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5443353-d6ba-4886-9294-840bcae71f73 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:15.663153 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5443353-d6ba-4886-9294-840bcae71f73 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:15.663908 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5443353-d6ba-4886-9294-840bcae71f73 None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:15.665575 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5443353-d6ba-4886-9294-840bcae71f73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:15.666415 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5443353-d6ba-4886-9294-840bcae71f73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:15.669586 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5443353-d6ba-4886-9294-840bcae71f73 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:15.693825 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 452/904] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:15.702906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed54604-d54a-4607-8cc4-fa4244f8125f None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:15.877160 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed54604-d54a-4607-8cc4-fa4244f8125f None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:15.927797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b963f-6e1b-4b43-bee5-3186cbba31c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:15.929215 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b963f-6e1b-4b43-bee5-3186cbba31c5 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:15.929712 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b963f-6e1b-4b43-bee5-3186cbba31c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:15.930194 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b963f-6e1b-4b43-bee5-3186cbba31c5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:15.945022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b963f-6e1b-4b43-bee5-3186cbba31c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:15.947682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b963f-6e1b-4b43-bee5-3186cbba31c5 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:15.974989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-423b963f-6e1b-4b43-bee5-3186cbba31c5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 20:12:15.974989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:15.974989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:15.974989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:15.974989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:15.974989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:15.974989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:15.974989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:15.974989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:15.974989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:15.974989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:15.974989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:15.974989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:12:15.974989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:12:15.974989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:12:15.974989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:12:15.976799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:15.976799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:15.976799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:12:15.976799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:15.976799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:12:15.976799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:15.976799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:15.976799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:15.976799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:15.976799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:15.976799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:15.976799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:15.976799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:15.976799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:15.976799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:15.976799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:15.976799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:15.976799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:15.978600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:15.978600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:15.978600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:12:15.978600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:12:15.978600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:12:15.978600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:12:15.978600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:12:15.978600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:12:15.978600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 20:12:15.978600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:15.978600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 453/905] 10.222.0.71 () {56 vars in 1117 bytes} [Mon May 16 20:12:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:15.990228 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5443353-d6ba-4886-9294-840bcae71f73 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:16.122697 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5443353-d6ba-4886-9294-840bcae71f73 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:16.167282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0d039-79cc-4d8e-8096-ac649df47c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:16.168477 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0d039-79cc-4d8e-8096-ac649df47c2d None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:16.169005 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0d039-79cc-4d8e-8096-ac649df47c2d None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:16.169487 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0d039-79cc-4d8e-8096-ac649df47c2d None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:16.170613 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0d039-79cc-4d8e-8096-ac649df47c2d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:16.171177 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0d039-79cc-4d8e-8096-ac649df47c2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:16.173000 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0d039-79cc-4d8e-8096-ac649df47c2d None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:16.195111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 453/906] 10.222.0.71 () {56 vars in 1149 bytes} [Mon May 16 20:12:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:16.201314 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b963f-6e1b-4b43-bee5-3186cbba31c5 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:16.331302 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b963f-6e1b-4b43-bee5-3186cbba31c5 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:16.369148 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5271679-2d77-4418-8901-ba49899c2e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:16.369958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5271679-2d77-4418-8901-ba49899c2e6b None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:16.370345 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5271679-2d77-4418-8901-ba49899c2e6b None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:16.370654 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5271679-2d77-4418-8901-ba49899c2e6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:16.451510 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5271679-2d77-4418-8901-ba49899c2e6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:16.452900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5271679-2d77-4418-8901-ba49899c2e6b None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:16.467314 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e0732-2a7d-4596-9898-ab324831731b None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:16.468306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e0732-2a7d-4596-9898-ab324831731b None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:16.469053 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e0732-2a7d-4596-9898-ab324831731b None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:16.478789 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 454/907] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:16 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:12:16.481564 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca56a0-a6a6-4adf-9dde-dbbf5010b7b6 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:16.482331 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca56a0-a6a6-4adf-9dde-dbbf5010b7b6 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:16.483137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca56a0-a6a6-4adf-9dde-dbbf5010b7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:16.511070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-99ca56a0-a6a6-4adf-9dde-dbbf5010b7b6 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:16.513552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-99ca56a0-a6a6-4adf-9dde-dbbf5010b7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:16.570819 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 454/908] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:12:16 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:12:16.576393 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5271679-2d77-4418-8901-ba49899c2e6b None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:16.628352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 455/909] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:12:16.647244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca56a0-a6a6-4adf-9dde-dbbf5010b7b6 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:16.681651 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5271679-2d77-4418-8901-ba49899c2e6b None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:16.720893 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521342d0-a267-4193-b2e6-418519cc0c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:16.721415 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521342d0-a267-4193-b2e6-418519cc0c56 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:16.721788 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521342d0-a267-4193-b2e6-418519cc0c56 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:16.722068 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521342d0-a267-4193-b2e6-418519cc0c56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:16.733003 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521342d0-a267-4193-b2e6-418519cc0c56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:16.734188 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521342d0-a267-4193-b2e6-418519cc0c56 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:16.751948 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca56a0-a6a6-4adf-9dde-dbbf5010b7b6 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:16.753454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-521342d0-a267-4193-b2e6-418519cc0c56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:16.753454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:16.753454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:16.753454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:16.753454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:16.753454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:16.753454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:16.753454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:16.753454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:16.753454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:16.753454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:16.753454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:16.753454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:12:16.753454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:12:16.753454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:12:16.754395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:12:16.754395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:16.754395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:16.754395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:16.754395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:16.754395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:16.754395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:16.754395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:16.754395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:16.754395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:16.754395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:16.754395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:16.754395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:16.754395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:16.754395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:16.754395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:16.754395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:16.755350 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:12:16.755350 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:12:16.755350 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:16.755350 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:16.755350 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 455/910] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:16.760498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521342d0-a267-4193-b2e6-418519cc0c56 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:16.790687 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a9726-382c-4381-89c5-91f6e91a05d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:16.791852 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a9726-382c-4381-89c5-91f6e91a05d1 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:16.792379 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a9726-382c-4381-89c5-91f6e91a05d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:16.792859 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a9726-382c-4381-89c5-91f6e91a05d1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:16.793722 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a9726-382c-4381-89c5-91f6e91a05d1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:16.795353 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a9726-382c-4381-89c5-91f6e91a05d1 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:16.817008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-1a9a9726-382c-4381-89c5-91f6e91a05d1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 20:12:16.817008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:16.817008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:12:16.817008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:12:16.817008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:12:16.817008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:12:16.817008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:12:16.817008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:16.817008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 20:12:16.817008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:16.817008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:12:16.817008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:16.817008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:16.817008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:16.817008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:16.817008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:16.817008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:16.818098 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:16.818098 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:16.818098 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:16.818098 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:16.818098 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:16.818098 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:16.818098 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:12:16.818098 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:12:16.818098 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:12:16.818098 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:12:16.818098 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:16.818098 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:16.818098 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:16.818098 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:16.818098 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:16.818098 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:16.818958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:16.818958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:16.818958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:16.818958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:16.818958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:16.818958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:16.818958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:16.818958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:16.818958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:16.818958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:16.818958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:12:16.818958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:16.818958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 20:12:16.818958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:16.823592 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 456/911] 10.222.0.71 () {56 vars in 1114 bytes} [Mon May 16 20:12:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:12:16.824852 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a9726-382c-4381-89c5-91f6e91a05d1 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:16.877108 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521342d0-a267-4193-b2e6-418519cc0c56 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:16.921320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac668be-8e12-4003-bce2-b76fd7857929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:16.924948 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac668be-8e12-4003-bce2-b76fd7857929 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:16.925682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac668be-8e12-4003-bce2-b76fd7857929 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:16.926492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac668be-8e12-4003-bce2-b76fd7857929 None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:16.927883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac668be-8e12-4003-bce2-b76fd7857929 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:16.928687 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac668be-8e12-4003-bce2-b76fd7857929 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:16.932226 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac668be-8e12-4003-bce2-b76fd7857929 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:16.963020 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 456/912] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:16.965042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac668be-8e12-4003-bce2-b76fd7857929 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:16.975959 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a9726-382c-4381-89c5-91f6e91a05d1 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:17.018732 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa48863-559a-47eb-830c-a2da5e3f90c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:17.019558 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa48863-559a-47eb-830c-a2da5e3f90c9 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:17.019880 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa48863-559a-47eb-830c-a2da5e3f90c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:17.020677 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa48863-559a-47eb-830c-a2da5e3f90c9 None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:17.020904 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa48863-559a-47eb-830c-a2da5e3f90c9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:17.021202 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa48863-559a-47eb-830c-a2da5e3f90c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:17.022642 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa48863-559a-47eb-830c-a2da5e3f90c9 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:17.032656 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 457/913] 10.222.0.71 () {56 vars in 1114 bytes} [Mon May 16 20:12:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:17.035819 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa48863-559a-47eb-830c-a2da5e3f90c9 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:17.094190 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac668be-8e12-4003-bce2-b76fd7857929 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:17.134249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af60625-0e88-41d4-b000-1e0be9b01f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:17.135464 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af60625-0e88-41d4-b000-1e0be9b01f26 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:17.135956 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af60625-0e88-41d4-b000-1e0be9b01f26 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:17.136481 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af60625-0e88-41d4-b000-1e0be9b01f26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:17.141853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa48863-559a-47eb-830c-a2da5e3f90c9 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:17.146518 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af60625-0e88-41d4-b000-1e0be9b01f26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:17.148866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af60625-0e88-41d4-b000-1e0be9b01f26 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:17.174077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-3af60625-0e88-41d4-b000-1e0be9b01f26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:17.174077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:17.174077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:17.174077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:17.174077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:17.174077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:17.174077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:17.174077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:17.174077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:17.174077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:17.174077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:17.174077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:17.174077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:12:17.174077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:12:17.174077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:12:17.175105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:12:17.175105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:17.175105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:17.175105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:17.175105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:17.175105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:17.175105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:17.175105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:17.175105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:17.175105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:17.175105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:17.175105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:17.175105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:17.175105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:17.175105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:17.175105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:17.175105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:17.176011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:12:17.176011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:12:17.176011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:12:17.176011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:12:17.176011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:12:17.176011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:12:17.176011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:17.176011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:17.182366 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 457/914] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:12:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:17.183804 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af60625-0e88-41d4-b000-1e0be9b01f26 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:17.186614 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39914de-6370-4984-a8cf-fd9013b2843d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:17.187297 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39914de-6370-4984-a8cf-fd9013b2843d None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:17.187576 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39914de-6370-4984-a8cf-fd9013b2843d None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:17.188503 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39914de-6370-4984-a8cf-fd9013b2843d None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:17.189454 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39914de-6370-4984-a8cf-fd9013b2843d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:17.189747 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39914de-6370-4984-a8cf-fd9013b2843d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:17.191194 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39914de-6370-4984-a8cf-fd9013b2843d None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:17.200192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 458/915] 10.222.0.71 () {56 vars in 1114 bytes} [Mon May 16 20:12:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:17.205423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39914de-6370-4984-a8cf-fd9013b2843d None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:17.330640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af60625-0e88-41d4-b000-1e0be9b01f26 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:17.349455 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39914de-6370-4984-a8cf-fd9013b2843d None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:17.373848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a52fb5-d9f6-496a-a03d-793f6159b9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:17.374649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a52fb5-d9f6-496a-a03d-793f6159b9e5 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:17.374970 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a52fb5-d9f6-496a-a03d-793f6159b9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:17.375316 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a52fb5-d9f6-496a-a03d-793f6159b9e5 None admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:17.376610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a52fb5-d9f6-496a-a03d-793f6159b9e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:17.376948 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a52fb5-d9f6-496a-a03d-793f6159b9e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:17.378483 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a52fb5-d9f6-496a-a03d-793f6159b9e5 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:17.389348 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f14f5-f3cc-4fdd-8971-5255719528d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:17.390821 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f14f5-f3cc-4fdd-8971-5255719528d8 None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:17.391685 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f14f5-f3cc-4fdd-8971-5255719528d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:17.392209 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f14f5-f3cc-4fdd-8971-5255719528d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:17.393418 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f14f5-f3cc-4fdd-8971-5255719528d8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:17.395316 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f14f5-f3cc-4fdd-8971-5255719528d8 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:17.397571 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 458/916] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:12:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:17.399020 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a52fb5-d9f6-496a-a03d-793f6159b9e5 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:17.434936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 459/917] 10.222.0.71 () {60 vars in 1144 bytes} [Mon May 16 20:12:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:12:17.525587 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a52fb5-d9f6-496a-a03d-793f6159b9e5 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:17.573509 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877188d-28a6-4ca4-a4fe-81c57fa0b40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:17.574560 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877188d-28a6-4ca4-a4fe-81c57fa0b40c None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:17.575035 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877188d-28a6-4ca4-a4fe-81c57fa0b40c None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:17.575496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877188d-28a6-4ca4-a4fe-81c57fa0b40c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:17.576569 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877188d-28a6-4ca4-a4fe-81c57fa0b40c None admin] RBAC: Adding query filter params (role.id=9c0b1dff381a4a6dbf48ad23f7e56280, scope.project.id=121ed31a143d49b3a16ac6c5c6b28955, user.id=38a56f3572874938ad4642fa34751a9a) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:17.577085 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877188d-28a6-4ca4-a4fe-81c57fa0b40c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:17.579043 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877188d-28a6-4ca4-a4fe-81c57fa0b40c None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:17.586191 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 459/918] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:12:17 2022] GET /identity/v3/role_assignments?user.id=38a56f3572874938ad4642fa34751a9a&scope.project.id=121ed31a143d49b3a16ac6c5c6b28955&role.id=9c0b1dff381a4a6dbf48ad23f7e56280 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:17.840262 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b864d7-1fae-48d4-b86f-b432a831cad3 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:17.840598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b864d7-1fae-48d4-b86f-b432a831cad3 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:17.840843 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b864d7-1fae-48d4-b86f-b432a831cad3 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:17.842533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 460/919] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:17.848908 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f3658-83a2-4062-a271-d4aa0fb1ed1b None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:17.849220 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f3658-83a2-4062-a271-d4aa0fb1ed1b None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:17.849497 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f3658-83a2-4062-a271-d4aa0fb1ed1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:17.865382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94da727-ea9d-4685-8a74-db34712d9c88 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:17.865715 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94da727-ea9d-4685-8a74-db34712d9c88 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:17.865926 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94da727-ea9d-4685-8a74-db34712d9c88 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:17.867770 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 461/920] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:17.871239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-0a0f3658-83a2-4062-a271-d4aa0fb1ed1b None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:17.872804 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-0a0f3658-83a2-4062-a271-d4aa0fb1ed1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:17.873604 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242d485-c33e-41da-8d33-4f5fe8bee417 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:17.873887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242d485-c33e-41da-8d33-4f5fe8bee417 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:17.874163 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242d485-c33e-41da-8d33-4f5fe8bee417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:17.893298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-f242d485-c33e-41da-8d33-4f5fe8bee417 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:17.894874 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f242d485-c33e-41da-8d33-4f5fe8bee417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:17.965806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 460/921] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:17.982764 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 462/922] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:12:17.992067 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f3658-83a2-4062-a271-d4aa0fb1ed1b None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:18.010042 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242d485-c33e-41da-8d33-4f5fe8bee417 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:18.109324 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242d485-c33e-41da-8d33-4f5fe8bee417 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:18.110897 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f3658-83a2-4062-a271-d4aa0fb1ed1b None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:18.148797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93d1ca-e484-406d-9467-d39834505b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:18.150089 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93d1ca-e484-406d-9467-d39834505b58 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:18.150572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93d1ca-e484-406d-9467-d39834505b58 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:18.151045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93d1ca-e484-406d-9467-d39834505b58 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:18.152110 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93d1ca-e484-406d-9467-d39834505b58 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:18.152869 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c06557-5d22-4e8e-ba0c-8c43fd1660bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:18.153671 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c06557-5d22-4e8e-ba0c-8c43fd1660bd None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:18.153953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c06557-5d22-4e8e-ba0c-8c43fd1660bd None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:18.154227 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c06557-5d22-4e8e-ba0c-8c43fd1660bd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:18.154621 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93d1ca-e484-406d-9467-d39834505b58 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:18.155062 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c06557-5d22-4e8e-ba0c-8c43fd1660bd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:18.156456 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c06557-5d22-4e8e-ba0c-8c43fd1660bd None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:18.168306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-ae93d1ca-e484-406d-9467-d39834505b58 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 20:12:18.168306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:18.168306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:12:18.168306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:12:18.168306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:12:18.168306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:12:18.168306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:12:18.168306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:18.168306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 20:12:18.168306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:18.168306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:12:18.168306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:18.168306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:18.168306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:18.168306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:18.168306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:18.169270 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:18.169270 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:18.169270 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:18.169270 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:18.169270 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:18.169270 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:18.169270 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:18.169270 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:12:18.169270 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:12:18.169270 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:12:18.169270 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:12:18.169270 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:18.169270 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:18.169270 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:18.169270 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:18.169270 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:18.170082 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:18.170082 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:18.170082 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:18.170082 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:18.170082 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:18.170082 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:18.170082 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:18.170082 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:18.170082 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:18.170082 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:18.170082 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:18.170082 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:12:18.170082 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:18.170082 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 20:12:18.170082 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:18.176330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-f6c06557-5d22-4e8e-ba0c-8c43fd1660bd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:12:18.176330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:18.176330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:12:18.176330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:12:18.176330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:12:18.176330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:12:18.176330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:12:18.176330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:18.176330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:12:18.176330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:18.176330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:12:18.176330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:18.176330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:18.176330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:18.176330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:18.176330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:18.176330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:18.177758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:18.177758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:18.177758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:18.177758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:18.177758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:18.177758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:18.177758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:12:18.177758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:12:18.177758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:12:18.177758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:12:18.177758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:18.177758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:18.177758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:18.177758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:18.177758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:18.177758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:18.178685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:18.178685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:18.178685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:18.178685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:18.178685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:18.178685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:18.178685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:18.178685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:18.178685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:18.178685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:18.178685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:12:18.178685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:18.178685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:12:18.178685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:18.178685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 461/923] 10.222.0.71 () {56 vars in 1126 bytes} [Mon May 16 20:12:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:18.179472 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 463/924] 10.222.0.71 () {56 vars in 1132 bytes} [Mon May 16 20:12:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:12:18.179543 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c06557-5d22-4e8e-ba0c-8c43fd1660bd None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:18.179988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93d1ca-e484-406d-9467-d39834505b58 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:18.298782 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93d1ca-e484-406d-9467-d39834505b58 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:18.303735 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c06557-5d22-4e8e-ba0c-8c43fd1660bd None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:18.338218 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39db92-f04b-41c3-82c9-9ce608482f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:18.339218 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39db92-f04b-41c3-82c9-9ce608482f5f None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:18.339331 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39db92-f04b-41c3-82c9-9ce608482f5f None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:18.339899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39db92-f04b-41c3-82c9-9ce608482f5f None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:18.340277 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39db92-f04b-41c3-82c9-9ce608482f5f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:18.340591 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39db92-f04b-41c3-82c9-9ce608482f5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:18.342172 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39db92-f04b-41c3-82c9-9ce608482f5f None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:18.348705 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 464/925] 10.222.0.71 () {56 vars in 1126 bytes} [Mon May 16 20:12:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:18.356189 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39db92-f04b-41c3-82c9-9ce608482f5f None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:18.358743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784b85c-2bf2-41df-a54d-497ca7254ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:18.360638 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784b85c-2bf2-41df-a54d-497ca7254ffe None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:18.361386 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784b85c-2bf2-41df-a54d-497ca7254ffe None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:18.361683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784b85c-2bf2-41df-a54d-497ca7254ffe None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:18.362436 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784b85c-2bf2-41df-a54d-497ca7254ffe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:18.362750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784b85c-2bf2-41df-a54d-497ca7254ffe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:18.364126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784b85c-2bf2-41df-a54d-497ca7254ffe None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:18.370287 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 462/926] 10.222.0.71 () {56 vars in 1122 bytes} [Mon May 16 20:12:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:18.377516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784b85c-2bf2-41df-a54d-497ca7254ffe None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:18.478879 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39db92-f04b-41c3-82c9-9ce608482f5f None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:18.507109 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784b85c-2bf2-41df-a54d-497ca7254ffe None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:18.516615 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c47b2a-3c3b-48b9-a04c-37cce48e508e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:18.517586 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c47b2a-3c3b-48b9-a04c-37cce48e508e None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:18.518066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c47b2a-3c3b-48b9-a04c-37cce48e508e None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:18.518538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c47b2a-3c3b-48b9-a04c-37cce48e508e None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:18.519450 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c47b2a-3c3b-48b9-a04c-37cce48e508e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:18.519984 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c47b2a-3c3b-48b9-a04c-37cce48e508e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:18.521578 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c47b2a-3c3b-48b9-a04c-37cce48e508e None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:18.527256 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 465/927] 10.222.0.71 () {56 vars in 1126 bytes} [Mon May 16 20:12:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:18.535567 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c47b2a-3c3b-48b9-a04c-37cce48e508e None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:18.551192 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77645073-701a-4b18-afa2-0b6e0bdefab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:18.551851 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77645073-701a-4b18-afa2-0b6e0bdefab4 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:18.552134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77645073-701a-4b18-afa2-0b6e0bdefab4 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:18.552450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77645073-701a-4b18-afa2-0b6e0bdefab4 None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:18.553147 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77645073-701a-4b18-afa2-0b6e0bdefab4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:18.553696 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77645073-701a-4b18-afa2-0b6e0bdefab4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:18.554803 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77645073-701a-4b18-afa2-0b6e0bdefab4 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:18.564403 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 463/928] 10.222.0.71 () {56 vars in 1122 bytes} [Mon May 16 20:12:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:18.566429 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77645073-701a-4b18-afa2-0b6e0bdefab4 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:18.670341 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c47b2a-3c3b-48b9-a04c-37cce48e508e None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:18.670904 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77645073-701a-4b18-afa2-0b6e0bdefab4 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:18.717158 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bb0d0-6d01-47f6-b765-e59a57c26c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:18.717948 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bb0d0-6d01-47f6-b765-e59a57c26c75 None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:18.718155 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bb0d0-6d01-47f6-b765-e59a57c26c75 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:18.718479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bb0d0-6d01-47f6-b765-e59a57c26c75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:18.719481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591bb0d0-6d01-47f6-b765-e59a57c26c75 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:18.720891 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591bb0d0-6d01-47f6-b765-e59a57c26c75 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:18.725265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409fd75-710e-47c2-8a1a-d1d02aed1a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:18.726769 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409fd75-710e-47c2-8a1a-d1d02aed1a2e None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:18.727573 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409fd75-710e-47c2-8a1a-d1d02aed1a2e None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:18.728070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409fd75-710e-47c2-8a1a-d1d02aed1a2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:18.729171 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409fd75-710e-47c2-8a1a-d1d02aed1a2e None admin] RBAC: Adding query filter params (interface=public, service_id=e6754a77d1924af5ba16b9b9f0a1ec7b, region_id=RegionOne) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:18.729898 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409fd75-710e-47c2-8a1a-d1d02aed1a2e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:18.732637 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409fd75-710e-47c2-8a1a-d1d02aed1a2e None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:18.745400 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 464/929] 10.222.0.71 () {56 vars in 1251 bytes} [Mon May 16 20:12:18 2022] GET /identity/v3/endpoints?service_id=e6754a77d1924af5ba16b9b9f0a1ec7b&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:18.747321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409fd75-710e-47c2-8a1a-d1d02aed1a2e None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:18.752222 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 466/930] 10.222.0.71 () {60 vars in 1144 bytes} [Mon May 16 20:12:18 2022] POST /identity/v3/endpoints => generated 347 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:12:18.930040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409fd75-710e-47c2-8a1a-d1d02aed1a2e None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:18.977077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04e994-83da-4131-85bf-bc648254ebba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:18.977765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04e994-83da-4131-85bf-bc648254ebba None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:18.978048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04e994-83da-4131-85bf-bc648254ebba None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:18.978325 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04e994-83da-4131-85bf-bc648254ebba None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:18.979012 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04e994-83da-4131-85bf-bc648254ebba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:18.980856 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04e994-83da-4131-85bf-bc648254ebba None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:18.993954 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 465/931] 10.222.0.71 () {56 vars in 1087 bytes} [Mon May 16 20:12:18 2022] GET /identity/v3/services => generated 1497 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:12:19.848471 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d6292-e60d-4858-b542-69d99373ca5e None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:19.849026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d6292-e60d-4858-b542-69d99373ca5e None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:19.849026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d6292-e60d-4858-b542-69d99373ca5e None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:19.850591 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 467/932] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:19.856274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ebf6b-3077-4399-b43d-44cda12097d1 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:19.856762 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ebf6b-3077-4399-b43d-44cda12097d1 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:19.856866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ebf6b-3077-4399-b43d-44cda12097d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:19.873688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-bd7ebf6b-3077-4399-b43d-44cda12097d1 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:19.874863 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-bd7ebf6b-3077-4399-b43d-44cda12097d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:19.943373 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 466/933] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:19.959373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a188a-e063-4906-98da-bb9686c45f4a None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:19.959655 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a188a-e063-4906-98da-bb9686c45f4a None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:19.959928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a188a-e063-4906-98da-bb9686c45f4a None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:19.961306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 468/934] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:19.966841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622799a1-279b-4407-b562-64fd4f1c8901 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:19.967118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622799a1-279b-4407-b562-64fd4f1c8901 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:19.967389 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622799a1-279b-4407-b562-64fd4f1c8901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:19.972792 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a188a-e063-4906-98da-bb9686c45f4a None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:19.993780 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-622799a1-279b-4407-b562-64fd4f1c8901 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:19.994956 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-622799a1-279b-4407-b562-64fd4f1c8901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:20.068712 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 467/935] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:20.096668 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622799a1-279b-4407-b562-64fd4f1c8901 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:20.098604 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a188a-e063-4906-98da-bb9686c45f4a None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:20.145651 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b698b7-6990-48ef-a29d-7215f62fc8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:20.146994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b698b7-6990-48ef-a29d-7215f62fc8da None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:20.147409 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b698b7-6990-48ef-a29d-7215f62fc8da None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:20.147677 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b698b7-6990-48ef-a29d-7215f62fc8da None admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:20.148442 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b698b7-6990-48ef-a29d-7215f62fc8da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:20.150667 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b698b7-6990-48ef-a29d-7215f62fc8da None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:20.152424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: WARNING keystone.server.flask.common [None req-91b698b7-6990-48ef-a29d-7215f62fc8da None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 16 20:12:20.176395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.sql.core [None req-91b698b7-6990-48ef-a29d-7215f62fc8da None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 20:12:20.176395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 16 20:12:20.176395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [parameters: {'id': 'c4e975d7a8d949e289fbfa8a1ec7225d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 16 20:12:20.176395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79935) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 20:12:20.195938 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-91b698b7-6990-48ef-a29d-7215f62fc8da None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c4e975d7a8d949e289fbfa8a1ec7225d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c4e975d7a8d949e289fbfa8a1ec7225d. May 16 20:12:20.195938 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:20.195938 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 20:12:20.195938 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 20:12:20.195938 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 20:12:20.195938 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 20:12:20.195938 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 20:12:20.195938 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application result = self._query(query) May 16 20:12:20.195938 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 20:12:20.195938 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application conn.query(q) May 16 20:12:20.195938 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 20:12:20.195938 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 20:12:20.195938 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 20:12:20.196871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application result.read() May 16 20:12:20.196871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 20:12:20.196871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 20:12:20.196871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 20:12:20.196871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 20:12:20.196871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 20:12:20.196871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 20:12:20.196871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 20:12:20.196871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 20:12:20.196871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 20:12:20.196871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:20.196871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 20:12:20.196871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:20.196871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:20.196871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 20:12:20.196871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 20:12:20.196871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 16 20:12:20.196871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return project_ref.to_dict() May 16 20:12:20.198086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 20:12:20.198086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application next(self.gen) May 16 20:12:20.198086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 20:12:20.198086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application yield resource May 16 20:12:20.198086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 20:12:20.198086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application next(self.gen) May 16 20:12:20.198086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 20:12:20.198086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self.session.rollback() May 16 20:12:20.198086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 20:12:20.198086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self.force_reraise() May 16 20:12:20.198086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 20:12:20.198086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise self.value May 16 20:12:20.198086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 20:12:20.198086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 20:12:20.198086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 20:12:20.198086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application session.commit() May 16 20:12:20.198086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 20:12:20.199285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 20:12:20.199285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 20:12:20.199285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self._prepare_impl() May 16 20:12:20.199285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 20:12:20.199285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self.session.flush() May 16 20:12:20.199285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 20:12:20.199285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self._flush(objects) May 16 20:12:20.199285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 20:12:20.199285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 20:12:20.199285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 20:12:20.199285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application compat.raise_( May 16 20:12:20.199285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 20:12:20.199285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception May 16 20:12:20.199285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 20:12:20.199285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application flush_context.execute() May 16 20:12:20.199285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 20:12:20.199285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rec.execute(self) May 16 20:12:20.200412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 20:12:20.200412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 20:12:20.200412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 20:12:20.200412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 20:12:20.200412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 16 20:12:20.200412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application c = connection._execute_20( May 16 20:12:20.200412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 20:12:20.200412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 20:12:20.200412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 20:12:20.200412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 20:12:20.200412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 20:12:20.200412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 20:12:20.200412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 20:12:20.200412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 20:12:20.200412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 20:12:20.201460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 20:12:20.201460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 20:12:20.201460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception May 16 20:12:20.201460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 20:12:20.201460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 20:12:20.201460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 20:12:20.201460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 20:12:20.201460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 20:12:20.201460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application result = self._query(query) May 16 20:12:20.201460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 20:12:20.201460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application conn.query(q) May 16 20:12:20.201460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 20:12:20.201460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 20:12:20.201460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 20:12:20.201460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application result.read() May 16 20:12:20.201460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 20:12:20.201460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 20:12:20.202570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 20:12:20.202570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 20:12:20.202570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 20:12:20.202570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 20:12:20.202570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 20:12:20.202570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 20:12:20.202570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 20:12:20.202570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 16 20:12:20.202570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [parameters: {'id': 'c4e975d7a8d949e289fbfa8a1ec7225d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 16 20:12:20.202570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 20:12:20.202570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:20.202570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:12:20.202570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:20.202570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:20.202570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 16 20:12:20.203369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 16 20:12:20.203369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 20:12:20.203369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 20:12:20.203369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 16 20:12:20.203369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:20.203369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:12:20.203369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:20.203369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:20.203369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:20.203369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:20.203369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:20.203369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:20.203369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:20.203369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:20.203369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:20.203369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:20.203369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:20.205394 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:20.205394 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 16 20:12:20.205394 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 16 20:12:20.205394 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:20.205394 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:20.205394 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 16 20:12:20.205394 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.Conflict( May 16 20:12:20.205394 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c4e975d7a8d949e289fbfa8a1ec7225d. May 16 20:12:20.205394 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:20.205394 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 469/936] 10.222.0.71 () {60 vars in 1140 bytes} [Mon May 16 20:12:19 2022] POST /identity/v3/projects => generated 262 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:20.208627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b698b7-6990-48ef-a29d-7215f62fc8da None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:20.238829 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622799a1-279b-4407-b562-64fd4f1c8901 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:20.288009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3b3b7-f87d-41cb-ac97-6ad8640f7fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:20.289845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3b3b7-f87d-41cb-ac97-6ad8640f7fc8 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:20.290302 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3b3b7-f87d-41cb-ac97-6ad8640f7fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:20.291058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3b3b7-f87d-41cb-ac97-6ad8640f7fc8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:20.307619 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3b3b7-f87d-41cb-ac97-6ad8640f7fc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:12:20.318601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-29f3b3b7-f87d-41cb-ac97-6ad8640f7fc8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 20:12:20.318601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:20.318601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:20.318601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:20.318601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:20.318601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:20.318601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:20.318601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:20.318601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:20.318601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:20.318601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:20.318601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:20.318601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:12:20.318601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:12:20.318601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:12:20.318601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:12:20.319831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:12:20.319831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:12:20.319831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:12:20.319831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:12:20.319831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:20.319831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:20.319831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:20.319831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:20.319831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:20.319831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:20.319831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:20.319831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:20.319831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:20.319831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:20.319831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:20.319831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:20.321087 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:20.321087 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:20.321087 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:20.321087 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:20.321087 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:12:20.321087 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:12:20.321087 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:12:20.321087 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:12:20.321087 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:12:20.321087 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:12:20.321087 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 20:12:20.321087 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:20.321087 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 468/937] 10.222.0.71 () {56 vars in 1120 bytes} [Mon May 16 20:12:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:12:20.328208 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3b3b7-f87d-41cb-ac97-6ad8640f7fc8 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:20.340600 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b698b7-6990-48ef-a29d-7215f62fc8da None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:20.377382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35a533-9c7e-47bc-98bb-6f3f22ffabcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:20.378116 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35a533-9c7e-47bc-98bb-6f3f22ffabcb None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:20.378392 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35a533-9c7e-47bc-98bb-6f3f22ffabcb None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:20.378658 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35a533-9c7e-47bc-98bb-6f3f22ffabcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:20.386655 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35a533-9c7e-47bc-98bb-6f3f22ffabcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:20.388369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35a533-9c7e-47bc-98bb-6f3f22ffabcb None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:20.415021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-4b35a533-9c7e-47bc-98bb-6f3f22ffabcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:20.415021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:20.415021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:20.415021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:20.415021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:20.415021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:20.415021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:20.415021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:20.415021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:20.415021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:20.415021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:20.415021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:20.415021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:12:20.415021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:12:20.415021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:12:20.416781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:12:20.416781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:20.416781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:20.416781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:20.416781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:20.416781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:20.416781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:20.416781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:20.416781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:20.416781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:20.416781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:20.416781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:20.416781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:20.416781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:20.416781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:20.416781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:20.416781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:20.418577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:12:20.418577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:12:20.418577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:12:20.418577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:12:20.418577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:12:20.418577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:12:20.418577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:20.418577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:20.422023 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 470/938] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:12:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:20.428403 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35a533-9c7e-47bc-98bb-6f3f22ffabcb None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:20.468730 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3b3b7-f87d-41cb-ac97-6ad8640f7fc8 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:20.512989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d7d4d-a983-4742-9b1d-780cc36a9fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:20.513671 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d7d4d-a983-4742-9b1d-780cc36a9fd4 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:20.513954 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d7d4d-a983-4742-9b1d-780cc36a9fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:20.514459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d7d4d-a983-4742-9b1d-780cc36a9fd4 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:20.515490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d7d4d-a983-4742-9b1d-780cc36a9fd4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:20.515799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d7d4d-a983-4742-9b1d-780cc36a9fd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:20.517744 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d7d4d-a983-4742-9b1d-780cc36a9fd4 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:20.540181 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 469/939] 10.222.0.71 () {56 vars in 1115 bytes} [Mon May 16 20:12:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:20.543955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d7d4d-a983-4742-9b1d-780cc36a9fd4 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:20.566426 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35a533-9c7e-47bc-98bb-6f3f22ffabcb None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:20.608085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af89bb1-24ac-40ef-9e12-05b12ce3b810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:20.609348 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af89bb1-24ac-40ef-9e12-05b12ce3b810 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:20.610522 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af89bb1-24ac-40ef-9e12-05b12ce3b810 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:20.610947 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af89bb1-24ac-40ef-9e12-05b12ce3b810 None admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:20.612010 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af89bb1-24ac-40ef-9e12-05b12ce3b810 None admin] RBAC: Adding query filter params (name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:20.612494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af89bb1-24ac-40ef-9e12-05b12ce3b810 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:20.614679 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af89bb1-24ac-40ef-9e12-05b12ce3b810 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:20.648909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 471/940] 10.222.0.71 () {56 vars in 1112 bytes} [Mon May 16 20:12:20 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:20.662509 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d7d4d-a983-4742-9b1d-780cc36a9fd4 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:20.700671 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51d642-d3fc-41a7-aeda-fc1aefdba5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:20.701540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51d642-d3fc-41a7-aeda-fc1aefdba5bc None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:20.701826 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51d642-d3fc-41a7-aeda-fc1aefdba5bc None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:20.702149 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51d642-d3fc-41a7-aeda-fc1aefdba5bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:20.714640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51d642-d3fc-41a7-aeda-fc1aefdba5bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:20.716205 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51d642-d3fc-41a7-aeda-fc1aefdba5bc None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:20.735469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-6f51d642-d3fc-41a7-aeda-fc1aefdba5bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:20.735469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:20.735469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:20.735469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:20.735469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:20.735469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:20.735469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:20.735469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:20.735469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:20.735469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:20.735469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:20.735469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:20.735469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:12:20.735469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:12:20.735469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:12:20.736487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:12:20.736487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:20.736487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:20.736487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:20.736487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:20.736487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:20.736487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:20.736487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:20.736487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:20.736487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:20.736487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:20.736487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:20.736487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:20.736487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:20.736487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:20.736487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:20.736487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:20.737405 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:12:20.737405 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:12:20.737405 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:20.737405 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:20.737405 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 470/941] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:12:20.745360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af89bb1-24ac-40ef-9e12-05b12ce3b810 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:20.861478 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af89bb1-24ac-40ef-9e12-05b12ce3b810 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:20.903655 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457dcbd7-9972-42a6-9baf-e0fae4b0810e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:20.904702 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dcbd7-9972-42a6-9baf-e0fae4b0810e None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:20.905207 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dcbd7-9972-42a6-9baf-e0fae4b0810e None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:20.905674 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dcbd7-9972-42a6-9baf-e0fae4b0810e None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:20.906675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457dcbd7-9972-42a6-9baf-e0fae4b0810e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:20.907196 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457dcbd7-9972-42a6-9baf-e0fae4b0810e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:20.908832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457dcbd7-9972-42a6-9baf-e0fae4b0810e None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:20.922165 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 472/942] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:20.928259 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51d642-d3fc-41a7-aeda-fc1aefdba5bc None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:21.054586 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51d642-d3fc-41a7-aeda-fc1aefdba5bc None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:21.092050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb84c46-75f4-47db-b84d-b701467ce2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:21.092908 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb84c46-75f4-47db-b84d-b701467ce2ff None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:21.093200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb84c46-75f4-47db-b84d-b701467ce2ff None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:21.093467 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb84c46-75f4-47db-b84d-b701467ce2ff None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:21.103357 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb84c46-75f4-47db-b84d-b701467ce2ff None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:21.104852 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb84c46-75f4-47db-b84d-b701467ce2ff None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:21.121612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-adb84c46-75f4-47db-b84d-b701467ce2ff None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 20:12:21.121612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:21.121612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:21.121612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:21.121612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:21.121612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:21.121612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:21.121612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:21.121612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:21.121612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:21.121612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:21.121612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:21.121612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:12:21.121612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:12:21.121612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:12:21.121612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:12:21.123134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:21.123134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:21.123134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:12:21.123134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:21.123134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:12:21.123134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:21.123134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:21.123134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:21.123134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:21.123134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:21.123134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:21.123134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:21.123134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:21.123134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:21.123134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:21.123134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:21.123134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:21.123134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:21.124673 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:21.124673 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:21.124673 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:12:21.124673 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:12:21.124673 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:12:21.124673 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:12:21.124673 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:12:21.124673 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:12:21.124673 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 20:12:21.124673 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:21.124673 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 471/943] 10.222.0.71 () {56 vars in 1117 bytes} [Mon May 16 20:12:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:21.135606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457dcbd7-9972-42a6-9baf-e0fae4b0810e None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:21.161967 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373d208-383e-42e0-a3ad-16fc7a1b6ae4 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:21.162321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373d208-383e-42e0-a3ad-16fc7a1b6ae4 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:21.162489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373d208-383e-42e0-a3ad-16fc7a1b6ae4 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:21.164835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 472/944] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:21.171289 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2f2e0-95f9-43d9-b067-14a9ef6cd913 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:21.173453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2f2e0-95f9-43d9-b067-14a9ef6cd913 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:21.173453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2f2e0-95f9-43d9-b067-14a9ef6cd913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:21.211946 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-28d2f2e0-95f9-43d9-b067-14a9ef6cd913 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:21.215248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-28d2f2e0-95f9-43d9-b067-14a9ef6cd913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:21.289588 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457dcbd7-9972-42a6-9baf-e0fae4b0810e None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:21.331984 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88294265-9445-45db-8c97-220583cffa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:21.333097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88294265-9445-45db-8c97-220583cffa59 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:21.333917 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88294265-9445-45db-8c97-220583cffa59 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:21.334382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88294265-9445-45db-8c97-220583cffa59 None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:21.335570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88294265-9445-45db-8c97-220583cffa59 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:21.336079 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88294265-9445-45db-8c97-220583cffa59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:21.338550 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88294265-9445-45db-8c97-220583cffa59 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:21.353941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 473/945] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:21.367388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 473/946] 10.222.0.71 () {56 vars in 1149 bytes} [Mon May 16 20:12:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:21.374576 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2f2e0-95f9-43d9-b067-14a9ef6cd913 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:21.379816 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88294265-9445-45db-8c97-220583cffa59 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:21.489813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2f2e0-95f9-43d9-b067-14a9ef6cd913 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:21.516785 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88294265-9445-45db-8c97-220583cffa59 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:21.525836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec4761-3259-4bbf-aea9-27b6a4659d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:21.526633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec4761-3259-4bbf-aea9-27b6a4659d7d None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:21.526916 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec4761-3259-4bbf-aea9-27b6a4659d7d None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:21.527192 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec4761-3259-4bbf-aea9-27b6a4659d7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:21.539536 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec4761-3259-4bbf-aea9-27b6a4659d7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:21.541142 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec4761-3259-4bbf-aea9-27b6a4659d7d None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:21.561331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-19ec4761-3259-4bbf-aea9-27b6a4659d7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:21.561331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:21.561331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:21.561331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:21.561331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:21.561331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:21.561331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:21.561331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:21.561331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:21.561331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:21.561331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:21.561331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:21.561331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:12:21.561331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:12:21.561331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:12:21.562307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:12:21.562307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:21.562307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:21.562307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:21.562307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:21.562307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:21.562307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:21.562307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:21.562307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:21.562307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:21.562307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:21.562307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:21.562307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:21.562307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:21.562307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:21.562307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:21.562307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:21.563761 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:12:21.563761 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:12:21.563761 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:21.563761 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:21.563761 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 474/947] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:21.565199 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d63c0-c0d8-44b6-9bd7-3a04a718f07a None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:21.565484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d63c0-c0d8-44b6-9bd7-3a04a718f07a None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:21.565762 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d63c0-c0d8-44b6-9bd7-3a04a718f07a None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:21.567279 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 475/948] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:21.572049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d63c0-c0d8-44b6-9bd7-3a04a718f07a None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:21.578092 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291111d-374b-407e-8ed5-900e8382d66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:21.579491 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291111d-374b-407e-8ed5-900e8382d66f None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:21.579989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291111d-374b-407e-8ed5-900e8382d66f None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:21.580508 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291111d-374b-407e-8ed5-900e8382d66f None admin] PATH_INFO: `/v3/services/compute` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:21.581706 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291111d-374b-407e-8ed5-900e8382d66f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:21.584138 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291111d-374b-407e-8ed5-900e8382d66f None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:21.598978 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-2291111d-374b-407e-8ed5-900e8382d66f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 20:12:21.598978 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:21.598978 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:12:21.598978 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:12:21.598978 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:12:21.598978 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:12:21.598978 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:12:21.598978 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:21.598978 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 20:12:21.598978 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:21.598978 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:12:21.598978 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:21.598978 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:21.598978 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:21.598978 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:21.598978 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:21.598978 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:21.600044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:21.600044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:21.600044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:21.600044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:21.600044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:21.600044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:21.600044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:12:21.600044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:12:21.600044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:12:21.600044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:12:21.600044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:21.600044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:21.600044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:21.600044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:21.600044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:21.600044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:21.601088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:21.601088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:21.601088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:21.601088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:21.601088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:21.601088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:21.601088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:21.601088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:21.601088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:21.601088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:21.601088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:12:21.601088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:21.601088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 20:12:21.601088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:21.601088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 474/949] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:12:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:12:21.602369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4573ba-e748-4733-ba14-4b9174c8494d None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:21.602369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4573ba-e748-4733-ba14-4b9174c8494d None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:21.602695 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4573ba-e748-4733-ba14-4b9174c8494d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:21.623087 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-aa4573ba-e748-4733-ba14-4b9174c8494d None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:21.624658 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-aa4573ba-e748-4733-ba14-4b9174c8494d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:21.709494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 475/950] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:21.710582 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4573ba-e748-4733-ba14-4b9174c8494d None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:21.734131 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d63c0-c0d8-44b6-9bd7-3a04a718f07a None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:21.775982 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b79b36-b4b6-4c4e-8802-320f5ea23e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:21.776783 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b79b36-b4b6-4c4e-8802-320f5ea23e19 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:21.777137 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b79b36-b4b6-4c4e-8802-320f5ea23e19 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:21.777414 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b79b36-b4b6-4c4e-8802-320f5ea23e19 None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:21.778149 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b79b36-b4b6-4c4e-8802-320f5ea23e19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:21.778454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b79b36-b4b6-4c4e-8802-320f5ea23e19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:21.780085 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b79b36-b4b6-4c4e-8802-320f5ea23e19 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:21.801098 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 476/951] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:21.801098 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b79b36-b4b6-4c4e-8802-320f5ea23e19 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:21.840384 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4573ba-e748-4733-ba14-4b9174c8494d None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:21.877153 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab96f0-dc1b-47c1-86ac-56a62f5e5e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:21.878142 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab96f0-dc1b-47c1-86ac-56a62f5e5e14 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:21.878252 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab96f0-dc1b-47c1-86ac-56a62f5e5e14 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:21.878565 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab96f0-dc1b-47c1-86ac-56a62f5e5e14 None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:21.879373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab96f0-dc1b-47c1-86ac-56a62f5e5e14 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:21.879678 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab96f0-dc1b-47c1-86ac-56a62f5e5e14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:21.881085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab96f0-dc1b-47c1-86ac-56a62f5e5e14 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:21.892054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 476/952] 10.222.0.71 () {56 vars in 1112 bytes} [Mon May 16 20:12:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:21.892054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab96f0-dc1b-47c1-86ac-56a62f5e5e14 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:21.916304 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b79b36-b4b6-4c4e-8802-320f5ea23e19 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:21.952857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2cbc2-0a23-4f73-b989-93682d3f8fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:21.954241 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2cbc2-0a23-4f73-b989-93682d3f8fb3 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:21.954521 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2cbc2-0a23-4f73-b989-93682d3f8fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:21.954795 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2cbc2-0a23-4f73-b989-93682d3f8fb3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:21.955449 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2cbc2-0a23-4f73-b989-93682d3f8fb3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:21.956834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2cbc2-0a23-4f73-b989-93682d3f8fb3 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:21.969425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-f5f2cbc2-0a23-4f73-b989-93682d3f8fb3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:12:21.969425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:21.969425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:12:21.969425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:12:21.969425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:12:21.969425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:12:21.969425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:12:21.969425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:21.969425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:12:21.969425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:21.969425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:12:21.969425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:21.969425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:21.969425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:21.969425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:21.969425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:21.969425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:21.970503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:21.970503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:21.970503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:21.970503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:21.970503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:21.970503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:21.970503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:12:21.970503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:12:21.970503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:12:21.970503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:12:21.970503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:21.970503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:21.970503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:21.970503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:21.970503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:21.970503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:21.971360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:21.971360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:21.971360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:21.971360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:21.971360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:21.971360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:21.971360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:21.971360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:21.971360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:21.971360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:21.971360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:12:21.971360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:21.971360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:12:21.971360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:21.975700 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 477/953] 10.222.0.71 () {56 vars in 1126 bytes} [Mon May 16 20:12:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:21.976647 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2cbc2-0a23-4f73-b989-93682d3f8fb3 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:21.996988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab96f0-dc1b-47c1-86ac-56a62f5e5e14 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:22.037221 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d1e8d-c012-4b55-be4c-efa38bde8bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:22.037944 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d1e8d-c012-4b55-be4c-efa38bde8bad None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:22.038224 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d1e8d-c012-4b55-be4c-efa38bde8bad None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:22.038611 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d1e8d-c012-4b55-be4c-efa38bde8bad None admin] PATH_INFO: `/v3/projects/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:22.046219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d1e8d-c012-4b55-be4c-efa38bde8bad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:22.047932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d1e8d-c012-4b55-be4c-efa38bde8bad None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:22.063105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-1f3d1e8d-c012-4b55-be4c-efa38bde8bad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:22.063105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:22.063105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:22.063105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:22.063105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:22.063105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:22.063105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:22.063105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:22.063105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:22.063105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:22.063105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:22.063105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:22.063105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:12:22.063105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:12:22.063105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:12:22.065137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:12:22.065137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:22.065137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:22.065137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:22.065137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:22.065137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:22.065137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:22.065137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:22.065137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:22.065137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:22.065137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:22.065137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:22.065137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:22.065137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:22.065137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:22.065137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:22.065137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:22.066832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:12:22.066832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:12:22.066832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:12:22.066832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:12:22.066832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:12:22.066832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:12:22.066832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:22.066832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:22.071779 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 477/954] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:12:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:22.072942 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d1e8d-c012-4b55-be4c-efa38bde8bad None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:22.109183 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2cbc2-0a23-4f73-b989-93682d3f8fb3 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:22.163309 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b869d4-bfc1-49fb-b8ff-28996afa354f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:22.164402 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b869d4-bfc1-49fb-b8ff-28996afa354f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:22.164871 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b869d4-bfc1-49fb-b8ff-28996afa354f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:22.165323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b869d4-bfc1-49fb-b8ff-28996afa354f None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:22.166636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b869d4-bfc1-49fb-b8ff-28996afa354f None admin] RBAC: Adding query filter params (type=compute) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:22.167124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b869d4-bfc1-49fb-b8ff-28996afa354f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:22.169638 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b869d4-bfc1-49fb-b8ff-28996afa354f None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:22.178186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 478/955] 10.222.0.71 () {56 vars in 1112 bytes} [Mon May 16 20:12:21 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:22.179667 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b869d4-bfc1-49fb-b8ff-28996afa354f None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:22.200237 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d1e8d-c012-4b55-be4c-efa38bde8bad None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:22.271955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54589231-86da-4ff1-b8af-24c30ca22b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:22.273728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54589231-86da-4ff1-b8af-24c30ca22b84 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:22.273728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54589231-86da-4ff1-b8af-24c30ca22b84 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:22.274188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54589231-86da-4ff1-b8af-24c30ca22b84 None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:22.275625 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54589231-86da-4ff1-b8af-24c30ca22b84 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:22.276281 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54589231-86da-4ff1-b8af-24c30ca22b84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:22.278939 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54589231-86da-4ff1-b8af-24c30ca22b84 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:22.296865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 478/956] 10.222.0.71 () {56 vars in 1122 bytes} [Mon May 16 20:12:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:22.300465 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54589231-86da-4ff1-b8af-24c30ca22b84 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:22.347003 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b869d4-bfc1-49fb-b8ff-28996afa354f None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:22.386195 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea2db9-2994-4dd3-85fd-ad2beeb9bf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:22.387282 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea2db9-2994-4dd3-85fd-ad2beeb9bf73 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:22.387793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea2db9-2994-4dd3-85fd-ad2beeb9bf73 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:22.388334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea2db9-2994-4dd3-85fd-ad2beeb9bf73 None admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:22.389343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea2db9-2994-4dd3-85fd-ad2beeb9bf73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:22.390123 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea2db9-2994-4dd3-85fd-ad2beeb9bf73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:22.392468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea2db9-2994-4dd3-85fd-ad2beeb9bf73 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:22.405853 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 479/957] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:12:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:22.412596 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea2db9-2994-4dd3-85fd-ad2beeb9bf73 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:22.442575 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54589231-86da-4ff1-b8af-24c30ca22b84 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:22.490016 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204508b-2556-4f23-ba96-cafb99cfce30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:22.491404 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204508b-2556-4f23-ba96-cafb99cfce30 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:22.491924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204508b-2556-4f23-ba96-cafb99cfce30 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:22.492607 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204508b-2556-4f23-ba96-cafb99cfce30 None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:22.494188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204508b-2556-4f23-ba96-cafb99cfce30 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:22.494821 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204508b-2556-4f23-ba96-cafb99cfce30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:22.497236 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204508b-2556-4f23-ba96-cafb99cfce30 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:22.505554 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 479/958] 10.222.0.71 () {56 vars in 1122 bytes} [Mon May 16 20:12:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:22.510547 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204508b-2556-4f23-ba96-cafb99cfce30 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:22.553890 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea2db9-2994-4dd3-85fd-ad2beeb9bf73 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:22.598789 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b62233-47f0-408b-ae6c-9b4b9fae43e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:22.599721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b62233-47f0-408b-ae6c-9b4b9fae43e6 None admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:22.600007 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b62233-47f0-408b-ae6c-9b4b9fae43e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:22.600300 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b62233-47f0-408b-ae6c-9b4b9fae43e6 None admin] PATH_INFO: `/v3/projects/121ed31a143d49b3a16ac6c5c6b28955/users/38a56f3572874938ad4642fa34751a9a/roles/9c0b1dff381a4a6dbf48ad23f7e56280` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:22.603357 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b62233-47f0-408b-ae6c-9b4b9fae43e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=121ed31a143d49b3a16ac6c5c6b28955, user_id=38a56f3572874938ad4642fa34751a9a, role_id=9c0b1dff381a4a6dbf48ad23f7e56280)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:22.606136 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b62233-47f0-408b-ae6c-9b4b9fae43e6 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:22.636588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 480/959] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:12:22 2022] PUT /identity/v3/projects/121ed31a143d49b3a16ac6c5c6b28955/users/38a56f3572874938ad4642fa34751a9a/roles/9c0b1dff381a4a6dbf48ad23f7e56280 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:12:22.705661 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204508b-2556-4f23-ba96-cafb99cfce30 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:22.776988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59bb361-2541-4a37-8bf0-286a649645a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:22.778627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bb361-2541-4a37-8bf0-286a649645a9 None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:22.779429 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bb361-2541-4a37-8bf0-286a649645a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:22.780271 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bb361-2541-4a37-8bf0-286a649645a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:22.782827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59bb361-2541-4a37-8bf0-286a649645a9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:22.786185 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59bb361-2541-4a37-8bf0-286a649645a9 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:22.825179 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 480/960] 10.222.0.71 () {60 vars in 1144 bytes} [Mon May 16 20:12:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:12:23.312566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4916b13-93f6-4d57-b701-873514aba202 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:23.313646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4916b13-93f6-4d57-b701-873514aba202 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:23.314000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4916b13-93f6-4d57-b701-873514aba202 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:23.316028 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 481/961] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:23.321953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e948f-16f0-44fb-89fa-db415ab4ec2a None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:23.322442 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e948f-16f0-44fb-89fa-db415ab4ec2a None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:23.322557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e948f-16f0-44fb-89fa-db415ab4ec2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:23.340456 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-e69e948f-16f0-44fb-89fa-db415ab4ec2a None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:23.341653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-e69e948f-16f0-44fb-89fa-db415ab4ec2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:23.423587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 481/962] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:12:23.448976 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4916b13-93f6-4d57-b701-873514aba202 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:23.561504 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4916b13-93f6-4d57-b701-873514aba202 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:23.597799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a39269-ec57-4136-a416-a7ab630e7699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:23.598487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a39269-ec57-4136-a416-a7ab630e7699 None admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:23.598768 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a39269-ec57-4136-a416-a7ab630e7699 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:23.599044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a39269-ec57-4136-a416-a7ab630e7699 None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:23.599766 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a39269-ec57-4136-a416-a7ab630e7699 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:23.601259 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a39269-ec57-4136-a416-a7ab630e7699 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:23.602601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: WARNING keystone.server.flask.common [None req-62a39269-ec57-4136-a416-a7ab630e7699 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 16 20:12:23.616545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.sql.core [None req-62a39269-ec57-4136-a416-a7ab630e7699 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 20:12:23.616545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 16 20:12:23.616545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [parameters: {'user_id': '8151b8af016b41d28235d38b1d84a4c5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 16 20:12:23.616545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79934) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 20:12:23.624676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-62a39269-ec57-4136-a416-a7ab630e7699 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 16 20:12:23.624676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:23.624676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 20:12:23.624676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 20:12:23.624676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 20:12:23.624676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 20:12:23.624676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 20:12:23.624676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application result = self._query(query) May 16 20:12:23.624676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 20:12:23.624676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application conn.query(q) May 16 20:12:23.624676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 20:12:23.624676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 20:12:23.624676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 20:12:23.624676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application result.read() May 16 20:12:23.624676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 20:12:23.626527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 20:12:23.626527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 20:12:23.626527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 20:12:23.626527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 20:12:23.626527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 20:12:23.626527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 20:12:23.626527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 20:12:23.626527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 20:12:23.626527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:23.626527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 20:12:23.626527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:23.626527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:23.626527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 20:12:23.626527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 20:12:23.626527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 16 20:12:23.626527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 16 20:12:23.626527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 20:12:23.626527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application next(self.gen) May 16 20:12:23.627657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 20:12:23.627657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application yield resource May 16 20:12:23.627657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 20:12:23.627657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application next(self.gen) May 16 20:12:23.627657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 20:12:23.627657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self.session.rollback() May 16 20:12:23.627657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 20:12:23.627657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self.force_reraise() May 16 20:12:23.627657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 20:12:23.627657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise self.value May 16 20:12:23.627657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 20:12:23.627657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 20:12:23.627657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 20:12:23.627657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application session.commit() May 16 20:12:23.627657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 20:12:23.627657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 20:12:23.627657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 20:12:23.628605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._prepare_impl() May 16 20:12:23.628605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 20:12:23.628605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self.session.flush() May 16 20:12:23.628605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 20:12:23.628605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._flush(objects) May 16 20:12:23.628605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 20:12:23.628605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 20:12:23.628605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 20:12:23.628605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application compat.raise_( May 16 20:12:23.628605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 20:12:23.628605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception May 16 20:12:23.628605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 20:12:23.628605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application flush_context.execute() May 16 20:12:23.628605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 20:12:23.628605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rec.execute(self) May 16 20:12:23.628605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 20:12:23.628605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 20:12:23.629528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 20:12:23.629528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 20:12:23.629528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 16 20:12:23.629528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application result = connection._execute_20( May 16 20:12:23.629528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 20:12:23.629528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 20:12:23.629528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 20:12:23.629528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 20:12:23.629528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 20:12:23.629528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 20:12:23.629528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 20:12:23.629528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 20:12:23.629528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 20:12:23.629528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 20:12:23.629528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 20:12:23.629528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception May 16 20:12:23.630453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 20:12:23.630453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 20:12:23.630453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 20:12:23.630453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 20:12:23.630453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 20:12:23.630453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application result = self._query(query) May 16 20:12:23.630453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 20:12:23.630453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application conn.query(q) May 16 20:12:23.630453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 20:12:23.630453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 20:12:23.630453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 20:12:23.630453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application result.read() May 16 20:12:23.630453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 20:12:23.630453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 20:12:23.630453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 20:12:23.630453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 20:12:23.631303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 20:12:23.631303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 20:12:23.631303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 20:12:23.631303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 20:12:23.631303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 20:12:23.631303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 16 20:12:23.631303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [parameters: {'user_id': '8151b8af016b41d28235d38b1d84a4c5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 16 20:12:23.631303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 20:12:23.631303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:23.631303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:12:23.631303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:23.631303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:23.631303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:23.631303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:23.631303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:23.635420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:23.635420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:23.635420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:23.635420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:23.635420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:23.635420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:23.635420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:23.635420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 16 20:12:23.635420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 16 20:12:23.635420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:23.635420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:23.635420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:12:23.635420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:23.635420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:12:23.635420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:23.635420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 16 20:12:23.635420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 16 20:12:23.637646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 16 20:12:23.637646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 16 20:12:23.637646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 20:12:23.637646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 20:12:23.637646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 16 20:12:23.637646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:23.637646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 482/963] 10.222.0.71 () {60 vars in 1131 bytes} [Mon May 16 20:12:23 2022] POST /identity/v3/users => generated 160 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:23.641392 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e948f-16f0-44fb-89fa-db415ab4ec2a None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:23.743425 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e948f-16f0-44fb-89fa-db415ab4ec2a None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:23.779479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b0d4a-621d-44a9-a412-07c16c7012e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:23.780715 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b0d4a-621d-44a9-a412-07c16c7012e3 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:23.781194 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b0d4a-621d-44a9-a412-07c16c7012e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:23.782310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b0d4a-621d-44a9-a412-07c16c7012e3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:23.790796 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b0d4a-621d-44a9-a412-07c16c7012e3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:23.792654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b0d4a-621d-44a9-a412-07c16c7012e3 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:23.808693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-a06b0d4a-621d-44a9-a412-07c16c7012e3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 20:12:23.808693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:23.808693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:23.808693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:23.808693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:23.808693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:23.808693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:23.808693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:23.808693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:23.808693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:23.808693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:23.808693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:23.808693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:12:23.808693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:12:23.808693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:12:23.808693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:12:23.809683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:23.809683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:23.809683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:12:23.809683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:23.809683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:12:23.809683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:23.809683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:23.809683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:23.809683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:23.809683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:23.809683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:23.809683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:23.809683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:23.809683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:23.809683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:23.809683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:23.809683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:23.809683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:23.810675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:23.810675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:23.810675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:12:23.810675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:12:23.810675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:12:23.810675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:12:23.810675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:12:23.810675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:12:23.810675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 20:12:23.810675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:23.813605 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 482/964] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:12:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:23.824201 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a39269-ec57-4136-a416-a7ab630e7699 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:23.929631 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a39269-ec57-4136-a416-a7ab630e7699 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:23.970031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b7935-076a-4d88-a7cc-1b6e2d90e9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:23.970757 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b7935-076a-4d88-a7cc-1b6e2d90e9ea None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:23.971038 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b7935-076a-4d88-a7cc-1b6e2d90e9ea None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:23.971312 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b7935-076a-4d88-a7cc-1b6e2d90e9ea None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:23.972114 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b7935-076a-4d88-a7cc-1b6e2d90e9ea None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:23.972451 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b7935-076a-4d88-a7cc-1b6e2d90e9ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:23.974098 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b7935-076a-4d88-a7cc-1b6e2d90e9ea None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:24.015398 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 483/965] 10.222.0.71 () {56 vars in 1101 bytes} [Mon May 16 20:12:23 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:25.101191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb79b86-ef0f-4e62-ac9a-2de122844fdb None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:25.101756 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb79b86-ef0f-4e62-ac9a-2de122844fdb None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:25.101756 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb79b86-ef0f-4e62-ac9a-2de122844fdb None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:25.103388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 483/966] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:25.108823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b07b0-2c0b-46e6-bb1a-91c672f04abf None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:25.109280 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b07b0-2c0b-46e6-bb1a-91c672f04abf None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:25.109368 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b07b0-2c0b-46e6-bb1a-91c672f04abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:25.127492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-293b07b0-2c0b-46e6-bb1a-91c672f04abf None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:25.129043 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-293b07b0-2c0b-46e6-bb1a-91c672f04abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:25.222224 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 484/967] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:25.251853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb79b86-ef0f-4e62-ac9a-2de122844fdb None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:25.363094 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8df87-0e1c-4ee8-a741-817aebec7707 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:25.363286 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8df87-0e1c-4ee8-a741-817aebec7707 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:25.363565 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8df87-0e1c-4ee8-a741-817aebec7707 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:25.364981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 485/968] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:12:25.370616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0a477-5358-4cb0-a15b-1d2739a06bd5 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:25.370911 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0a477-5358-4cb0-a15b-1d2739a06bd5 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:25.371191 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0a477-5358-4cb0-a15b-1d2739a06bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:25.390509 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-18c0a477-5358-4cb0-a15b-1d2739a06bd5 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:25.393026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-18c0a477-5358-4cb0-a15b-1d2739a06bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:25.401392 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb79b86-ef0f-4e62-ac9a-2de122844fdb None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:25.442255 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab538442-c0f5-4aed-9dce-a83fc73e91e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:25.443351 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab538442-c0f5-4aed-9dce-a83fc73e91e4 None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:25.443898 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab538442-c0f5-4aed-9dce-a83fc73e91e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:25.444700 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab538442-c0f5-4aed-9dce-a83fc73e91e4 None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:25.445462 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab538442-c0f5-4aed-9dce-a83fc73e91e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:25.446881 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab538442-c0f5-4aed-9dce-a83fc73e91e4 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:25.478102 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 484/969] 10.222.0.71 () {60 vars in 1141 bytes} [Mon May 16 20:12:25 2022] POST /identity/v3/services => generated 242 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:12:25.511894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 486/970] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:12:25.518227 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1984a95-94ba-42c5-91ce-f431730d74e3 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:25.518593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1984a95-94ba-42c5-91ce-f431730d74e3 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:25.518852 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1984a95-94ba-42c5-91ce-f431730d74e3 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:25.520779 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 485/971] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:25.526636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdece828-24cf-477b-bae2-887646c4740e None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:25.527011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdece828-24cf-477b-bae2-887646c4740e None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:25.527419 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdece828-24cf-477b-bae2-887646c4740e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:25.538005 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1984a95-94ba-42c5-91ce-f431730d74e3 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:25.546898 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-cdece828-24cf-477b-bae2-887646c4740e None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:25.548286 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-cdece828-24cf-477b-bae2-887646c4740e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:25.630793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 487/972] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:25.658288 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdece828-24cf-477b-bae2-887646c4740e None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:25.667483 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1984a95-94ba-42c5-91ce-f431730d74e3 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:25.717396 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c215ce-cfcb-42e9-9271-cb9bc90edb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:25.718212 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c215ce-cfcb-42e9-9271-cb9bc90edb51 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:25.718492 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c215ce-cfcb-42e9-9271-cb9bc90edb51 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:25.719786 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c215ce-cfcb-42e9-9271-cb9bc90edb51 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:25.720307 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c215ce-cfcb-42e9-9271-cb9bc90edb51 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:25.722006 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c215ce-cfcb-42e9-9271-cb9bc90edb51 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:25.735310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-93c215ce-cfcb-42e9-9271-cb9bc90edb51 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:12:25.735310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:25.735310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:12:25.735310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:12:25.735310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:12:25.735310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:12:25.735310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:12:25.735310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:25.735310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:12:25.735310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:25.735310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:12:25.735310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:25.735310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:25.735310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:25.735310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:25.735310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:25.735310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:25.736814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:25.736814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:25.736814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:25.736814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:25.736814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:25.736814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:25.736814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:12:25.736814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:12:25.736814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:12:25.736814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:12:25.736814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:25.736814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:25.736814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:25.736814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:25.736814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:25.736814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:25.737725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:25.737725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:25.737725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:25.737725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:25.737725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:25.737725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:25.737725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:25.737725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:25.737725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:25.737725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:25.737725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:12:25.737725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:25.737725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:12:25.737725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:25.737725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 486/973] 10.222.0.71 () {56 vars in 1126 bytes} [Mon May 16 20:12:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:12:25.743081 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c215ce-cfcb-42e9-9271-cb9bc90edb51 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:25.775777 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdece828-24cf-477b-bae2-887646c4740e None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:25.821079 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55056af7-6028-41fc-be1c-9d5b3e0148c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:25.822654 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55056af7-6028-41fc-be1c-9d5b3e0148c7 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:25.823175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55056af7-6028-41fc-be1c-9d5b3e0148c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:25.823688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55056af7-6028-41fc-be1c-9d5b3e0148c7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:25.843682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55056af7-6028-41fc-be1c-9d5b3e0148c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:12:25.859751 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c215ce-cfcb-42e9-9271-cb9bc90edb51 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:25.860597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-55056af7-6028-41fc-be1c-9d5b3e0148c7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 20:12:25.860597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:25.860597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:25.860597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:25.860597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:25.860597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:25.860597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:25.860597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:25.860597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:25.860597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:25.860597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:25.860597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:25.860597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:12:25.860597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:12:25.860597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:12:25.860597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:12:25.862318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:12:25.862318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:12:25.862318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:12:25.862318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:12:25.862318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:25.862318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:25.862318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:25.862318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:25.862318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:25.862318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:25.862318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:25.862318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:25.862318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:25.862318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:25.862318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:25.862318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:25.864740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:25.864740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:25.864740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:25.864740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:25.864740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:12:25.864740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:12:25.864740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:12:25.864740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:12:25.864740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:12:25.864740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:12:25.864740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 20:12:25.864740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:25.864740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 488/974] 10.222.0.71 () {56 vars in 1120 bytes} [Mon May 16 20:12:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:25.869714 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55056af7-6028-41fc-be1c-9d5b3e0148c7 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:25.903767 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d202d8-5ae0-4634-9c3b-4ef2310c13b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:25.905075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d202d8-5ae0-4634-9c3b-4ef2310c13b2 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:25.905745 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d202d8-5ae0-4634-9c3b-4ef2310c13b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:25.908696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d202d8-5ae0-4634-9c3b-4ef2310c13b2 None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:25.910105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d202d8-5ae0-4634-9c3b-4ef2310c13b2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:25.910781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d202d8-5ae0-4634-9c3b-4ef2310c13b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:25.913381 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d202d8-5ae0-4634-9c3b-4ef2310c13b2 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:25.925087 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 487/975] 10.222.0.71 () {56 vars in 1122 bytes} [Mon May 16 20:12:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:25.926909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d202d8-5ae0-4634-9c3b-4ef2310c13b2 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:26.033264 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55056af7-6028-41fc-be1c-9d5b3e0148c7 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:26.048955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d202d8-5ae0-4634-9c3b-4ef2310c13b2 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:26.068782 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69577e12-3e24-4736-b09b-e2fa7a7ad308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:26.069620 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69577e12-3e24-4736-b09b-e2fa7a7ad308 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:26.070008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69577e12-3e24-4736-b09b-e2fa7a7ad308 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:26.070462 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69577e12-3e24-4736-b09b-e2fa7a7ad308 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:26.071415 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69577e12-3e24-4736-b09b-e2fa7a7ad308 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:26.071821 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69577e12-3e24-4736-b09b-e2fa7a7ad308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:26.073322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69577e12-3e24-4736-b09b-e2fa7a7ad308 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:26.086837 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 489/976] 10.222.0.71 () {56 vars in 1115 bytes} [Mon May 16 20:12:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:26.088435 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69577e12-3e24-4736-b09b-e2fa7a7ad308 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:26.089815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96548e-3ebb-4813-8540-1e3740d13b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:26.090490 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96548e-3ebb-4813-8540-1e3740d13b06 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:26.090767 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96548e-3ebb-4813-8540-1e3740d13b06 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:26.091042 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96548e-3ebb-4813-8540-1e3740d13b06 None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:26.091756 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96548e-3ebb-4813-8540-1e3740d13b06 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:26.092062 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96548e-3ebb-4813-8540-1e3740d13b06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:26.093528 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96548e-3ebb-4813-8540-1e3740d13b06 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:26.100737 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 488/977] 10.222.0.71 () {56 vars in 1122 bytes} [Mon May 16 20:12:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:26.106980 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96548e-3ebb-4813-8540-1e3740d13b06 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:26.202431 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69577e12-3e24-4736-b09b-e2fa7a7ad308 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:26.216129 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96548e-3ebb-4813-8540-1e3740d13b06 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:26.239536 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774afd90-d8ac-4137-86e0-5e5d91a9d0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:26.240373 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774afd90-d8ac-4137-86e0-5e5d91a9d0c0 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:26.240662 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774afd90-d8ac-4137-86e0-5e5d91a9d0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:26.240940 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774afd90-d8ac-4137-86e0-5e5d91a9d0c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:26.252872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774afd90-d8ac-4137-86e0-5e5d91a9d0c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:26.254328 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774afd90-d8ac-4137-86e0-5e5d91a9d0c0 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:26.255195 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ec995-326a-45fd-ad60-fad76c4d1411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:26.255908 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ec995-326a-45fd-ad60-fad76c4d1411 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:26.256203 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ec995-326a-45fd-ad60-fad76c4d1411 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:26.256474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ec995-326a-45fd-ad60-fad76c4d1411 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:26.257270 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ec995-326a-45fd-ad60-fad76c4d1411 None admin] RBAC: Adding query filter params (interface=admin, service_id=e6754a77d1924af5ba16b9b9f0a1ec7b, region_id=RegionOne) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:26.257578 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ec995-326a-45fd-ad60-fad76c4d1411 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:26.258938 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ec995-326a-45fd-ad60-fad76c4d1411 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:26.266479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 489/978] 10.222.0.71 () {56 vars in 1249 bytes} [Mon May 16 20:12:26 2022] GET /identity/v3/endpoints?service_id=e6754a77d1924af5ba16b9b9f0a1ec7b&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:26.273745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-774afd90-d8ac-4137-86e0-5e5d91a9d0c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:26.273745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:26.273745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:26.273745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:26.273745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:26.273745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:26.273745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:26.273745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:26.273745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:26.273745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:26.273745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:26.273745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:26.273745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:12:26.273745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:12:26.273745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:12:26.274721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:12:26.274721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:26.274721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:26.274721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:26.274721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:26.274721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:26.274721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:26.274721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:26.274721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:26.274721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:26.274721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:26.274721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:26.274721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:26.274721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:26.274721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:26.274721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:26.274721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:26.275635 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:12:26.275635 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:12:26.275635 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:26.275635 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:26.275871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ec995-326a-45fd-ad60-fad76c4d1411 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:26.275947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 490/979] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:12:26.280584 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774afd90-d8ac-4137-86e0-5e5d91a9d0c0 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:26.384847 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ec995-326a-45fd-ad60-fad76c4d1411 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:26.396938 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774afd90-d8ac-4137-86e0-5e5d91a9d0c0 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:26.423234 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af3936-7b61-4c2c-b878-db5ce9278468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:26.423809 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af3936-7b61-4c2c-b878-db5ce9278468 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:26.424086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af3936-7b61-4c2c-b878-db5ce9278468 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:26.424386 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af3936-7b61-4c2c-b878-db5ce9278468 None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:26.425069 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af3936-7b61-4c2c-b878-db5ce9278468 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:26.426427 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af3936-7b61-4c2c-b878-db5ce9278468 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:26.440548 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 490/980] 10.222.0.71 () {56 vars in 1087 bytes} [Mon May 16 20:12:26 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:12:26.441455 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b572f4e-5f1f-4cf5-ba22-7e26cc76a9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:26.442170 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b572f4e-5f1f-4cf5-ba22-7e26cc76a9c7 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:26.442442 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b572f4e-5f1f-4cf5-ba22-7e26cc76a9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:26.442718 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b572f4e-5f1f-4cf5-ba22-7e26cc76a9c7 None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:26.443499 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b572f4e-5f1f-4cf5-ba22-7e26cc76a9c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:26.443809 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b572f4e-5f1f-4cf5-ba22-7e26cc76a9c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:26.445303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b572f4e-5f1f-4cf5-ba22-7e26cc76a9c7 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:26.461813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 491/981] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:26.468283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af3936-7b61-4c2c-b878-db5ce9278468 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:26.589624 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af3936-7b61-4c2c-b878-db5ce9278468 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:26.630485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e14bdf-0fd8-4434-8895-0edeb98a8bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:26.631312 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e14bdf-0fd8-4434-8895-0edeb98a8bcb None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:26.631590 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e14bdf-0fd8-4434-8895-0edeb98a8bcb None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:26.631860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e14bdf-0fd8-4434-8895-0edeb98a8bcb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:26.642444 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e14bdf-0fd8-4434-8895-0edeb98a8bcb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:26.643919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e14bdf-0fd8-4434-8895-0edeb98a8bcb None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:26.659915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-a4e14bdf-0fd8-4434-8895-0edeb98a8bcb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 20:12:26.659915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:26.659915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:26.659915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:26.659915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:26.659915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:26.659915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:26.659915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:26.659915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:26.659915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:26.659915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:26.659915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:26.659915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:12:26.659915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:12:26.659915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:12:26.659915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:12:26.661154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:26.661154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:26.661154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:12:26.661154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:26.661154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:12:26.661154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:26.661154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:26.661154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:26.661154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:26.661154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:26.661154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:26.661154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:26.661154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:26.661154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:26.661154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:26.661154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:26.661154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:26.661154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:26.662390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:26.662390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:26.662390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:12:26.662390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:12:26.662390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:12:26.662390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:12:26.662390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:12:26.662390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:12:26.662390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 20:12:26.662390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:26.662390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 491/982] 10.222.0.71 () {56 vars in 1117 bytes} [Mon May 16 20:12:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:12:26.668311 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b572f4e-5f1f-4cf5-ba22-7e26cc76a9c7 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:26.795980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b572f4e-5f1f-4cf5-ba22-7e26cc76a9c7 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:26.837579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f8ae7-2027-4f1b-b49e-b5c0c12b53b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:26.838275 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f8ae7-2027-4f1b-b49e-b5c0c12b53b1 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:26.838559 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f8ae7-2027-4f1b-b49e-b5c0c12b53b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:26.838838 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f8ae7-2027-4f1b-b49e-b5c0c12b53b1 None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:26.839693 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f8ae7-2027-4f1b-b49e-b5c0c12b53b1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:26.840118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f8ae7-2027-4f1b-b49e-b5c0c12b53b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:26.841640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f8ae7-2027-4f1b-b49e-b5c0c12b53b1 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:26.862505 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 492/983] 10.222.0.71 () {56 vars in 1149 bytes} [Mon May 16 20:12:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:26.868424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e14bdf-0fd8-4434-8895-0edeb98a8bcb None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:26.986452 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e14bdf-0fd8-4434-8895-0edeb98a8bcb None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:27.029341 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15557938-426d-4966-865b-3f837a246353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:27.030469 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15557938-426d-4966-865b-3f837a246353 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:27.030955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15557938-426d-4966-865b-3f837a246353 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:27.032633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15557938-426d-4966-865b-3f837a246353 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:27.155381 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15557938-426d-4966-865b-3f837a246353 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:27.158787 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15557938-426d-4966-865b-3f837a246353 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:27.338444 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 492/984] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:12:26 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 20:12:27.340173 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f8ae7-2027-4f1b-b49e-b5c0c12b53b1 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:27.441603 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f8ae7-2027-4f1b-b49e-b5c0c12b53b1 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:27.476303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e476c-8463-498f-8f53-5e15a8bd34cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:27.477102 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e476c-8463-498f-8f53-5e15a8bd34cf None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:27.477376 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e476c-8463-498f-8f53-5e15a8bd34cf None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:27.477646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e476c-8463-498f-8f53-5e15a8bd34cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:27.488207 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e476c-8463-498f-8f53-5e15a8bd34cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:27.489667 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e476c-8463-498f-8f53-5e15a8bd34cf None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:27.507303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-9d1e476c-8463-498f-8f53-5e15a8bd34cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:27.507303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:27.507303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:27.507303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:27.507303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:27.507303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:27.507303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:27.507303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:27.507303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:27.507303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:27.507303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:27.507303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:27.507303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:12:27.507303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:12:27.507303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:12:27.508657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:12:27.508657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:27.508657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:27.508657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:27.508657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:27.508657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:27.508657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:27.508657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:27.508657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:27.508657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:27.508657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:27.508657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:27.508657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:27.508657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:27.508657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:27.508657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:27.508657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:27.509580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:12:27.509580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:12:27.509580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:27.509580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:27.512496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 493/985] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:27.514235 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15557938-426d-4966-865b-3f837a246353 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:27.624311 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15557938-426d-4966-865b-3f837a246353 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:27.668974 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da79397-6280-4a4a-9891-17e1095078eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:27.669641 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da79397-6280-4a4a-9891-17e1095078eb None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:27.669919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da79397-6280-4a4a-9891-17e1095078eb None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:27.670196 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da79397-6280-4a4a-9891-17e1095078eb None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:27.670958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da79397-6280-4a4a-9891-17e1095078eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:27.671257 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da79397-6280-4a4a-9891-17e1095078eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:27.672770 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da79397-6280-4a4a-9891-17e1095078eb None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:27.690983 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 493/986] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:27.693356 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e476c-8463-498f-8f53-5e15a8bd34cf None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:27.797848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e476c-8463-498f-8f53-5e15a8bd34cf None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:27.832898 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa13d9-50dc-4506-95af-5df14914d01b None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:27.833227 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa13d9-50dc-4506-95af-5df14914d01b None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:27.833462 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa13d9-50dc-4506-95af-5df14914d01b None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:27.834945 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 494/987] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:12:27.836380 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfab7d0-7c3a-47b4-9070-9a70b38f245c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:27.837358 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfab7d0-7c3a-47b4-9070-9a70b38f245c None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:27.837791 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfab7d0-7c3a-47b4-9070-9a70b38f245c None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:27.838319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfab7d0-7c3a-47b4-9070-9a70b38f245c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:27.840120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ee201-bcb6-4ec5-b1ff-75fce54ca1f4 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:27.840439 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ee201-bcb6-4ec5-b1ff-75fce54ca1f4 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:27.840716 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ee201-bcb6-4ec5-b1ff-75fce54ca1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:27.847324 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfab7d0-7c3a-47b4-9070-9a70b38f245c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:27.848895 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfab7d0-7c3a-47b4-9070-9a70b38f245c None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:27.858878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-f40ee201-bcb6-4ec5-b1ff-75fce54ca1f4 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:27.861463 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f40ee201-bcb6-4ec5-b1ff-75fce54ca1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:27.865121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-8dfab7d0-7c3a-47b4-9070-9a70b38f245c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:27.865121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:27.865121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:27.865121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:27.865121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:27.865121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:27.865121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:27.865121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:27.865121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:27.865121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:27.865121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:27.865121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:27.865121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:12:27.865121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:12:27.865121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:12:27.866077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:12:27.866077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:27.866077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:27.866077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:27.866077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:27.866077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:27.866077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:27.866077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:27.866077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:27.866077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:27.866077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:27.866077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:27.866077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:27.866077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:27.866077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:27.866077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:27.866077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:27.866985 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:12:27.866985 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:12:27.866985 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:12:27.866985 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:12:27.866985 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:12:27.866985 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:12:27.866985 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:27.866985 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:27.866985 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 494/988] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:12:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:27.872657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfab7d0-7c3a-47b4-9070-9a70b38f245c None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:27.944515 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 495/989] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:27.970489 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ee201-bcb6-4ec5-b1ff-75fce54ca1f4 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:27.992226 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfab7d0-7c3a-47b4-9070-9a70b38f245c None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:28.034918 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f84e2-d68d-40f9-90d2-93e6865decd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:28.035580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f84e2-d68d-40f9-90d2-93e6865decd6 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:28.035861 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f84e2-d68d-40f9-90d2-93e6865decd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:28.036133 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f84e2-d68d-40f9-90d2-93e6865decd6 None admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:28.036963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f84e2-d68d-40f9-90d2-93e6865decd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:28.037260 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f84e2-d68d-40f9-90d2-93e6865decd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:28.038701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f84e2-d68d-40f9-90d2-93e6865decd6 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:28.057139 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 495/990] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:12:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:28.059679 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f84e2-d68d-40f9-90d2-93e6865decd6 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:28.100687 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ee201-bcb6-4ec5-b1ff-75fce54ca1f4 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:28.153628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e181bfb-a3f9-42de-8062-9f57820ef309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:28.154432 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e181bfb-a3f9-42de-8062-9f57820ef309 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:28.154714 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e181bfb-a3f9-42de-8062-9f57820ef309 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:28.155155 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e181bfb-a3f9-42de-8062-9f57820ef309 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:28.155905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e181bfb-a3f9-42de-8062-9f57820ef309 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:28.158145 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e181bfb-a3f9-42de-8062-9f57820ef309 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:28.170283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-1e181bfb-a3f9-42de-8062-9f57820ef309 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 20:12:28.170283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:28.170283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:12:28.170283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:12:28.170283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:12:28.170283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:12:28.170283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:12:28.170283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:28.170283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 20:12:28.170283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:28.170283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:12:28.170283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:28.170283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:28.170283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:28.170283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:28.170283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:28.170283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:28.171346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:28.171346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:28.171346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:28.171346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:28.171346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:28.171346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:28.171346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:12:28.171346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:12:28.171346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:12:28.171346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:12:28.171346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:28.171346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:28.171346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:28.171346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:28.171346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:28.171346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:28.173101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:28.173101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:28.173101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:28.173101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:28.173101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:28.173101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:28.173101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:28.173101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:28.173101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:28.173101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:28.173101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:12:28.173101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:28.173101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 20:12:28.173101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:28.173101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 496/991] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:12:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:28.178605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f84e2-d68d-40f9-90d2-93e6865decd6 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:28.178881 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e181bfb-a3f9-42de-8062-9f57820ef309 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:28.222161 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc1363-4c8e-4718-9145-a56028a7aca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:28.222374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc1363-4c8e-4718-9145-a56028a7aca8 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:28.222573 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc1363-4c8e-4718-9145-a56028a7aca8 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:28.222852 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc1363-4c8e-4718-9145-a56028a7aca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:28.223689 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc1363-4c8e-4718-9145-a56028a7aca8 None admin] RBAC: Adding query filter params (role.id=9c0b1dff381a4a6dbf48ad23f7e56280, scope.project.id=121ed31a143d49b3a16ac6c5c6b28955, user.id=38a56f3572874938ad4642fa34751a9a) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:28.224001 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc1363-4c8e-4718-9145-a56028a7aca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:28.225469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc1363-4c8e-4718-9145-a56028a7aca8 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:28.244182 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 496/992] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:12:28 2022] GET /identity/v3/role_assignments?user.id=38a56f3572874938ad4642fa34751a9a&scope.project.id=121ed31a143d49b3a16ac6c5c6b28955&role.id=9c0b1dff381a4a6dbf48ad23f7e56280 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:28.298116 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e181bfb-a3f9-42de-8062-9f57820ef309 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:28.341105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff25ac5-bf61-4b46-9ef7-49bfbeb597d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:28.342453 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff25ac5-bf61-4b46-9ef7-49bfbeb597d6 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:28.342884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff25ac5-bf61-4b46-9ef7-49bfbeb597d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:28.343443 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff25ac5-bf61-4b46-9ef7-49bfbeb597d6 None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:28.345672 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff25ac5-bf61-4b46-9ef7-49bfbeb597d6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:28.346274 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff25ac5-bf61-4b46-9ef7-49bfbeb597d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:28.348101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff25ac5-bf61-4b46-9ef7-49bfbeb597d6 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:28.360417 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 497/993] 10.222.0.71 () {56 vars in 1112 bytes} [Mon May 16 20:12:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:28.361442 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc1363-4c8e-4718-9145-a56028a7aca8 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:28.498623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc1363-4c8e-4718-9145-a56028a7aca8 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:28.536192 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46f8be-8218-4e51-990b-680314ba2389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:28.536856 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46f8be-8218-4e51-990b-680314ba2389 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:28.537137 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46f8be-8218-4e51-990b-680314ba2389 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:28.537410 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46f8be-8218-4e51-990b-680314ba2389 None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:28.538111 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46f8be-8218-4e51-990b-680314ba2389 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:28.538414 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46f8be-8218-4e51-990b-680314ba2389 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:28.539768 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46f8be-8218-4e51-990b-680314ba2389 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:28.545713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 497/994] 10.222.0.71 () {56 vars in 1112 bytes} [Mon May 16 20:12:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:28.551941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff25ac5-bf61-4b46-9ef7-49bfbeb597d6 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:28.653606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff25ac5-bf61-4b46-9ef7-49bfbeb597d6 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:28.694282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c0794-2120-48dd-85d9-400de3327328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:28.695368 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c0794-2120-48dd-85d9-400de3327328 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:28.695844 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c0794-2120-48dd-85d9-400de3327328 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:28.696346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c0794-2120-48dd-85d9-400de3327328 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:28.697803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c0794-2120-48dd-85d9-400de3327328 None admin] RBAC: Adding query filter params (interface=public, service_id=29f8747878b04ad9bc0c257ac6b43f5d, region_id=RegionOne) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:28.698338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c0794-2120-48dd-85d9-400de3327328 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:28.700797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c0794-2120-48dd-85d9-400de3327328 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:28.714807 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 498/995] 10.222.0.71 () {56 vars in 1251 bytes} [Mon May 16 20:12:28 2022] GET /identity/v3/endpoints?service_id=29f8747878b04ad9bc0c257ac6b43f5d&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:28.716319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46f8be-8218-4e51-990b-680314ba2389 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:28.826191 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46f8be-8218-4e51-990b-680314ba2389 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:28.860225 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc944a7-8768-443f-a332-f1f6cae45f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:28.861073 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc944a7-8768-443f-a332-f1f6cae45f38 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:28.861521 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc944a7-8768-443f-a332-f1f6cae45f38 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:28.861801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc944a7-8768-443f-a332-f1f6cae45f38 None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:28.862487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc944a7-8768-443f-a332-f1f6cae45f38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:28.863850 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc944a7-8768-443f-a332-f1f6cae45f38 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:28.876406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 498/996] 10.222.0.71 () {56 vars in 1087 bytes} [Mon May 16 20:12:28 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:12:28.946968 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694d0f9-3a0d-4e51-ac91-256afc5d34e4 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:28.947252 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694d0f9-3a0d-4e51-ac91-256afc5d34e4 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:28.947532 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694d0f9-3a0d-4e51-ac91-256afc5d34e4 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:28.948950 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 499/997] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:28.955465 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104580c3-05b8-46f1-b49c-7e2e2d55413a None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:28.955785 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104580c3-05b8-46f1-b49c-7e2e2d55413a None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:28.956031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104580c3-05b8-46f1-b49c-7e2e2d55413a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:28.974229 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-104580c3-05b8-46f1-b49c-7e2e2d55413a None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:28.975444 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-104580c3-05b8-46f1-b49c-7e2e2d55413a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:29.050619 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 499/998] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:29.073390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694d0f9-3a0d-4e51-ac91-256afc5d34e4 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:29.185291 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694d0f9-3a0d-4e51-ac91-256afc5d34e4 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:29.223138 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65c585-4091-4342-b751-a9b2267d314c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:29.223951 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65c585-4091-4342-b751-a9b2267d314c None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:29.224309 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65c585-4091-4342-b751-a9b2267d314c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:29.224584 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65c585-4091-4342-b751-a9b2267d314c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:29.225247 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65c585-4091-4342-b751-a9b2267d314c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:29.226616 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65c585-4091-4342-b751-a9b2267d314c None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:29.240133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-ae65c585-4091-4342-b751-a9b2267d314c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:12:29.240133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:29.240133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:12:29.240133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:12:29.240133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:12:29.240133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:12:29.240133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:12:29.240133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:29.240133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:12:29.240133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:29.240133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:12:29.240133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:29.240133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:29.240133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:29.240133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:29.240133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:29.240133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:29.241220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:29.241220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:29.241220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:29.241220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:29.241220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:29.241220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:29.241220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:12:29.241220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:12:29.241220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:12:29.241220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:12:29.241220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:29.241220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:29.241220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:29.241220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:29.241220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:29.241220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:29.242060 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:29.242060 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:29.242060 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:29.242060 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:29.242060 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:29.242060 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:29.242060 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:29.242060 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:29.242060 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:29.242060 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:29.242060 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:12:29.242060 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:29.242060 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 20:12:29.242060 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:29.242060 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 500/999] 10.222.0.71 () {56 vars in 1126 bytes} [Mon May 16 20:12:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:29.249473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104580c3-05b8-46f1-b49c-7e2e2d55413a None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:29.370002 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104580c3-05b8-46f1-b49c-7e2e2d55413a None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:29.415109 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6cf12-33e4-43e0-a3bc-3ab54c5b0f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:29.416122 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6cf12-33e4-43e0-a3bc-3ab54c5b0f3f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:29.416650 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6cf12-33e4-43e0-a3bc-3ab54c5b0f3f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:29.417113 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6cf12-33e4-43e0-a3bc-3ab54c5b0f3f None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:29.418004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6cf12-33e4-43e0-a3bc-3ab54c5b0f3f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:29.418493 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6cf12-33e4-43e0-a3bc-3ab54c5b0f3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:29.420053 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6cf12-33e4-43e0-a3bc-3ab54c5b0f3f None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:29.426807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 500/1000] 10.222.0.71 () {56 vars in 1122 bytes} [Mon May 16 20:12:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:29.433334 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65c585-4091-4342-b751-a9b2267d314c None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:29.540045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65c585-4091-4342-b751-a9b2267d314c None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:29.585591 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307dbe7-1cc1-484b-b6f1-afe73191d11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:29.586258 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307dbe7-1cc1-484b-b6f1-afe73191d11f None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:29.586530 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307dbe7-1cc1-484b-b6f1-afe73191d11f None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:29.586796 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307dbe7-1cc1-484b-b6f1-afe73191d11f None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:29.587498 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307dbe7-1cc1-484b-b6f1-afe73191d11f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:29.587791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307dbe7-1cc1-484b-b6f1-afe73191d11f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:29.589193 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307dbe7-1cc1-484b-b6f1-afe73191d11f None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:29.594182 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 501/1001] 10.222.0.71 () {56 vars in 1122 bytes} [Mon May 16 20:12:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:29.599565 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6cf12-33e4-43e0-a3bc-3ab54c5b0f3f None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:29.745360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6cf12-33e4-43e0-a3bc-3ab54c5b0f3f None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:29.791386 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fedfa-f723-4210-afe1-83452146f91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:29.792631 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fedfa-f723-4210-afe1-83452146f91e None admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:29.793162 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fedfa-f723-4210-afe1-83452146f91e None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:29.793657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fedfa-f723-4210-afe1-83452146f91e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:29.794648 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fedfa-f723-4210-afe1-83452146f91e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:29.796350 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fedfa-f723-4210-afe1-83452146f91e None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:29.820839 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 501/1002] 10.222.0.71 () {60 vars in 1144 bytes} [Mon May 16 20:12:29 2022] POST /identity/v3/endpoints => generated 325 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:12:30.647189 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c083c-e4ff-4b00-8669-b6d3e0e14f93 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:30.647725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c083c-e4ff-4b00-8669-b6d3e0e14f93 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:30.647725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c083c-e4ff-4b00-8669-b6d3e0e14f93 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:30.652194 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 502/1003] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:30.654540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2c1eb-cfd5-4f09-88b7-189ff2de7ac9 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:30.655058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2c1eb-cfd5-4f09-88b7-189ff2de7ac9 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:30.655295 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2c1eb-cfd5-4f09-88b7-189ff2de7ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:30.673770 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-19e2c1eb-cfd5-4f09-88b7-189ff2de7ac9 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:30.674942 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-19e2c1eb-cfd5-4f09-88b7-189ff2de7ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:30.768456 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 502/1004] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:30 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:30.791154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c083c-e4ff-4b00-8669-b6d3e0e14f93 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:30.935782 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c083c-e4ff-4b00-8669-b6d3e0e14f93 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:30.978941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4d8f5-e6b6-411c-81a9-74556ffdc646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:30.979747 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4d8f5-e6b6-411c-81a9-74556ffdc646 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:30.980025 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4d8f5-e6b6-411c-81a9-74556ffdc646 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:30.980330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4d8f5-e6b6-411c-81a9-74556ffdc646 None admin] PATH_INFO: `/v3/services/image` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:30.981016 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4d8f5-e6b6-411c-81a9-74556ffdc646 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:30.982562 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4d8f5-e6b6-411c-81a9-74556ffdc646 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:30.999653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-44a4d8f5-e6b6-411c-81a9-74556ffdc646 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 20:12:30.999653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:30.999653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:12:30.999653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:12:30.999653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:12:30.999653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:12:30.999653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:12:30.999653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:30.999653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 20:12:30.999653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:30.999653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:12:30.999653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:30.999653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:30.999653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:30.999653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:30.999653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:30.999653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:31.001485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:31.001485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:31.001485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:31.001485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:31.001485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:31.001485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:31.001485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:12:31.001485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:12:31.001485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:12:31.001485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:12:31.001485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:31.001485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:31.001485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:31.001485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:31.001485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:31.001485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:31.002894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:31.002894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:31.002894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:31.002894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:31.002894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:31.002894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:31.002894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:31.002894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:31.002894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:31.002894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:31.002894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:12:31.002894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:31.002894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 20:12:31.002894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:31.006043 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 503/1005] 10.222.0.71 () {56 vars in 1105 bytes} [Mon May 16 20:12:30 2022] GET /identity/v3/services/image => generated 86 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:31.011718 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2c1eb-cfd5-4f09-88b7-189ff2de7ac9 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:31.162292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2c1eb-cfd5-4f09-88b7-189ff2de7ac9 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:31.207980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a52e7-6472-49c7-932d-eb01ad556b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:31.208630 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a52e7-6472-49c7-932d-eb01ad556b36 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:31.208911 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a52e7-6472-49c7-932d-eb01ad556b36 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:31.209179 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a52e7-6472-49c7-932d-eb01ad556b36 None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:31.209916 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a52e7-6472-49c7-932d-eb01ad556b36 None admin] RBAC: Adding query filter params (name=image) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:31.210221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a52e7-6472-49c7-932d-eb01ad556b36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:31.211645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a52e7-6472-49c7-932d-eb01ad556b36 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:31.222934 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 503/1006] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:31.225088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4d8f5-e6b6-411c-81a9-74556ffdc646 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:31.383919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4d8f5-e6b6-411c-81a9-74556ffdc646 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:31.422565 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19117d81-2ffa-4e67-b361-b1d949ab1c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:31.423469 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19117d81-2ffa-4e67-b361-b1d949ab1c4b None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:31.423892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19117d81-2ffa-4e67-b361-b1d949ab1c4b None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:31.424357 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19117d81-2ffa-4e67-b361-b1d949ab1c4b None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:31.425212 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19117d81-2ffa-4e67-b361-b1d949ab1c4b None admin] RBAC: Adding query filter params (type=image) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:31.425655 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19117d81-2ffa-4e67-b361-b1d949ab1c4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:31.427181 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19117d81-2ffa-4e67-b361-b1d949ab1c4b None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:31.433745 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 504/1007] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:31 2022] GET /identity/v3/services?type=image => generated 122 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:31.474004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ddbcb-b5ae-402e-a49e-c4b76cb5364d None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:31.474197 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ddbcb-b5ae-402e-a49e-c4b76cb5364d None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:31.474458 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ddbcb-b5ae-402e-a49e-c4b76cb5364d None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:31.476180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 504/1008] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:31.482281 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978a94a-ba8f-4ba4-8a37-389cff8f8ea3 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:31.482607 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978a94a-ba8f-4ba4-8a37-389cff8f8ea3 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:31.482912 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978a94a-ba8f-4ba4-8a37-389cff8f8ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:31.514211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-3978a94a-ba8f-4ba4-8a37-389cff8f8ea3 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:31.515883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-3978a94a-ba8f-4ba4-8a37-389cff8f8ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:31.602716 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 505/1009] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:31 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:31.627262 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ddbcb-b5ae-402e-a49e-c4b76cb5364d None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:31.760889 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ddbcb-b5ae-402e-a49e-c4b76cb5364d None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:31.804091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e01ea0-ee8e-4930-904a-70e2834a3136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:31.804941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e01ea0-ee8e-4930-904a-70e2834a3136 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:31.805278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e01ea0-ee8e-4930-904a-70e2834a3136 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:31.805558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e01ea0-ee8e-4930-904a-70e2834a3136 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:31.806274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e01ea0-ee8e-4930-904a-70e2834a3136 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:31.807668 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e01ea0-ee8e-4930-904a-70e2834a3136 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:31.821378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-03e01ea0-ee8e-4930-904a-70e2834a3136 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 20:12:31.821378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:31.821378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:12:31.821378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:12:31.821378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:12:31.821378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:12:31.821378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:12:31.821378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:31.821378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 20:12:31.821378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:31.821378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:12:31.821378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:31.821378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:31.821378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:31.821378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:31.821378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:31.821378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:31.823303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:31.823303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:31.823303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:31.823303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:31.823303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:31.823303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:31.823303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:12:31.823303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:12:31.823303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:12:31.823303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:12:31.823303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:31.823303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:31.823303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:31.823303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:31.823303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:31.823303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:31.825048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:31.825048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:31.825048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:31.825048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:31.825048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:31.825048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:31.825048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:31.825048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:31.825048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:31.825048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:31.825048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:12:31.825048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:31.825048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 20:12:31.825048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:31.825048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 505/1010] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:12:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:12:31.837811 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978a94a-ba8f-4ba4-8a37-389cff8f8ea3 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:31.985855 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978a94a-ba8f-4ba4-8a37-389cff8f8ea3 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:32.029863 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e69afb-3aae-48c1-adaa-56304454154f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:32.030474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e69afb-3aae-48c1-adaa-56304454154f None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:32.030753 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e69afb-3aae-48c1-adaa-56304454154f None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:32.031023 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e69afb-3aae-48c1-adaa-56304454154f None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:32.032343 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e69afb-3aae-48c1-adaa-56304454154f None admin] RBAC: Adding query filter params (name=compute) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:32.032650 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e69afb-3aae-48c1-adaa-56304454154f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:32.034063 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e69afb-3aae-48c1-adaa-56304454154f None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:32.039913 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 506/1011] 10.222.0.71 () {56 vars in 1112 bytes} [Mon May 16 20:12:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:32.046446 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e01ea0-ee8e-4930-904a-70e2834a3136 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:32.166923 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e01ea0-ee8e-4930-904a-70e2834a3136 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:32.211391 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d3b06-ad90-4a90-bd3a-431529367af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:32.213074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d3b06-ad90-4a90-bd3a-431529367af3 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:32.213855 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d3b06-ad90-4a90-bd3a-431529367af3 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:32.214606 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d3b06-ad90-4a90-bd3a-431529367af3 None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:32.216209 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d3b06-ad90-4a90-bd3a-431529367af3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:32.217167 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d3b06-ad90-4a90-bd3a-431529367af3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:32.220611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d3b06-ad90-4a90-bd3a-431529367af3 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:32.231378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 506/1012] 10.222.0.71 () {56 vars in 1112 bytes} [Mon May 16 20:12:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:32.236703 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e69afb-3aae-48c1-adaa-56304454154f None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:32.346416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e69afb-3aae-48c1-adaa-56304454154f None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:32.382407 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776d0a7-a02f-4417-be58-13a1b734d921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:32.383059 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776d0a7-a02f-4417-be58-13a1b734d921 None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:32.383336 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776d0a7-a02f-4417-be58-13a1b734d921 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:32.383604 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776d0a7-a02f-4417-be58-13a1b734d921 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:32.384386 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776d0a7-a02f-4417-be58-13a1b734d921 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:32.385757 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776d0a7-a02f-4417-be58-13a1b734d921 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:32.393677 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2e87a-7766-4a57-9033-a26833035678 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:32.393980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2e87a-7766-4a57-9033-a26833035678 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:32.394241 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2e87a-7766-4a57-9033-a26833035678 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:32.395644 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 507/1013] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:32.401505 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bdddd-411a-4727-94e9-530cc4495aef None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:32.401864 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bdddd-411a-4727-94e9-530cc4495aef None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:32.403013 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bdddd-411a-4727-94e9-530cc4495aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:32.412578 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 507/1014] 10.222.0.71 () {60 vars in 1144 bytes} [Mon May 16 20:12:32 2022] POST /identity/v3/endpoints => generated 334 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:12:32.420420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-e80bdddd-411a-4727-94e9-530cc4495aef None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:32.422095 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-e80bdddd-411a-4727-94e9-530cc4495aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:32.515430 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 508/1015] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:32 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:12:32.541163 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776d0a7-a02f-4417-be58-13a1b734d921 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:32.658219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776d0a7-a02f-4417-be58-13a1b734d921 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:32.707230 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6379f9-3e21-428a-8ba8-c87e56aff25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:32.708038 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6379f9-3e21-428a-8ba8-c87e56aff25e None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:32.708378 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6379f9-3e21-428a-8ba8-c87e56aff25e None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:32.708641 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6379f9-3e21-428a-8ba8-c87e56aff25e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:32.712024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6379f9-3e21-428a-8ba8-c87e56aff25e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:32.712311 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6379f9-3e21-428a-8ba8-c87e56aff25e None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:32.715666 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 508/1016] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:32.723121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bdddd-411a-4727-94e9-530cc4495aef None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:32.857198 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bdddd-411a-4727-94e9-530cc4495aef None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:32.898044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed52a8-b81c-4ac4-a234-213a9d50498f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:32.898718 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed52a8-b81c-4ac4-a234-213a9d50498f None admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:32.898998 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed52a8-b81c-4ac4-a234-213a9d50498f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:32.899271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed52a8-b81c-4ac4-a234-213a9d50498f None admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:32.899996 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed52a8-b81c-4ac4-a234-213a9d50498f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:32.901493 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed52a8-b81c-4ac4-a234-213a9d50498f None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:32.938971 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 509/1017] 10.222.0.71 () {60 vars in 1141 bytes} [Mon May 16 20:12:32 2022] POST /identity/v3/projects => generated 311 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:12:33.900006 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d73807-5bd3-423d-9584-871a2521d889 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:33.900559 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d73807-5bd3-423d-9584-871a2521d889 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:33.900559 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d73807-5bd3-423d-9584-871a2521d889 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:33.901947 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 509/1018] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:33.907904 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e63c0a-90d5-445f-b582-d9e7acc8ad5f None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:33.908425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e63c0a-90d5-445f-b582-d9e7acc8ad5f None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:33.908533 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e63c0a-90d5-445f-b582-d9e7acc8ad5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:33.925250 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-94e63c0a-90d5-445f-b582-d9e7acc8ad5f None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:33.926438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-94e63c0a-90d5-445f-b582-d9e7acc8ad5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:33.993198 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 510/1019] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:33 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:34.017058 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d73807-5bd3-423d-9584-871a2521d889 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:34.119449 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d73807-5bd3-423d-9584-871a2521d889 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:34.153758 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43458c8a-77e8-4bde-8b26-7c5292a3933c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:34.154337 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43458c8a-77e8-4bde-8b26-7c5292a3933c None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:34.154806 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43458c8a-77e8-4bde-8b26-7c5292a3933c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:34.154966 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43458c8a-77e8-4bde-8b26-7c5292a3933c None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:34.155707 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43458c8a-77e8-4bde-8b26-7c5292a3933c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:34.158034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43458c8a-77e8-4bde-8b26-7c5292a3933c None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:34.171492 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 510/1020] 10.222.0.71 () {60 vars in 1141 bytes} [Mon May 16 20:12:34 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:12:34.973229 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad88e28-e89a-4b02-9050-543af3e0a001 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:34.973798 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad88e28-e89a-4b02-9050-543af3e0a001 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:34.973963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad88e28-e89a-4b02-9050-543af3e0a001 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:34.976132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 511/1021] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:34.982027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec00b41-c93a-43cb-8376-4fb33447a643 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:34.982582 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec00b41-c93a-43cb-8376-4fb33447a643 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:34.982582 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec00b41-c93a-43cb-8376-4fb33447a643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:35.000563 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-8ec00b41-c93a-43cb-8376-4fb33447a643 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:35.001854 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8ec00b41-c93a-43cb-8376-4fb33447a643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:35.083282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 511/1022] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:12:35.106469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad88e28-e89a-4b02-9050-543af3e0a001 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:35.209468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad88e28-e89a-4b02-9050-543af3e0a001 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:35.242992 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1c874-0730-4fc1-a625-2a54d45a945f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:35.243797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1c874-0730-4fc1-a625-2a54d45a945f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:35.244079 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1c874-0730-4fc1-a625-2a54d45a945f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:35.244378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1c874-0730-4fc1-a625-2a54d45a945f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:35.254677 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1c874-0730-4fc1-a625-2a54d45a945f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:12:35.262765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-ebe1c874-0730-4fc1-a625-2a54d45a945f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 20:12:35.262765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:35.262765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:35.262765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:35.262765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:35.262765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:35.262765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:35.262765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:35.262765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:35.262765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:35.262765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:35.262765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:35.262765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:12:35.262765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:12:35.262765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:12:35.262765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:12:35.263733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:12:35.263733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:12:35.263733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:12:35.263733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:12:35.263733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:35.263733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:35.263733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:35.263733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:35.263733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:35.263733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:35.263733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:35.263733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:35.263733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:35.263733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:35.263733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:35.263733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:35.264925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:35.264925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:35.264925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:35.264925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:35.264925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:12:35.264925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:12:35.264925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:12:35.264925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:12:35.264925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:12:35.264925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:12:35.264925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 20:12:35.264925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:35.266297 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 512/1023] 10.222.0.71 () {56 vars in 1120 bytes} [Mon May 16 20:12:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:35.270386 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec00b41-c93a-43cb-8376-4fb33447a643 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:35.350186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b471c-7656-450d-8697-562fe01a1ef1 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:35.350541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b471c-7656-450d-8697-562fe01a1ef1 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:35.350741 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b471c-7656-450d-8697-562fe01a1ef1 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:35.352197 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 513/1024] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:12:35.357789 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8694355-0c91-411d-8e8b-5d37ed886d27 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:35.358072 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8694355-0c91-411d-8e8b-5d37ed886d27 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:35.358345 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8694355-0c91-411d-8e8b-5d37ed886d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:35.372839 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec00b41-c93a-43cb-8376-4fb33447a643 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:35.375838 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-e8694355-0c91-411d-8e8b-5d37ed886d27 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:35.377024 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-e8694355-0c91-411d-8e8b-5d37ed886d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:35.407692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db672-7f91-4b88-9b38-0059d82fd588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:35.408494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db672-7f91-4b88-9b38-0059d82fd588 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:35.408774 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db672-7f91-4b88-9b38-0059d82fd588 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:35.409041 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db672-7f91-4b88-9b38-0059d82fd588 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:35.409783 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9db672-7f91-4b88-9b38-0059d82fd588 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:35.410084 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9db672-7f91-4b88-9b38-0059d82fd588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:35.411448 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9db672-7f91-4b88-9b38-0059d82fd588 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:35.419756 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 512/1025] 10.222.0.71 () {56 vars in 1115 bytes} [Mon May 16 20:12:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:35.426325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db672-7f91-4b88-9b38-0059d82fd588 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:35.445424 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 514/1026] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:12:35.470424 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8694355-0c91-411d-8e8b-5d37ed886d27 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:35.532069 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db672-7f91-4b88-9b38-0059d82fd588 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:35.588516 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83961fc3-e514-4750-9af1-31c04a2ee319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:35.590220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83961fc3-e514-4750-9af1-31c04a2ee319 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:35.590567 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83961fc3-e514-4750-9af1-31c04a2ee319 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:35.591027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83961fc3-e514-4750-9af1-31c04a2ee319 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:35.603588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8694355-0c91-411d-8e8b-5d37ed886d27 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:35.613455 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83961fc3-e514-4750-9af1-31c04a2ee319 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:35.616319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83961fc3-e514-4750-9af1-31c04a2ee319 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:35.642721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3acff-9269-4e80-9e9f-482d5d620dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:35.643519 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3acff-9269-4e80-9e9f-482d5d620dd2 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:35.643803 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3acff-9269-4e80-9e9f-482d5d620dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:35.644078 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3acff-9269-4e80-9e9f-482d5d620dd2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:35.645324 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3acff-9269-4e80-9e9f-482d5d620dd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:35.646752 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3acff-9269-4e80-9e9f-482d5d620dd2 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:35.646994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-83961fc3-e514-4750-9af1-31c04a2ee319 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:35.646994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:35.646994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:35.646994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:35.646994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:35.646994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:35.646994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:35.646994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:35.646994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:35.646994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:35.646994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:35.646994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:35.646994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:12:35.646994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:12:35.646994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:12:35.648045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:12:35.648045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:35.648045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:35.648045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:35.648045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:35.648045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:35.648045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:35.648045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:35.648045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:35.648045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:35.648045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:35.648045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:35.648045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:35.648045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:35.648045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:35.648045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:35.648045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:35.649370 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:12:35.649370 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:12:35.649370 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:35.649370 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:35.649690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 515/1027] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:35.657516 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 513/1028] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:12:35.658392 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3acff-9269-4e80-9e9f-482d5d620dd2 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:35.658510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83961fc3-e514-4750-9af1-31c04a2ee319 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:35.779351 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83961fc3-e514-4750-9af1-31c04a2ee319 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:35.797385 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3acff-9269-4e80-9e9f-482d5d620dd2 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:35.835109 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060e5a2-99e7-4cbb-9300-07e4386a3d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:35.835796 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060e5a2-99e7-4cbb-9300-07e4386a3d81 None admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:35.836073 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060e5a2-99e7-4cbb-9300-07e4386a3d81 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:35.836388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060e5a2-99e7-4cbb-9300-07e4386a3d81 None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:35.837114 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060e5a2-99e7-4cbb-9300-07e4386a3d81 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:35.838630 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060e5a2-99e7-4cbb-9300-07e4386a3d81 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:35.851193 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267393e9-e229-475d-a98f-ee2b0d8d9a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:35.852081 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267393e9-e229-475d-a98f-ee2b0d8d9a3c None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:35.852403 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267393e9-e229-475d-a98f-ee2b0d8d9a3c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:35.852706 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267393e9-e229-475d-a98f-ee2b0d8d9a3c None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:35.853716 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267393e9-e229-475d-a98f-ee2b0d8d9a3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:35.854071 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267393e9-e229-475d-a98f-ee2b0d8d9a3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:35.855879 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267393e9-e229-475d-a98f-ee2b0d8d9a3c None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:35.871702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 516/1029] 10.222.0.71 () {60 vars in 1132 bytes} [Mon May 16 20:12:35 2022] POST /identity/v3/users => generated 285 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:12:35.876625 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 514/1030] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:35.879026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060e5a2-99e7-4cbb-9300-07e4386a3d81 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:36.009290 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060e5a2-99e7-4cbb-9300-07e4386a3d81 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:36.051230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b415a5-a9f4-41f0-ba03-5b08058a4255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:36.051965 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b415a5-a9f4-41f0-ba03-5b08058a4255 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:36.052292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b415a5-a9f4-41f0-ba03-5b08058a4255 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:36.052570 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b415a5-a9f4-41f0-ba03-5b08058a4255 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:36.062504 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b415a5-a9f4-41f0-ba03-5b08058a4255 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:36.064094 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b415a5-a9f4-41f0-ba03-5b08058a4255 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:36.079683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-f8b415a5-a9f4-41f0-ba03-5b08058a4255 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 20:12:36.079683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:36.079683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:36.079683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:36.079683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:36.079683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:36.079683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:36.079683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:36.079683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:36.079683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:36.079683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:36.079683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:36.079683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:12:36.079683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:12:36.079683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:12:36.079683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:12:36.080963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:36.080963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:36.080963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:12:36.080963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:36.080963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:12:36.080963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:36.080963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:36.080963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:36.080963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:36.080963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:36.080963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:36.080963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:36.080963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:36.080963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:36.080963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:36.080963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:36.080963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:36.080963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:36.087274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:36.087274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:36.087274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:12:36.087274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:12:36.087274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:12:36.087274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:12:36.087274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:12:36.087274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:12:36.087274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 20:12:36.087274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:36.087274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 517/1031] 10.222.0.71 () {56 vars in 1093 bytes} [Mon May 16 20:12:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:12:36.090430 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267393e9-e229-475d-a98f-ee2b0d8d9a3c None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:36.215659 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267393e9-e229-475d-a98f-ee2b0d8d9a3c None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:36.273779 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f7175-4a7b-4049-8fbb-caa0fb9d0401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:36.274921 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f7175-4a7b-4049-8fbb-caa0fb9d0401 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:36.275408 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f7175-4a7b-4049-8fbb-caa0fb9d0401 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:36.275896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f7175-4a7b-4049-8fbb-caa0fb9d0401 None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:36.277582 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f7175-4a7b-4049-8fbb-caa0fb9d0401 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:36.278008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f7175-4a7b-4049-8fbb-caa0fb9d0401 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:36.280767 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f7175-4a7b-4049-8fbb-caa0fb9d0401 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:36.313920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 515/1032] 10.222.0.71 () {56 vars in 1133 bytes} [Mon May 16 20:12:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:36.321445 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b415a5-a9f4-41f0-ba03-5b08058a4255 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:36.477272 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b415a5-a9f4-41f0-ba03-5b08058a4255 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:36.499588 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4fc1c-b222-43b7-8a3d-74776cf1ab15 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:36.500542 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4fc1c-b222-43b7-8a3d-74776cf1ab15 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:36.500846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4fc1c-b222-43b7-8a3d-74776cf1ab15 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:36.502400 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 516/1033] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:12:36.507424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b76e92-bf0b-4360-82d0-2f7699c946e8 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:36.507711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b76e92-bf0b-4360-82d0-2f7699c946e8 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:36.507964 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b76e92-bf0b-4360-82d0-2f7699c946e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:36.525119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-81b76e92-bf0b-4360-82d0-2f7699c946e8 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:36.526288 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-81b76e92-bf0b-4360-82d0-2f7699c946e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:36.532406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a0ef9-3465-42c6-8123-98d28e7d4209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:36.533305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a0ef9-3465-42c6-8123-98d28e7d4209 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:36.533655 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a0ef9-3465-42c6-8123-98d28e7d4209 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:36.533935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a0ef9-3465-42c6-8123-98d28e7d4209 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:36.618694 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a0ef9-3465-42c6-8123-98d28e7d4209 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:36.620183 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a0ef9-3465-42c6-8123-98d28e7d4209 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:36.632100 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 517/1034] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:12:36.655494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b76e92-bf0b-4360-82d0-2f7699c946e8 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:36.747712 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 518/1035] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:12:36 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:12:36.755147 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a0ef9-3465-42c6-8123-98d28e7d4209 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:36.784373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b76e92-bf0b-4360-82d0-2f7699c946e8 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:36.820362 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0d906-22b1-4783-aeef-6c7be36f30aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:36.821162 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0d906-22b1-4783-aeef-6c7be36f30aa None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:36.821440 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0d906-22b1-4783-aeef-6c7be36f30aa None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:36.821708 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0d906-22b1-4783-aeef-6c7be36f30aa None admin] PATH_INFO: `/v3/services/image` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:36.822364 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0d906-22b1-4783-aeef-6c7be36f30aa None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:36.823760 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0d906-22b1-4783-aeef-6c7be36f30aa None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:36.836815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-ced0d906-22b1-4783-aeef-6c7be36f30aa None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 20:12:36.836815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:36.836815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:12:36.836815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:12:36.836815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:12:36.836815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:12:36.836815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:12:36.836815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:36.836815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 20:12:36.836815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:36.836815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:12:36.836815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:36.836815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:36.836815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:36.836815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:36.836815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:36.836815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:36.838808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:36.838808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:36.838808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:36.838808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:36.838808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:36.838808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:36.838808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:12:36.838808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:12:36.838808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:12:36.838808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:12:36.838808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:36.838808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:36.838808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:36.838808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:36.838808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:36.838808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:36.840568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:36.840568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:36.840568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:36.840568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:36.840568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:36.840568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:36.840568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:36.840568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:36.840568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:36.840568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:36.840568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:12:36.840568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:36.840568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 20:12:36.840568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:36.840568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 518/1036] 10.222.0.71 () {56 vars in 1105 bytes} [Mon May 16 20:12:36 2022] GET /identity/v3/services/image => generated 86 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:12:36.846870 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0d906-22b1-4783-aeef-6c7be36f30aa None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:36.901719 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a0ef9-3465-42c6-8123-98d28e7d4209 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:36.941487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db97707-fce0-4c7e-bd15-706b542ad2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:36.942447 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db97707-fce0-4c7e-bd15-706b542ad2d9 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:36.942739 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db97707-fce0-4c7e-bd15-706b542ad2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:36.943016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db97707-fce0-4c7e-bd15-706b542ad2d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:36.957173 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db97707-fce0-4c7e-bd15-706b542ad2d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:36.959542 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db97707-fce0-4c7e-bd15-706b542ad2d9 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:36.966521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0d906-22b1-4783-aeef-6c7be36f30aa None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:36.978917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-8db97707-fce0-4c7e-bd15-706b542ad2d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:36.978917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:36.978917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:36.978917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:36.978917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:36.978917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:36.978917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:36.978917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:36.978917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:36.978917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:36.978917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:36.978917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:36.978917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:12:36.978917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:12:36.978917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:12:36.979958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:12:36.979958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:36.979958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:36.979958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:36.979958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:36.979958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:36.979958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:36.979958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:36.979958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:36.979958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:36.979958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:36.979958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:36.979958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:36.979958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:36.979958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:36.979958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:36.979958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:36.986402 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:12:36.986402 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:12:36.986402 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:36.986402 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:36.986402 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 519/1037] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:36.986402 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db97707-fce0-4c7e-bd15-706b542ad2d9 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:37.007528 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94503706-db6f-43a1-9ccf-4a5ae7dac1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:37.008674 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94503706-db6f-43a1-9ccf-4a5ae7dac1c1 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:37.009098 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94503706-db6f-43a1-9ccf-4a5ae7dac1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:37.009568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94503706-db6f-43a1-9ccf-4a5ae7dac1c1 None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:37.010474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94503706-db6f-43a1-9ccf-4a5ae7dac1c1 None admin] RBAC: Adding query filter params (name=image) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:37.010920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94503706-db6f-43a1-9ccf-4a5ae7dac1c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:37.012555 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94503706-db6f-43a1-9ccf-4a5ae7dac1c1 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:37.018874 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 519/1038] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:37.024167 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94503706-db6f-43a1-9ccf-4a5ae7dac1c1 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:37.093222 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db97707-fce0-4c7e-bd15-706b542ad2d9 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:37.129880 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb568a-401f-41c2-854f-d531a5c1cf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:37.130917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb568a-401f-41c2-854f-d531a5c1cf8f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:37.131378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb568a-401f-41c2-854f-d531a5c1cf8f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:37.131848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb568a-401f-41c2-854f-d531a5c1cf8f None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:37.132805 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb568a-401f-41c2-854f-d531a5c1cf8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:37.132970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94503706-db6f-43a1-9ccf-4a5ae7dac1c1 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:37.133820 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb568a-401f-41c2-854f-d531a5c1cf8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:37.135514 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb568a-401f-41c2-854f-d531a5c1cf8f None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:37.149334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 520/1039] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:37.157991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb568a-401f-41c2-854f-d531a5c1cf8f None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:37.176651 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2b081-8696-46a6-aee5-e3235bd308a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:37.177341 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2b081-8696-46a6-aee5-e3235bd308a2 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:37.177619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2b081-8696-46a6-aee5-e3235bd308a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:37.177892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2b081-8696-46a6-aee5-e3235bd308a2 None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:37.178626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd2b081-8696-46a6-aee5-e3235bd308a2 None admin] RBAC: Adding query filter params (type=image) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:37.178929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd2b081-8696-46a6-aee5-e3235bd308a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:37.180399 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd2b081-8696-46a6-aee5-e3235bd308a2 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:37.185987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 520/1040] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:37.192327 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2b081-8696-46a6-aee5-e3235bd308a2 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:37.274090 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb568a-401f-41c2-854f-d531a5c1cf8f None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:37.304891 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2b081-8696-46a6-aee5-e3235bd308a2 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:37.308652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469aef54-9e7f-49ef-b7fa-59d5621e440a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:37.309451 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aef54-9e7f-49ef-b7fa-59d5621e440a None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:37.309732 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aef54-9e7f-49ef-b7fa-59d5621e440a None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:37.310002 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aef54-9e7f-49ef-b7fa-59d5621e440a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:37.317051 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469aef54-9e7f-49ef-b7fa-59d5621e440a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:37.318531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469aef54-9e7f-49ef-b7fa-59d5621e440a None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:37.333486 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-469aef54-9e7f-49ef-b7fa-59d5621e440a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:37.333486 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:37.333486 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:37.333486 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:37.333486 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:37.333486 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:37.333486 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:37.333486 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:37.333486 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:37.333486 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:37.333486 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:37.333486 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:37.333486 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:12:37.333486 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:12:37.333486 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:12:37.334610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:12:37.334610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:37.334610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:37.334610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:37.334610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:37.334610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:37.334610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:37.334610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:37.334610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:37.334610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:37.334610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:37.334610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:37.334610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:37.334610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:37.334610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:37.334610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:37.334610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:37.335647 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:12:37.335647 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:12:37.335647 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:12:37.335647 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:12:37.335647 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:12:37.335647 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:12:37.335647 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:37.335647 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:37.335647 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 521/1041] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:12:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:12:37.340510 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469aef54-9e7f-49ef-b7fa-59d5621e440a None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:37.341171 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed2f4b-d8cf-4cce-887a-c2669e2c58f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:37.342017 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed2f4b-d8cf-4cce-887a-c2669e2c58f3 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:37.342438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed2f4b-d8cf-4cce-887a-c2669e2c58f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:37.342851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed2f4b-d8cf-4cce-887a-c2669e2c58f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:37.344346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed2f4b-d8cf-4cce-887a-c2669e2c58f3 None admin] RBAC: Adding query filter params (interface=public, service_id=ad7f881c57224f1082e59750b5e2a277, region_id=RegionOne) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:37.344865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed2f4b-d8cf-4cce-887a-c2669e2c58f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:37.346201 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed2f4b-d8cf-4cce-887a-c2669e2c58f3 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:37.356006 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 521/1042] 10.222.0.71 () {56 vars in 1251 bytes} [Mon May 16 20:12:37 2022] GET /identity/v3/endpoints?service_id=ad7f881c57224f1082e59750b5e2a277&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:37.356885 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed2f4b-d8cf-4cce-887a-c2669e2c58f3 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:37.442270 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469aef54-9e7f-49ef-b7fa-59d5621e440a None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:37.462753 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed2f4b-d8cf-4cce-887a-c2669e2c58f3 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:37.478213 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6bdcf-8c53-483d-99c2-eff6ee199092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:37.478873 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6bdcf-8c53-483d-99c2-eff6ee199092 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:37.479157 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6bdcf-8c53-483d-99c2-eff6ee199092 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:37.479438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6bdcf-8c53-483d-99c2-eff6ee199092 None admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:37.480238 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6bdcf-8c53-483d-99c2-eff6ee199092 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:37.480548 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6bdcf-8c53-483d-99c2-eff6ee199092 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:37.481947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6bdcf-8c53-483d-99c2-eff6ee199092 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:37.493304 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 522/1043] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:12:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:37.496587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d5069-65ef-404d-b902-60c518115658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:37.497251 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d5069-65ef-404d-b902-60c518115658 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:37.497531 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d5069-65ef-404d-b902-60c518115658 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:37.497805 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d5069-65ef-404d-b902-60c518115658 None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:37.498484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d5069-65ef-404d-b902-60c518115658 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:37.499281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6bdcf-8c53-483d-99c2-eff6ee199092 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:37.501049 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d5069-65ef-404d-b902-60c518115658 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:37.512192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 522/1044] 10.222.0.71 () {56 vars in 1087 bytes} [Mon May 16 20:12:37 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:12:37.626813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6bdcf-8c53-483d-99c2-eff6ee199092 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:37.694072 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8a07a-28d3-4ce0-ad6a-d651df995ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:37.695102 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8a07a-28d3-4ce0-ad6a-d651df995ae1 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:37.695510 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8a07a-28d3-4ce0-ad6a-d651df995ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:37.696016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8a07a-28d3-4ce0-ad6a-d651df995ae1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:37.698083 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8a07a-28d3-4ce0-ad6a-d651df995ae1 None admin] RBAC: Adding query filter params (role.id=9c0b1dff381a4a6dbf48ad23f7e56280, scope.project.id=121ed31a143d49b3a16ac6c5c6b28955, user.id=242d4f9634a74013af05f50981280864) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:37.698665 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8a07a-28d3-4ce0-ad6a-d651df995ae1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:37.701962 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8a07a-28d3-4ce0-ad6a-d651df995ae1 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:37.714268 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 523/1045] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:12:37 2022] GET /identity/v3/role_assignments?user.id=242d4f9634a74013af05f50981280864&scope.project.id=121ed31a143d49b3a16ac6c5c6b28955&role.id=9c0b1dff381a4a6dbf48ad23f7e56280 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:38.382151 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbfe4c-d7d5-440f-ae0c-872d2bd54c0a None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:38.382678 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbfe4c-d7d5-440f-ae0c-872d2bd54c0a None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:38.382678 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbfe4c-d7d5-440f-ae0c-872d2bd54c0a None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:38.384266 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 523/1046] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:38.389745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f41183-f4d6-416f-a16f-5ba7094095ce None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:38.390175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f41183-f4d6-416f-a16f-5ba7094095ce None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:38.391009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f41183-f4d6-416f-a16f-5ba7094095ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:38.408198 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-d9f41183-f4d6-416f-a16f-5ba7094095ce None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:38.409386 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-d9f41183-f4d6-416f-a16f-5ba7094095ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:38.487190 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 524/1047] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:38.511057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbfe4c-d7d5-440f-ae0c-872d2bd54c0a None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:38.674760 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbfe4c-d7d5-440f-ae0c-872d2bd54c0a None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:38.734425 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f18ab3-701a-4c73-b1da-f183bc4214e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:38.735774 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f18ab3-701a-4c73-b1da-f183bc4214e7 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:38.736323 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f18ab3-701a-4c73-b1da-f183bc4214e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:38.736826 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f18ab3-701a-4c73-b1da-f183bc4214e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:38.754248 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f18ab3-701a-4c73-b1da-f183bc4214e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:12:38.766858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-61f18ab3-701a-4c73-b1da-f183bc4214e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:12:38.766858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:38.766858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:38.766858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:38.766858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:38.766858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:38.766858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:38.766858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:38.766858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:38.766858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:38.766858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:38.766858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:38.766858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:12:38.766858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:12:38.766858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:12:38.766858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:12:38.767988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:12:38.767988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:12:38.767988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:12:38.767988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:12:38.767988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:38.767988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:38.767988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:38.767988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:38.767988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:38.767988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:38.767988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:38.767988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:38.767988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:38.767988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:38.767988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:38.767988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:38.777906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:38.777906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:38.777906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:38.777906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:38.777906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:12:38.777906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:12:38.777906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:12:38.777906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:12:38.777906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:12:38.777906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:12:38.777906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:12:38.777906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:38.777906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 524/1048] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:12:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:12:38.778613 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f41183-f4d6-416f-a16f-5ba7094095ce None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:38.901916 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f41183-f4d6-416f-a16f-5ba7094095ce None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:38.938441 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5c75e-e879-41c3-8e57-63ef2d2e2d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:38.939279 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5c75e-e879-41c3-8e57-63ef2d2e2d71 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:38.939563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5c75e-e879-41c3-8e57-63ef2d2e2d71 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:38.939844 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5c75e-e879-41c3-8e57-63ef2d2e2d71 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:38.940636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5c75e-e879-41c3-8e57-63ef2d2e2d71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:38.940949 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5c75e-e879-41c3-8e57-63ef2d2e2d71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:38.942376 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5c75e-e879-41c3-8e57-63ef2d2e2d71 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:38.957808 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 525/1049] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:12:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:38.959043 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f18ab3-701a-4c73-b1da-f183bc4214e7 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:39.068970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f18ab3-701a-4c73-b1da-f183bc4214e7 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:39.105672 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be0e82-1c2e-41af-9e34-7da07148476e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:39.106526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be0e82-1c2e-41af-9e34-7da07148476e None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:39.106800 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be0e82-1c2e-41af-9e34-7da07148476e None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:39.107070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be0e82-1c2e-41af-9e34-7da07148476e None admin] PATH_INFO: `/v3/users/bf3d1667b72641139e5607523b76027c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:39.121972 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be0e82-1c2e-41af-9e34-7da07148476e None admin] RBAC: Authorizing `identity:get_user(user_id=bf3d1667b72641139e5607523b76027c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:39.123415 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be0e82-1c2e-41af-9e34-7da07148476e None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:39.130254 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 525/1050] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:12:38 2022] GET /identity/v3/users/bf3d1667b72641139e5607523b76027c => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:39.131505 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5c75e-e879-41c3-8e57-63ef2d2e2d71 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:39.244569 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5c75e-e879-41c3-8e57-63ef2d2e2d71 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:39.279193 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223acdc-b8cf-4649-9150-74065d76e42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:39.279847 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223acdc-b8cf-4649-9150-74065d76e42e None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:39.280122 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223acdc-b8cf-4649-9150-74065d76e42e None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:39.280422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223acdc-b8cf-4649-9150-74065d76e42e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:39.354467 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223acdc-b8cf-4649-9150-74065d76e42e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:39.360941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223acdc-b8cf-4649-9150-74065d76e42e None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:39.462280 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 526/1051] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:12:39 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:12:39.467970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be0e82-1c2e-41af-9e34-7da07148476e None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:39.580353 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be0e82-1c2e-41af-9e34-7da07148476e None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:39.617421 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b4dfb-530b-4bce-90a6-08abf478e135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:39.618177 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b4dfb-530b-4bce-90a6-08abf478e135 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:39.618450 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b4dfb-530b-4bce-90a6-08abf478e135 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:39.618720 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b4dfb-530b-4bce-90a6-08abf478e135 None admin] PATH_INFO: `/v3/projects/7028f072b565430895db6b468244e66c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:39.619940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b4dfb-530b-4bce-90a6-08abf478e135 None admin] RBAC: Authorizing `identity:get_project(project_id=7028f072b565430895db6b468244e66c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:39.621412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b4dfb-530b-4bce-90a6-08abf478e135 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:39.628502 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 526/1052] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:12:39 2022] GET /identity/v3/projects/7028f072b565430895db6b468244e66c => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:39.629808 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223acdc-b8cf-4649-9150-74065d76e42e None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:39.767763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223acdc-b8cf-4649-9150-74065d76e42e None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:39.805740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efcb9a-e55d-46c6-bd08-25d9d7ce7e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:39.806388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efcb9a-e55d-46c6-bd08-25d9d7ce7e81 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:39.806666 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efcb9a-e55d-46c6-bd08-25d9d7ce7e81 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:39.806937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efcb9a-e55d-46c6-bd08-25d9d7ce7e81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:39.807748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efcb9a-e55d-46c6-bd08-25d9d7ce7e81 None admin] RBAC: Adding query filter params (role.id=6576d9225a0946de877f527e3d15db05, scope.project.id=7028f072b565430895db6b468244e66c, user.id=bf3d1667b72641139e5607523b76027c) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:39.808058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efcb9a-e55d-46c6-bd08-25d9d7ce7e81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:39.809521 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efcb9a-e55d-46c6-bd08-25d9d7ce7e81 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:39.821079 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 527/1053] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:12:39 2022] GET /identity/v3/role_assignments?user.id=bf3d1667b72641139e5607523b76027c&scope.project.id=7028f072b565430895db6b468244e66c&role.id=6576d9225a0946de877f527e3d15db05 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:39.941955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882fc00-e19f-438d-a8f0-a62206f0c4ed None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:39.942150 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882fc00-e19f-438d-a8f0-a62206f0c4ed None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:39.942423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882fc00-e19f-438d-a8f0-a62206f0c4ed None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:39.943916 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 527/1054] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:12:39.949565 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44f4b6-b71b-4187-b041-2da670c19b60 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:39.949866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44f4b6-b71b-4187-b041-2da670c19b60 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:39.950122 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44f4b6-b71b-4187-b041-2da670c19b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:39.967696 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-6c44f4b6-b71b-4187-b041-2da670c19b60 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:39.969497 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-6c44f4b6-b71b-4187-b041-2da670c19b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:40.055244 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 528/1055] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:40.071937 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cf5a2-b87e-41d2-9b53-befedde8380e None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:40.072295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cf5a2-b87e-41d2-9b53-befedde8380e None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:40.072527 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cf5a2-b87e-41d2-9b53-befedde8380e None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:40.074058 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 528/1056] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:40.079768 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cf5a2-b87e-41d2-9b53-befedde8380e None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:40.080296 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc8027-4f43-4515-80dd-b211db2b6f1f None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:40.080701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc8027-4f43-4515-80dd-b211db2b6f1f None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:40.081116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc8027-4f43-4515-80dd-b211db2b6f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:40.106183 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-5dbc8027-4f43-4515-80dd-b211db2b6f1f None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:40.108054 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-5dbc8027-4f43-4515-80dd-b211db2b6f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:40.212510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cf5a2-b87e-41d2-9b53-befedde8380e None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:40.216080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 529/1057] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:40.239341 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc8027-4f43-4515-80dd-b211db2b6f1f None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:40.252640 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81e43e-b5c0-4db5-88ed-a90d27c68d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:40.253425 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81e43e-b5c0-4db5-88ed-a90d27c68d51 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:40.253703 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81e43e-b5c0-4db5-88ed-a90d27c68d51 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:40.253972 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81e43e-b5c0-4db5-88ed-a90d27c68d51 None admin] PATH_INFO: `/v3/services/image` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:40.254624 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81e43e-b5c0-4db5-88ed-a90d27c68d51 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:40.256004 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81e43e-b5c0-4db5-88ed-a90d27c68d51 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:40.268827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-ce81e43e-b5c0-4db5-88ed-a90d27c68d51 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 20:12:40.268827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:40.268827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:12:40.268827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:12:40.268827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:12:40.268827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:12:40.268827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:12:40.268827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:40.268827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 20:12:40.268827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:40.268827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:12:40.268827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:40.268827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:40.268827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:40.268827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:40.268827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:40.268827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:40.270066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:40.270066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:40.270066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:40.270066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:40.270066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:40.270066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:40.270066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:12:40.270066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:12:40.270066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:12:40.270066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:12:40.270066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:40.270066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:40.270066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:40.270066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:40.270066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:40.270066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:40.270911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:40.270911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:40.270911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:40.270911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:40.270911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:40.270911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:40.270911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:40.270911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:40.270911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:40.270911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:40.270911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:12:40.270911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:12:40.270911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 20:12:40.270911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:40.270911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 529/1058] 10.222.0.71 () {56 vars in 1105 bytes} [Mon May 16 20:12:40 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:40.276439 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81e43e-b5c0-4db5-88ed-a90d27c68d51 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:40.345972 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc8027-4f43-4515-80dd-b211db2b6f1f None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:40.387182 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9a957-a78b-40ae-8a65-e6cedd04a48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:40.387996 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9a957-a78b-40ae-8a65-e6cedd04a48e None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:40.388318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9a957-a78b-40ae-8a65-e6cedd04a48e None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:40.388594 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9a957-a78b-40ae-8a65-e6cedd04a48e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:40.394203 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81e43e-b5c0-4db5-88ed-a90d27c68d51 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:40.401051 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9a957-a78b-40ae-8a65-e6cedd04a48e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:12:40.409952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-34b9a957-a78b-40ae-8a65-e6cedd04a48e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 20:12:40.409952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:40.409952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:40.409952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:40.409952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:40.409952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:40.409952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:40.409952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:40.409952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:40.409952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:40.409952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:40.409952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:40.409952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:12:40.409952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:12:40.409952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:12:40.409952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:12:40.410935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:12:40.410935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:12:40.410935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:12:40.410935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:12:40.410935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:40.410935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:40.410935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:40.410935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:40.410935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:40.410935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:40.410935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:40.410935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:40.410935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:40.410935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:40.410935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:40.410935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:40.411774 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:40.411774 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:40.411774 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:40.411774 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:40.411774 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:12:40.411774 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:12:40.411774 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:12:40.411774 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:12:40.411774 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:12:40.411774 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:12:40.411774 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 20:12:40.411774 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:40.411774 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 530/1059] 10.222.0.71 () {56 vars in 1120 bytes} [Mon May 16 20:12:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:12:40.418265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9a957-a78b-40ae-8a65-e6cedd04a48e None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:40.440800 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fdfc5-5695-4323-9bef-8b95d682840f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:40.441535 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fdfc5-5695-4323-9bef-8b95d682840f None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:40.441816 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fdfc5-5695-4323-9bef-8b95d682840f None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:40.442139 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fdfc5-5695-4323-9bef-8b95d682840f None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:40.442859 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182fdfc5-5695-4323-9bef-8b95d682840f None admin] RBAC: Adding query filter params (name=image) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:40.443164 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182fdfc5-5695-4323-9bef-8b95d682840f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:40.444624 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182fdfc5-5695-4323-9bef-8b95d682840f None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:40.454838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 530/1060] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:40.455995 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fdfc5-5695-4323-9bef-8b95d682840f None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:40.524492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9a957-a78b-40ae-8a65-e6cedd04a48e None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:40.560017 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fdfc5-5695-4323-9bef-8b95d682840f None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:40.560686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de53c5f-0672-4a4c-ad64-e7d44123a1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:40.561205 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de53c5f-0672-4a4c-ad64-e7d44123a1b9 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:40.561541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de53c5f-0672-4a4c-ad64-e7d44123a1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:40.561826 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de53c5f-0672-4a4c-ad64-e7d44123a1b9 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:40.562967 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de53c5f-0672-4a4c-ad64-e7d44123a1b9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:40.563274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de53c5f-0672-4a4c-ad64-e7d44123a1b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:40.564693 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de53c5f-0672-4a4c-ad64-e7d44123a1b9 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:40.574208 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 531/1061] 10.222.0.71 () {56 vars in 1115 bytes} [Mon May 16 20:12:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:40.580009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de53c5f-0672-4a4c-ad64-e7d44123a1b9 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:40.602319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6ed18-49e0-47ec-86b0-7e618992365f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:40.603021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6ed18-49e0-47ec-86b0-7e618992365f None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:40.603301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6ed18-49e0-47ec-86b0-7e618992365f None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:40.603581 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6ed18-49e0-47ec-86b0-7e618992365f None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:40.604325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6ed18-49e0-47ec-86b0-7e618992365f None admin] RBAC: Adding query filter params (type=image) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:40.604628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6ed18-49e0-47ec-86b0-7e618992365f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:40.606007 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6ed18-49e0-47ec-86b0-7e618992365f None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:40.612837 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 531/1062] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:40.618673 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6ed18-49e0-47ec-86b0-7e618992365f None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:40.690155 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de53c5f-0672-4a4c-ad64-e7d44123a1b9 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:40.725554 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe3064-4790-45b6-b917-c213d5d9ce32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:40.726347 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe3064-4790-45b6-b917-c213d5d9ce32 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:40.726632 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe3064-4790-45b6-b917-c213d5d9ce32 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:40.726911 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe3064-4790-45b6-b917-c213d5d9ce32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:40.730652 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6ed18-49e0-47ec-86b0-7e618992365f None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:40.738737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe3064-4790-45b6-b917-c213d5d9ce32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:40.740232 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe3064-4790-45b6-b917-c213d5d9ce32 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:40.757981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-8bbe3064-4790-45b6-b917-c213d5d9ce32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:40.757981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:40.757981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:40.757981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:40.757981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:40.757981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:40.757981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:40.757981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:40.757981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:40.757981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:40.757981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:40.757981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:40.757981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:12:40.757981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:12:40.757981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:12:40.758989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:12:40.758989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:40.758989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:40.758989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:40.758989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:40.758989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:40.758989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:40.758989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:40.758989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:40.758989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:40.758989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:40.758989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:40.758989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:40.758989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:40.758989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:40.758989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:40.758989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:40.765657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:12:40.765657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:12:40.765657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:40.765657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:40.765657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 532/1063] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:12:40.766404 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe3064-4790-45b6-b917-c213d5d9ce32 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:40.766737 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d8c99-80e8-4f91-b99b-f8435be5874a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:40.767394 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d8c99-80e8-4f91-b99b-f8435be5874a None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:40.767674 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d8c99-80e8-4f91-b99b-f8435be5874a None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:40.768005 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d8c99-80e8-4f91-b99b-f8435be5874a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:40.768786 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d8c99-80e8-4f91-b99b-f8435be5874a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:40.770224 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d8c99-80e8-4f91-b99b-f8435be5874a None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:40.790913 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 532/1064] 10.222.0.71 () {60 vars in 1144 bytes} [Mon May 16 20:12:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:12:40.894264 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe3064-4790-45b6-b917-c213d5d9ce32 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:40.945537 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1eadff-d458-40cf-b4ba-49b915738a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:40.946337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1eadff-d458-40cf-b4ba-49b915738a15 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:40.946801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1eadff-d458-40cf-b4ba-49b915738a15 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:40.947097 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1eadff-d458-40cf-b4ba-49b915738a15 None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:40.947994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1eadff-d458-40cf-b4ba-49b915738a15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:40.948333 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1eadff-d458-40cf-b4ba-49b915738a15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:40.949769 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1eadff-d458-40cf-b4ba-49b915738a15 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:40.964068 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 533/1065] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:40.970704 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d8c99-80e8-4f91-b99b-f8435be5874a None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:41.085818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d8c99-80e8-4f91-b99b-f8435be5874a None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:41.123480 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed370851-577c-497b-9fe2-57190f141bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:41.131741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed370851-577c-497b-9fe2-57190f141bfb None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:41.132426 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed370851-577c-497b-9fe2-57190f141bfb None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:41.132952 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed370851-577c-497b-9fe2-57190f141bfb None admin] PATH_INFO: `/v3/users/nova` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:41.143618 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed370851-577c-497b-9fe2-57190f141bfb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:41.145434 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed370851-577c-497b-9fe2-57190f141bfb None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:41.162061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-ed370851-577c-497b-9fe2-57190f141bfb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 20:12:41.162061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:41.162061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:41.162061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:41.162061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:41.162061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:41.162061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:41.162061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:41.162061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:41.162061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:41.162061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:41.162061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:41.162061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:12:41.162061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:12:41.162061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:12:41.162061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:12:41.163070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:41.163070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:41.163070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:12:41.163070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:41.163070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:12:41.163070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:41.163070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:41.163070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:41.163070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:41.163070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:41.163070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:41.163070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:41.163070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:41.163070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:41.163070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:41.163070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:41.163070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:41.163070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:41.164020 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:41.164020 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:41.164020 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:12:41.164020 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:12:41.164020 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:12:41.164020 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:12:41.164020 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:12:41.164020 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:12:41.164020 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 20:12:41.164020 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:41.165923 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 533/1066] 10.222.0.71 () {56 vars in 1093 bytes} [Mon May 16 20:12:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:41.174034 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1eadff-d458-40cf-b4ba-49b915738a15 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:41.299979 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1eadff-d458-40cf-b4ba-49b915738a15 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:41.336746 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd1dea-fa8c-482b-b828-2c398783d4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:41.337331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd1dea-fa8c-482b-b828-2c398783d4ba None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:41.337605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd1dea-fa8c-482b-b828-2c398783d4ba None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:41.337877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd1dea-fa8c-482b-b828-2c398783d4ba None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:41.338698 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd1dea-fa8c-482b-b828-2c398783d4ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:41.339002 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd1dea-fa8c-482b-b828-2c398783d4ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:41.340429 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd1dea-fa8c-482b-b828-2c398783d4ba None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:41.359260 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 534/1067] 10.222.0.71 () {56 vars in 1133 bytes} [Mon May 16 20:12:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:41.364879 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed370851-577c-497b-9fe2-57190f141bfb None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:41.473186 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed370851-577c-497b-9fe2-57190f141bfb None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:41.511375 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27a6be-6e53-4e4e-bb66-2642747a5aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:41.512222 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27a6be-6e53-4e4e-bb66-2642747a5aa9 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:41.512600 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27a6be-6e53-4e4e-bb66-2642747a5aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:41.512879 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27a6be-6e53-4e4e-bb66-2642747a5aa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:41.525434 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27a6be-6e53-4e4e-bb66-2642747a5aa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:41.526911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27a6be-6e53-4e4e-bb66-2642747a5aa9 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:41.544721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-0a27a6be-6e53-4e4e-bb66-2642747a5aa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:41.544721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:41.544721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:41.544721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:41.544721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:41.544721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:41.544721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:41.544721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:41.544721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:41.544721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:41.544721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:41.544721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:41.544721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:12:41.544721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:12:41.544721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:12:41.545712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:12:41.545712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:41.545712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:41.545712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:41.545712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:41.545712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:41.545712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:41.545712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:41.545712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:41.545712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:41.545712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:41.545712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:41.545712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:41.545712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:41.545712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:41.545712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:41.545712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:41.547163 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:12:41.547163 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:12:41.547163 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:41.547163 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:41.551364 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 534/1068] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:41.552819 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd1dea-fa8c-482b-b828-2c398783d4ba None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:41.658132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd1dea-fa8c-482b-b828-2c398783d4ba None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:41.694219 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faeebc1-cc43-44a9-9d73-5cc08ade3e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:41.695264 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faeebc1-cc43-44a9-9d73-5cc08ade3e1b None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:41.695754 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faeebc1-cc43-44a9-9d73-5cc08ade3e1b None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:41.696266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faeebc1-cc43-44a9-9d73-5cc08ade3e1b None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:41.697236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faeebc1-cc43-44a9-9d73-5cc08ade3e1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:41.697747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faeebc1-cc43-44a9-9d73-5cc08ade3e1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:41.699411 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faeebc1-cc43-44a9-9d73-5cc08ade3e1b None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:41.712643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 535/1069] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:41.719400 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27a6be-6e53-4e4e-bb66-2642747a5aa9 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:41.831360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27a6be-6e53-4e4e-bb66-2642747a5aa9 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:41.868931 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f9a0f-0684-4e09-af1e-3ec426b4c006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:41.869718 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f9a0f-0684-4e09-af1e-3ec426b4c006 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:41.869990 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f9a0f-0684-4e09-af1e-3ec426b4c006 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:41.870262 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f9a0f-0684-4e09-af1e-3ec426b4c006 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:41.878630 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f9a0f-0684-4e09-af1e-3ec426b4c006 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:41.880094 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f9a0f-0684-4e09-af1e-3ec426b4c006 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:41.895705 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-4e1f9a0f-0684-4e09-af1e-3ec426b4c006 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:41.895705 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:41.895705 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:41.895705 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:41.895705 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:41.895705 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:41.895705 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:41.895705 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:41.895705 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:41.895705 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:41.895705 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:41.895705 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:41.895705 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:12:41.895705 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:12:41.895705 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:12:41.896882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:12:41.896882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:41.896882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:41.896882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:41.896882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:41.896882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:41.896882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:41.896882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:41.896882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:41.896882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:41.896882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:41.896882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:41.896882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:41.896882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:41.896882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:41.896882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:41.896882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:41.898027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:12:41.898027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:12:41.898027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:12:41.898027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:12:41.898027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:12:41.898027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:12:41.898027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:41.898027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:41.900553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 535/1070] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:12:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:41.903346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faeebc1-cc43-44a9-9d73-5cc08ade3e1b None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:42.025023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faeebc1-cc43-44a9-9d73-5cc08ade3e1b None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:42.061762 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29f4f2-a98b-4f64-a102-449114ee082f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:42.063219 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29f4f2-a98b-4f64-a102-449114ee082f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:42.063504 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29f4f2-a98b-4f64-a102-449114ee082f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:42.063775 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29f4f2-a98b-4f64-a102-449114ee082f None admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:42.064607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29f4f2-a98b-4f64-a102-449114ee082f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:42.064919 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29f4f2-a98b-4f64-a102-449114ee082f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:42.066339 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29f4f2-a98b-4f64-a102-449114ee082f None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:42.084878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 536/1071] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:12:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:42.086501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f9a0f-0684-4e09-af1e-3ec426b4c006 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:42.186471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa47ef-da8e-4b48-9be9-b577eb50a97b None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:42.186774 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa47ef-da8e-4b48-9be9-b577eb50a97b None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:42.187698 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa47ef-da8e-4b48-9be9-b577eb50a97b None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:42.189317 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 537/1072] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:12:42.194734 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17982248-b6fa-41ff-8708-fc31d750a06b None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:42.195133 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17982248-b6fa-41ff-8708-fc31d750a06b None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:42.195414 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17982248-b6fa-41ff-8708-fc31d750a06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:42.205074 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f9a0f-0684-4e09-af1e-3ec426b4c006 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:42.219328 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-17982248-b6fa-41ff-8708-fc31d750a06b None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:42.220577 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-17982248-b6fa-41ff-8708-fc31d750a06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:42.243086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610054d4-fc55-4fc3-a454-8f7f30d0bfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:42.243964 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610054d4-fc55-4fc3-a454-8f7f30d0bfb4 None admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:42.244266 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610054d4-fc55-4fc3-a454-8f7f30d0bfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:42.244535 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610054d4-fc55-4fc3-a454-8f7f30d0bfb4 None admin] PATH_INFO: `/v3/projects/121ed31a143d49b3a16ac6c5c6b28955/users/242d4f9634a74013af05f50981280864/roles/9c0b1dff381a4a6dbf48ad23f7e56280` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:42.246751 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610054d4-fc55-4fc3-a454-8f7f30d0bfb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=121ed31a143d49b3a16ac6c5c6b28955, user_id=242d4f9634a74013af05f50981280864, role_id=9c0b1dff381a4a6dbf48ad23f7e56280)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:42.248222 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610054d4-fc55-4fc3-a454-8f7f30d0bfb4 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:42.264036 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 536/1073] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:12:42 2022] PUT /identity/v3/projects/121ed31a143d49b3a16ac6c5c6b28955/users/242d4f9634a74013af05f50981280864/roles/9c0b1dff381a4a6dbf48ad23f7e56280 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:12:42.308314 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 538/1074] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:12:42.332265 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610054d4-fc55-4fc3-a454-8f7f30d0bfb4 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:42.447387 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610054d4-fc55-4fc3-a454-8f7f30d0bfb4 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:42.483351 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba9677-8932-4ea9-89a6-85f7ffc9c3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:42.484859 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba9677-8932-4ea9-89a6-85f7ffc9c3aa None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:42.485137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba9677-8932-4ea9-89a6-85f7ffc9c3aa None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:42.485405 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba9677-8932-4ea9-89a6-85f7ffc9c3aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:42.496720 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba9677-8932-4ea9-89a6-85f7ffc9c3aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:12:42.505553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-55ba9677-8932-4ea9-89a6-85f7ffc9c3aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:12:42.505553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:42.505553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:42.505553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:42.505553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:42.505553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:42.505553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:42.505553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:42.505553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:42.505553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:42.505553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:42.505553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:42.505553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:12:42.505553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:12:42.505553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:12:42.505553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:12:42.506884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:12:42.506884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:12:42.506884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:12:42.506884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:12:42.506884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:42.506884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:42.506884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:42.506884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:42.506884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:42.506884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:42.506884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:42.506884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:42.506884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:42.506884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:42.506884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:42.506884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:42.507936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:42.507936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:42.507936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:42.507936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:42.507936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:12:42.507936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:12:42.507936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:12:42.507936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:12:42.507936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:12:42.507936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:12:42.507936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:12:42.507936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:42.507936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 537/1075] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:12:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:42.517469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17982248-b6fa-41ff-8708-fc31d750a06b None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:42.638600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17982248-b6fa-41ff-8708-fc31d750a06b None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:42.682619 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479abc63-c43e-484a-98fa-8d9afad3d679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:42.683306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479abc63-c43e-484a-98fa-8d9afad3d679 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:42.683581 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479abc63-c43e-484a-98fa-8d9afad3d679 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:42.683852 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479abc63-c43e-484a-98fa-8d9afad3d679 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:42.684640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479abc63-c43e-484a-98fa-8d9afad3d679 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:42.684942 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479abc63-c43e-484a-98fa-8d9afad3d679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:42.686307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479abc63-c43e-484a-98fa-8d9afad3d679 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:42.701131 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 539/1076] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:12:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:42.706054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba9677-8932-4ea9-89a6-85f7ffc9c3aa None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:42.819515 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba9677-8932-4ea9-89a6-85f7ffc9c3aa None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:42.855940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27763486-6a75-4ebd-bba3-3934808b61a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:42.856849 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27763486-6a75-4ebd-bba3-3934808b61a5 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:42.857131 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27763486-6a75-4ebd-bba3-3934808b61a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:42.857396 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27763486-6a75-4ebd-bba3-3934808b61a5 None admin] PATH_INFO: `/v3/users/bf3d1667b72641139e5607523b76027c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:42.858639 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27763486-6a75-4ebd-bba3-3934808b61a5 None admin] RBAC: Authorizing `identity:get_user(user_id=bf3d1667b72641139e5607523b76027c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:42.860769 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27763486-6a75-4ebd-bba3-3934808b61a5 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:42.868190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 538/1077] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:12:42 2022] GET /identity/v3/users/bf3d1667b72641139e5607523b76027c => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:42.871240 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479abc63-c43e-484a-98fa-8d9afad3d679 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:42.979415 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479abc63-c43e-484a-98fa-8d9afad3d679 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:43.042357 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d6dab-23a4-4f63-92d4-d44ae42cded6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:43.043685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d6dab-23a4-4f63-92d4-d44ae42cded6 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:43.044101 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d6dab-23a4-4f63-92d4-d44ae42cded6 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:43.044543 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d6dab-23a4-4f63-92d4-d44ae42cded6 None admin] PATH_INFO: `/v3/projects/7028f072b565430895db6b468244e66c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:43.046527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d6dab-23a4-4f63-92d4-d44ae42cded6 None admin] RBAC: Authorizing `identity:get_project(project_id=7028f072b565430895db6b468244e66c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:43.048977 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d6dab-23a4-4f63-92d4-d44ae42cded6 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:43.057917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 540/1078] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:12:42 2022] GET /identity/v3/projects/7028f072b565430895db6b468244e66c => generated 311 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:43.059385 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27763486-6a75-4ebd-bba3-3934808b61a5 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:43.186751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0182d4d-664c-41f1-b7a1-1256ba2675d1 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:43.187444 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0182d4d-664c-41f1-b7a1-1256ba2675d1 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:43.187829 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0182d4d-664c-41f1-b7a1-1256ba2675d1 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:43.190622 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 541/1079] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:43.196813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ae1eb-cc65-4eb0-a65e-f7aee678c48f None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:43.197363 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ae1eb-cc65-4eb0-a65e-f7aee678c48f None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:43.197812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ae1eb-cc65-4eb0-a65e-f7aee678c48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:43.215603 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-c44ae1eb-cc65-4eb0-a65e-f7aee678c48f None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:43.216896 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-c44ae1eb-cc65-4eb0-a65e-f7aee678c48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:43.235190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27763486-6a75-4ebd-bba3-3934808b61a5 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:43.282339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a859f5-e04f-4a2f-b7b7-84c90b0515e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:43.283118 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a859f5-e04f-4a2f-b7b7-84c90b0515e6 None admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:43.283411 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a859f5-e04f-4a2f-b7b7-84c90b0515e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:43.283656 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a859f5-e04f-4a2f-b7b7-84c90b0515e6 None admin] PATH_INFO: `/v3/projects/7028f072b565430895db6b468244e66c/users/bf3d1667b72641139e5607523b76027c/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:43.285722 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a859f5-e04f-4a2f-b7b7-84c90b0515e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7028f072b565430895db6b468244e66c, user_id=bf3d1667b72641139e5607523b76027c, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:43.287176 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a859f5-e04f-4a2f-b7b7-84c90b0515e6 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:43.306032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 539/1080] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:12:43 2022] PUT /identity/v3/projects/7028f072b565430895db6b468244e66c/users/bf3d1667b72641139e5607523b76027c/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:12:43.318161 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 542/1081] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:12:43.341634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a859f5-e04f-4a2f-b7b7-84c90b0515e6 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:43.470847 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a859f5-e04f-4a2f-b7b7-84c90b0515e6 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:43.507776 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1691a-cb93-41ed-99e3-d342986d685f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:43.508119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1691a-cb93-41ed-99e3-d342986d685f None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:43.509037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1691a-cb93-41ed-99e3-d342986d685f None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:43.509037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1691a-cb93-41ed-99e3-d342986d685f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:43.603064 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1691a-cb93-41ed-99e3-d342986d685f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:43.604550 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1691a-cb93-41ed-99e3-d342986d685f None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:43.731631 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 540/1082] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:12:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:12:43.732980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ae1eb-cc65-4eb0-a65e-f7aee678c48f None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:43.845025 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ae1eb-cc65-4eb0-a65e-f7aee678c48f None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:43.882515 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c3b5f-74ae-409b-9cea-3d010b59f73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:43.883318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c3b5f-74ae-409b-9cea-3d010b59f73a None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:43.883598 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c3b5f-74ae-409b-9cea-3d010b59f73a None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:43.883872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c3b5f-74ae-409b-9cea-3d010b59f73a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:43.895358 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c3b5f-74ae-409b-9cea-3d010b59f73a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:43.896849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c3b5f-74ae-409b-9cea-3d010b59f73a None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:43.916580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-4e4c3b5f-74ae-409b-9cea-3d010b59f73a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:43.916580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:43.916580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:43.916580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:43.916580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:43.916580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:43.916580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:43.916580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:43.916580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:43.916580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:43.916580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:43.916580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:43.916580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:12:43.916580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:12:43.916580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:12:43.917563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:12:43.917563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:43.917563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:43.917563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:43.917563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:43.917563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:43.917563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:43.917563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:43.917563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:43.917563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:43.917563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:43.917563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:43.917563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:43.917563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:43.917563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:43.917563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:43.917563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:43.924328 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:12:43.924328 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:12:43.924328 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:43.924328 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:43.924328 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 543/1083] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:43.924912 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1691a-cb93-41ed-99e3-d342986d685f None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:44.050043 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1691a-cb93-41ed-99e3-d342986d685f None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:44.084826 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3337b1-52c7-4792-bd10-158b6d56f6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:44.085498 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3337b1-52c7-4792-bd10-158b6d56f6f3 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:44.085778 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3337b1-52c7-4792-bd10-158b6d56f6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:44.086053 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3337b1-52c7-4792-bd10-158b6d56f6f3 None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:44.086781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3337b1-52c7-4792-bd10-158b6d56f6f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:44.087086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3337b1-52c7-4792-bd10-158b6d56f6f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:44.088495 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3337b1-52c7-4792-bd10-158b6d56f6f3 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:44.101391 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 541/1084] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:44.599362 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae77e3-f37a-48a6-a273-7b3d506930a6 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:44.599646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae77e3-f37a-48a6-a273-7b3d506930a6 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:44.599926 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae77e3-f37a-48a6-a273-7b3d506930a6 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:44.601364 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 544/1085] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:44.608360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90e27b-63fc-42c1-b7ae-0c165e16acc8 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:44.609388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90e27b-63fc-42c1-b7ae-0c165e16acc8 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:44.609880 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90e27b-63fc-42c1-b7ae-0c165e16acc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:44.637644 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-2a90e27b-63fc-42c1-b7ae-0c165e16acc8 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:44.640000 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-2a90e27b-63fc-42c1-b7ae-0c165e16acc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:44.715175 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 542/1086] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:44.739159 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae77e3-f37a-48a6-a273-7b3d506930a6 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:44.837901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae77e3-f37a-48a6-a273-7b3d506930a6 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:44.871034 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ea6a1-c98a-4469-bf0f-8ca4d1aeb2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:44.871759 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ea6a1-c98a-4469-bf0f-8ca4d1aeb2f0 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:44.872037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ea6a1-c98a-4469-bf0f-8ca4d1aeb2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:44.872341 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ea6a1-c98a-4469-bf0f-8ca4d1aeb2f0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:44.882096 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ea6a1-c98a-4469-bf0f-8ca4d1aeb2f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:12:44.890500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-819ea6a1-c98a-4469-bf0f-8ca4d1aeb2f0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 20:12:44.890500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:44.890500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:44.890500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:44.890500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:44.890500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:44.890500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:44.890500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:44.890500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:44.890500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:44.890500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:44.890500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:44.890500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:12:44.890500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:12:44.890500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:12:44.890500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:12:44.891459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:12:44.891459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:12:44.891459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:12:44.891459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:12:44.891459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:44.891459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:44.891459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:44.891459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:44.891459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:44.891459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:44.891459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:44.891459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:44.891459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:44.891459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:44.891459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:44.891459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:44.892337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:44.892337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:44.892337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:44.892337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:44.892337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:12:44.892337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:12:44.892337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:12:44.892337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:12:44.892337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:12:44.892337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:12:44.892337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 20:12:44.892337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:44.892337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 545/1087] 10.222.0.71 () {56 vars in 1120 bytes} [Mon May 16 20:12:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:44.897781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90e27b-63fc-42c1-b7ae-0c165e16acc8 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:44.999560 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90e27b-63fc-42c1-b7ae-0c165e16acc8 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:45.033571 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef86bb-5240-4612-9b84-3269a892e930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:45.034233 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef86bb-5240-4612-9b84-3269a892e930 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:45.034508 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef86bb-5240-4612-9b84-3269a892e930 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:45.034778 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef86bb-5240-4612-9b84-3269a892e930 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:45.035525 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef86bb-5240-4612-9b84-3269a892e930 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:45.035824 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef86bb-5240-4612-9b84-3269a892e930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:45.037266 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef86bb-5240-4612-9b84-3269a892e930 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:45.045449 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 543/1088] 10.222.0.71 () {56 vars in 1115 bytes} [Mon May 16 20:12:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:45.052573 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ea6a1-c98a-4469-bf0f-8ca4d1aeb2f0 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:45.173112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ea6a1-c98a-4469-bf0f-8ca4d1aeb2f0 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:45.208273 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed448bb4-a65d-4b79-836e-bb2f37cef1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:45.209073 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed448bb4-a65d-4b79-836e-bb2f37cef1a5 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:45.209351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed448bb4-a65d-4b79-836e-bb2f37cef1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:45.209624 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed448bb4-a65d-4b79-836e-bb2f37cef1a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:45.221258 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed448bb4-a65d-4b79-836e-bb2f37cef1a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:45.222715 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed448bb4-a65d-4b79-836e-bb2f37cef1a5 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:45.240394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-ed448bb4-a65d-4b79-836e-bb2f37cef1a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:45.240394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:45.240394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:45.240394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:45.240394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:45.240394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:45.240394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:45.240394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:45.240394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:45.240394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:45.240394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:45.240394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:45.240394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:12:45.240394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:12:45.240394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:12:45.241319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:12:45.241319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:45.241319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:45.241319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:45.241319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:45.241319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:45.241319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:45.241319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:45.241319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:45.241319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:45.241319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:45.241319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:45.241319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:45.241319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:45.241319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:45.241319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:45.241319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:45.242259 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:12:45.242259 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:12:45.242259 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:45.242259 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:45.242259 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 546/1089] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:45.247255 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef86bb-5240-4612-9b84-3269a892e930 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:45.345232 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef86bb-5240-4612-9b84-3269a892e930 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:45.378119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ed67b-de1a-4cbc-9f92-217894758722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:45.378775 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ed67b-de1a-4cbc-9f92-217894758722 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:45.379056 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ed67b-de1a-4cbc-9f92-217894758722 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:45.379329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ed67b-de1a-4cbc-9f92-217894758722 None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:45.380048 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ed67b-de1a-4cbc-9f92-217894758722 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:45.380378 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ed67b-de1a-4cbc-9f92-217894758722 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:45.381756 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ed67b-de1a-4cbc-9f92-217894758722 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:45.394574 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 544/1090] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:45.400129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed448bb4-a65d-4b79-836e-bb2f37cef1a5 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:45.500885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed448bb4-a65d-4b79-836e-bb2f37cef1a5 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:45.535286 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486661b-de1e-414b-a7bd-b6bfcde6740e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:45.536078 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486661b-de1e-414b-a7bd-b6bfcde6740e None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:45.536388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486661b-de1e-414b-a7bd-b6bfcde6740e None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:45.536664 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486661b-de1e-414b-a7bd-b6bfcde6740e None admin] PATH_INFO: `/v3/users/nova` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:45.544569 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486661b-de1e-414b-a7bd-b6bfcde6740e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:45.546022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486661b-de1e-414b-a7bd-b6bfcde6740e None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:45.559843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-f486661b-de1e-414b-a7bd-b6bfcde6740e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 20:12:45.559843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:45.559843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:45.559843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:45.559843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:45.559843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:45.559843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:45.559843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:45.559843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:45.559843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:45.559843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:45.559843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:45.559843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:12:45.559843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:12:45.559843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:12:45.559843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:12:45.560858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:45.560858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:45.560858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:12:45.560858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:45.560858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:12:45.560858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:12:45.560858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:45.560858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:45.560858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:45.560858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:45.560858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:45.560858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:45.560858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:45.560858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:45.560858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:45.560858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:45.560858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:45.560858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:45.561841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:45.561841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:45.561841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:12:45.561841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:12:45.561841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:12:45.561841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:12:45.561841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:12:45.561841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:12:45.561841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 20:12:45.561841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:45.561841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 547/1091] 10.222.0.71 () {56 vars in 1093 bytes} [Mon May 16 20:12:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:12:45.566950 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ed67b-de1a-4cbc-9f92-217894758722 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:45.637948 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84993c-fb73-4d8d-8068-65a369b2e76a None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:45.638232 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84993c-fb73-4d8d-8068-65a369b2e76a None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:45.638515 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84993c-fb73-4d8d-8068-65a369b2e76a None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:45.640717 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 548/1092] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:12:45.646197 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459489a8-e291-4ef6-b4f5-13d47efa532c None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:45.646561 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459489a8-e291-4ef6-b4f5-13d47efa532c None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:45.646844 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459489a8-e291-4ef6-b4f5-13d47efa532c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:45.665101 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-459489a8-e291-4ef6-b4f5-13d47efa532c None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:45.666288 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-459489a8-e291-4ef6-b4f5-13d47efa532c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:45.692654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ed67b-de1a-4cbc-9f92-217894758722 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:45.735840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 549/1093] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:12:45.753080 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232bd35-79d6-47a4-99ad-5b225d5fa3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:45.754161 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232bd35-79d6-47a4-99ad-5b225d5fa3ce None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:45.754650 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232bd35-79d6-47a4-99ad-5b225d5fa3ce None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:45.755143 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232bd35-79d6-47a4-99ad-5b225d5fa3ce None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:45.756830 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232bd35-79d6-47a4-99ad-5b225d5fa3ce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:45.757330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232bd35-79d6-47a4-99ad-5b225d5fa3ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:45.760055 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232bd35-79d6-47a4-99ad-5b225d5fa3ce None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:45.764986 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459489a8-e291-4ef6-b4f5-13d47efa532c None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:45.793956 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 545/1094] 10.222.0.71 () {56 vars in 1133 bytes} [Mon May 16 20:12:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:45.799643 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232bd35-79d6-47a4-99ad-5b225d5fa3ce None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:45.901475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459489a8-e291-4ef6-b4f5-13d47efa532c None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:45.911531 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232bd35-79d6-47a4-99ad-5b225d5fa3ce None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:45.939866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c346a5e-5615-4b9c-8b29-678846c2a637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:45.940708 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c346a5e-5615-4b9c-8b29-678846c2a637 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:45.940990 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c346a5e-5615-4b9c-8b29-678846c2a637 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:45.941261 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c346a5e-5615-4b9c-8b29-678846c2a637 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:45.948230 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65b1f3-06a3-4764-ae70-cb8c8d2df6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:45.948880 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65b1f3-06a3-4764-ae70-cb8c8d2df6b9 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:45.949150 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65b1f3-06a3-4764-ae70-cb8c8d2df6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:45.949418 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65b1f3-06a3-4764-ae70-cb8c8d2df6b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:45.952905 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c346a5e-5615-4b9c-8b29-678846c2a637 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:12:45.960944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-8c346a5e-5615-4b9c-8b29-678846c2a637 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:12:45.960944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:45.960944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:45.960944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:45.960944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:45.960944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:45.960944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:45.960944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:45.960944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:45.960944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:45.960944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:45.960944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:45.960944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:12:45.960944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:12:45.960944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:12:45.960944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:12:45.962320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:12:45.962320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:12:45.962320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:12:45.962320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:12:45.962320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:45.962320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:45.962320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:45.962320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:45.962320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:45.962320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:45.962320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:45.962320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:12:45.962320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:45.962320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:45.962320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:45.962320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:45.963883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:45.963883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:45.963883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:45.963883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:45.963883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:12:45.963883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:12:45.963883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:12:45.963883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:12:45.963883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:12:45.963883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:12:45.963883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:12:45.963883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:12:45.963883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 550/1095] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:12:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:12:45.969388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c346a5e-5615-4b9c-8b29-678846c2a637 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:46.018859 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65b1f3-06a3-4764-ae70-cb8c8d2df6b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:46.020275 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65b1f3-06a3-4764-ae70-cb8c8d2df6b9 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:46.067748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c346a5e-5615-4b9c-8b29-678846c2a637 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:46.101572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353cd35-e204-47d0-86ff-9f7a838c7923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:46.102241 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353cd35-e204-47d0-86ff-9f7a838c7923 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:46.102530 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353cd35-e204-47d0-86ff-9f7a838c7923 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:46.102805 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353cd35-e204-47d0-86ff-9f7a838c7923 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:46.103554 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353cd35-e204-47d0-86ff-9f7a838c7923 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:46.103857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353cd35-e204-47d0-86ff-9f7a838c7923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:46.105236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353cd35-e204-47d0-86ff-9f7a838c7923 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:46.113572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 551/1096] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:12:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:46.115344 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 546/1097] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:12:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 20:12:46.119195 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353cd35-e204-47d0-86ff-9f7a838c7923 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:46.120776 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65b1f3-06a3-4764-ae70-cb8c8d2df6b9 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:46.216053 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353cd35-e204-47d0-86ff-9f7a838c7923 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:46.221541 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65b1f3-06a3-4764-ae70-cb8c8d2df6b9 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:46.249471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36ad82-f946-4b6a-a1e4-ee63da70b84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:46.250664 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36ad82-f946-4b6a-a1e4-ee63da70b84d None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:46.250945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36ad82-f946-4b6a-a1e4-ee63da70b84d None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:46.251219 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36ad82-f946-4b6a-a1e4-ee63da70b84d None admin] PATH_INFO: `/v3/users/bf3d1667b72641139e5607523b76027c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:46.252428 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36ad82-f946-4b6a-a1e4-ee63da70b84d None admin] RBAC: Authorizing `identity:get_user(user_id=bf3d1667b72641139e5607523b76027c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:46.253756 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791297f-d850-47bc-a73c-fffe526a8a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:46.253872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36ad82-f946-4b6a-a1e4-ee63da70b84d None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:46.254533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791297f-d850-47bc-a73c-fffe526a8a66 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:46.254807 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791297f-d850-47bc-a73c-fffe526a8a66 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:46.255075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791297f-d850-47bc-a73c-fffe526a8a66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:46.255533 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 552/1098] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:12:46 2022] GET /identity/v3/users/bf3d1667b72641139e5607523b76027c => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:46.261164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36ad82-f946-4b6a-a1e4-ee63da70b84d None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:46.270542 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791297f-d850-47bc-a73c-fffe526a8a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:46.271916 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791297f-d850-47bc-a73c-fffe526a8a66 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:46.289634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-e791297f-d850-47bc-a73c-fffe526a8a66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:46.289634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:46.289634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:46.289634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:46.289634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:46.289634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:46.289634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:46.289634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:46.289634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:46.289634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:46.289634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:46.289634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:46.289634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:12:46.289634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:12:46.289634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:12:46.290738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:12:46.290738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:46.290738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:46.290738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:46.290738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:46.290738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:46.290738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:46.290738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:46.290738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:46.290738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:46.290738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:46.290738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:46.290738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:46.290738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:46.290738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:46.290738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:46.290738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:46.291663 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:12:46.291663 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:12:46.291663 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:12:46.291663 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:46.291663 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 547/1099] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:12:46.296444 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791297f-d850-47bc-a73c-fffe526a8a66 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:46.357870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36ad82-f946-4b6a-a1e4-ee63da70b84d None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:46.395102 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e877c-d7b0-4c0a-97ec-6dea0b95acc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:46.395772 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e877c-d7b0-4c0a-97ec-6dea0b95acc9 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:46.396225 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e877c-d7b0-4c0a-97ec-6dea0b95acc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:46.396403 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e877c-d7b0-4c0a-97ec-6dea0b95acc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:46.401497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791297f-d850-47bc-a73c-fffe526a8a66 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:46.438523 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22e84e-4acb-42a4-9fba-7f91b7b8d5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:46.439280 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22e84e-4acb-42a4-9fba-7f91b7b8d5c8 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:46.439555 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22e84e-4acb-42a4-9fba-7f91b7b8d5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:46.439821 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22e84e-4acb-42a4-9fba-7f91b7b8d5c8 None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:46.440570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22e84e-4acb-42a4-9fba-7f91b7b8d5c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:46.440866 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22e84e-4acb-42a4-9fba-7f91b7b8d5c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:46.442248 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22e84e-4acb-42a4-9fba-7f91b7b8d5c8 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:46.454808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 548/1100] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:46.460480 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22e84e-4acb-42a4-9fba-7f91b7b8d5c8 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:46.469393 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e877c-d7b0-4c0a-97ec-6dea0b95acc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:46.470935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e877c-d7b0-4c0a-97ec-6dea0b95acc9 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:46.571267 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22e84e-4acb-42a4-9fba-7f91b7b8d5c8 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:46.578278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 553/1101] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:12:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 20:12:46.584320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e877c-d7b0-4c0a-97ec-6dea0b95acc9 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:46.610938 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0484e3c-436d-47cb-b682-caa35051651a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:46.611734 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0484e3c-436d-47cb-b682-caa35051651a None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:46.612006 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0484e3c-436d-47cb-b682-caa35051651a None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:46.612307 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0484e3c-436d-47cb-b682-caa35051651a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:46.628613 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0484e3c-436d-47cb-b682-caa35051651a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:46.630085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0484e3c-436d-47cb-b682-caa35051651a None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:46.645736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-a0484e3c-436d-47cb-b682-caa35051651a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:46.645736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:12:46.645736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:12:46.645736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:12:46.645736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:12:46.645736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:12:46.645736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:12:46.645736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:12:46.645736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:12:46.645736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:12:46.645736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:12:46.645736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:12:46.645736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:12:46.645736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:12:46.645736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:12:46.646989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:12:46.646989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:12:46.646989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:12:46.646989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:12:46.646989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:12:46.646989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:12:46.646989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:12:46.646989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:12:46.646989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:12:46.646989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:12:46.646989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:12:46.646989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:12:46.646989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:12:46.646989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:12:46.646989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:12:46.646989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:12:46.646989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:12:46.647900 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:12:46.647900 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:12:46.647900 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:12:46.647900 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:12:46.647900 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:12:46.647900 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:12:46.647900 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:12:46.647900 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:12:46.647900 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 549/1102] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:12:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:12:46.652961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0484e3c-436d-47cb-b682-caa35051651a None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:46.693338 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e877c-d7b0-4c0a-97ec-6dea0b95acc9 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:46.726344 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07383843-56c6-47c3-aa12-6c9d3c950d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:46.727202 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07383843-56c6-47c3-aa12-6c9d3c950d0a None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:46.727485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07383843-56c6-47c3-aa12-6c9d3c950d0a None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:46.727760 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07383843-56c6-47c3-aa12-6c9d3c950d0a None admin] PATH_INFO: `/v3/projects/7028f072b565430895db6b468244e66c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:46.728979 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07383843-56c6-47c3-aa12-6c9d3c950d0a None admin] RBAC: Authorizing `identity:get_project(project_id=7028f072b565430895db6b468244e66c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:46.730418 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07383843-56c6-47c3-aa12-6c9d3c950d0a None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:46.732136 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 554/1103] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:12:46 2022] GET /identity/v3/projects/7028f072b565430895db6b468244e66c => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:46.738779 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07383843-56c6-47c3-aa12-6c9d3c950d0a None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:46.748951 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0484e3c-436d-47cb-b682-caa35051651a None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:46.788816 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab427faf-a0a6-4676-804a-968b03f51680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:46.789922 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab427faf-a0a6-4676-804a-968b03f51680 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:46.790415 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab427faf-a0a6-4676-804a-968b03f51680 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:46.790896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab427faf-a0a6-4676-804a-968b03f51680 None admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:46.792432 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab427faf-a0a6-4676-804a-968b03f51680 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:46.792995 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab427faf-a0a6-4676-804a-968b03f51680 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:46.795585 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab427faf-a0a6-4676-804a-968b03f51680 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:46.818157 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 550/1104] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:12:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:46.827668 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab427faf-a0a6-4676-804a-968b03f51680 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:46.842101 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07383843-56c6-47c3-aa12-6c9d3c950d0a None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:46.887627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550ed00-fa6f-45c9-8676-32f0a128fd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:46.888322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550ed00-fa6f-45c9-8676-32f0a128fd8f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:46.888605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550ed00-fa6f-45c9-8676-32f0a128fd8f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:46.888885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550ed00-fa6f-45c9-8676-32f0a128fd8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:46.890009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550ed00-fa6f-45c9-8676-32f0a128fd8f None admin] RBAC: Adding query filter params (role.id=6576d9225a0946de877f527e3d15db05, scope.project.id=7028f072b565430895db6b468244e66c, user.id=bf3d1667b72641139e5607523b76027c) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:46.890437 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550ed00-fa6f-45c9-8676-32f0a128fd8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:46.892172 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550ed00-fa6f-45c9-8676-32f0a128fd8f None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:46.898581 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 555/1105] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:12:46 2022] GET /identity/v3/role_assignments?user.id=bf3d1667b72641139e5607523b76027c&scope.project.id=7028f072b565430895db6b468244e66c&role.id=6576d9225a0946de877f527e3d15db05 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:46.954661 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab427faf-a0a6-4676-804a-968b03f51680 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:47.001777 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4ce91-316e-4a56-90da-6b1163f9a6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:47.002447 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4ce91-316e-4a56-90da-6b1163f9a6c1 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:47.002722 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4ce91-316e-4a56-90da-6b1163f9a6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:47.002992 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4ce91-316e-4a56-90da-6b1163f9a6c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:47.003837 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4ce91-316e-4a56-90da-6b1163f9a6c1 None admin] RBAC: Adding query filter params (role.id=9c0b1dff381a4a6dbf48ad23f7e56280, scope.project.id=121ed31a143d49b3a16ac6c5c6b28955, user.id=242d4f9634a74013af05f50981280864) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:47.004143 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4ce91-316e-4a56-90da-6b1163f9a6c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:47.005645 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4ce91-316e-4a56-90da-6b1163f9a6c1 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:47.021249 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 551/1106] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:12:46 2022] GET /identity/v3/role_assignments?user.id=242d4f9634a74013af05f50981280864&scope.project.id=121ed31a143d49b3a16ac6c5c6b28955&role.id=9c0b1dff381a4a6dbf48ad23f7e56280 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:49.224629 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59af03-c8a1-45a1-b930-39f5012e5b76 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:49.225210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59af03-c8a1-45a1-b930-39f5012e5b76 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:49.225210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59af03-c8a1-45a1-b930-39f5012e5b76 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:49.226522 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 556/1107] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:49.231820 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54bae2-2767-402c-962c-51d59f5cab19 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:49.232292 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54bae2-2767-402c-962c-51d59f5cab19 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:49.232389 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54bae2-2767-402c-962c-51d59f5cab19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:49.251002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-ad54bae2-2767-402c-962c-51d59f5cab19 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:49.252612 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-ad54bae2-2767-402c-962c-51d59f5cab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:49.324093 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 552/1108] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:49.349500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59af03-c8a1-45a1-b930-39f5012e5b76 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:49.456007 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59af03-c8a1-45a1-b930-39f5012e5b76 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:49.488513 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b030172-f281-4184-9863-3654bde6065b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:49.489217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b030172-f281-4184-9863-3654bde6065b None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:49.489497 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b030172-f281-4184-9863-3654bde6065b None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:49.489767 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b030172-f281-4184-9863-3654bde6065b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:49.490924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b030172-f281-4184-9863-3654bde6065b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:49.492379 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b030172-f281-4184-9863-3654bde6065b None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:49.493984 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 557/1109] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:12:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:12:49.499789 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54bae2-2767-402c-962c-51d59f5cab19 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:49.612949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54bae2-2767-402c-962c-51d59f5cab19 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:49.647388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2742a-c9d0-472f-bdb4-b7a5f4a42bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:49.648059 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2742a-c9d0-472f-bdb4-b7a5f4a42bd3 None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:49.648439 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2742a-c9d0-472f-bdb4-b7a5f4a42bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:49.648716 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2742a-c9d0-472f-bdb4-b7a5f4a42bd3 None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:49.649416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2742a-c9d0-472f-bdb4-b7a5f4a42bd3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:49.650854 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2742a-c9d0-472f-bdb4-b7a5f4a42bd3 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:49.673440 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 553/1110] 10.222.0.71 () {60 vars in 1132 bytes} [Mon May 16 20:12:49 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:12:52.075032 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e2079-34ef-49a0-9530-2ef7cd14fdc5 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:52.075720 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e2079-34ef-49a0-9530-2ef7cd14fdc5 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:52.075943 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e2079-34ef-49a0-9530-2ef7cd14fdc5 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:52.079060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 558/1111] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:52.087335 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9eaebf-7363-4a18-9882-9fc05057882d None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:52.088094 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9eaebf-7363-4a18-9882-9fc05057882d None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:52.088094 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9eaebf-7363-4a18-9882-9fc05057882d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:52.111695 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-9b9eaebf-7363-4a18-9882-9fc05057882d None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:52.113596 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-9b9eaebf-7363-4a18-9882-9fc05057882d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:52.216219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 554/1112] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:52.260843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e2079-34ef-49a0-9530-2ef7cd14fdc5 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:52.410818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e2079-34ef-49a0-9530-2ef7cd14fdc5 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:52.445281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33da89-75e2-4745-b69d-8f7eeb1b2268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:52.446121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33da89-75e2-4745-b69d-8f7eeb1b2268 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:52.446398 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33da89-75e2-4745-b69d-8f7eeb1b2268 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:52.446666 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33da89-75e2-4745-b69d-8f7eeb1b2268 None admin] PATH_INFO: `/v3/roles/140f30ce618745eea43e96b91df3bbab` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:52.448104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33da89-75e2-4745-b69d-8f7eeb1b2268 None admin] RBAC: Authorizing `identity:get_role(role_id=140f30ce618745eea43e96b91df3bbab)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:52.449488 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33da89-75e2-4745-b69d-8f7eeb1b2268 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:52.450864 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 559/1113] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:12:52 2022] GET /identity/v3/roles/140f30ce618745eea43e96b91df3bbab => generated 223 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:52.457574 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9eaebf-7363-4a18-9882-9fc05057882d None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:52.554826 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9eaebf-7363-4a18-9882-9fc05057882d None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:52.593439 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41fb54-b75a-41fe-8ebb-f714bbd265cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:52.594291 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41fb54-b75a-41fe-8ebb-f714bbd265cb None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:52.594565 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41fb54-b75a-41fe-8ebb-f714bbd265cb None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:52.594831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41fb54-b75a-41fe-8ebb-f714bbd265cb None admin] PATH_INFO: `/v3/users/a205b23bdd1a4e4cbf889c5bcf53e423` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:52.607629 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41fb54-b75a-41fe-8ebb-f714bbd265cb None admin] RBAC: Authorizing `identity:get_user(user_id=a205b23bdd1a4e4cbf889c5bcf53e423)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:52.609194 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41fb54-b75a-41fe-8ebb-f714bbd265cb None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:52.610888 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 555/1114] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:12:52 2022] GET /identity/v3/users/a205b23bdd1a4e4cbf889c5bcf53e423 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:52.616950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33da89-75e2-4745-b69d-8f7eeb1b2268 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:52.716265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33da89-75e2-4745-b69d-8f7eeb1b2268 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:52.750994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a1c48-54ee-46a6-8780-4caeab1e5a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:52.752214 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a1c48-54ee-46a6-8780-4caeab1e5a9b None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:52.752214 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a1c48-54ee-46a6-8780-4caeab1e5a9b None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:52.752400 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a1c48-54ee-46a6-8780-4caeab1e5a9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:52.822048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a1c48-54ee-46a6-8780-4caeab1e5a9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:52.823525 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a1c48-54ee-46a6-8780-4caeab1e5a9b None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:52.924678 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 560/1115] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:12:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:12:52.930821 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41fb54-b75a-41fe-8ebb-f714bbd265cb None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:53.036332 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41fb54-b75a-41fe-8ebb-f714bbd265cb None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:53.070831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846d83c-df46-47bb-a574-234f0d477f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:53.071685 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846d83c-df46-47bb-a574-234f0d477f10 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:53.071984 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846d83c-df46-47bb-a574-234f0d477f10 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:53.072326 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846d83c-df46-47bb-a574-234f0d477f10 None admin] PATH_INFO: `/v3/projects/7028f072b565430895db6b468244e66c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:53.073675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846d83c-df46-47bb-a574-234f0d477f10 None admin] RBAC: Authorizing `identity:get_project(project_id=7028f072b565430895db6b468244e66c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:53.075136 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846d83c-df46-47bb-a574-234f0d477f10 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:53.076981 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 556/1116] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:12:52 2022] GET /identity/v3/projects/7028f072b565430895db6b468244e66c => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:53.084299 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a1c48-54ee-46a6-8780-4caeab1e5a9b None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:53.189647 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a1c48-54ee-46a6-8780-4caeab1e5a9b None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:53.224104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd924e-7647-461f-8e83-31ec91c45406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:53.224782 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd924e-7647-461f-8e83-31ec91c45406 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:53.225065 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd924e-7647-461f-8e83-31ec91c45406 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:53.225340 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd924e-7647-461f-8e83-31ec91c45406 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:53.226192 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd924e-7647-461f-8e83-31ec91c45406 None admin] RBAC: Adding query filter params (role.id=140f30ce618745eea43e96b91df3bbab, scope.project.id=7028f072b565430895db6b468244e66c, user.id=a205b23bdd1a4e4cbf889c5bcf53e423) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:53.226503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd924e-7647-461f-8e83-31ec91c45406 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:53.227973 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd924e-7647-461f-8e83-31ec91c45406 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:53.233703 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 561/1117] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:12:53 2022] GET /identity/v3/role_assignments?user.id=a205b23bdd1a4e4cbf889c5bcf53e423&scope.project.id=7028f072b565430895db6b468244e66c&role.id=140f30ce618745eea43e96b91df3bbab => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:55.499330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3752a-0313-4b56-a74f-383461a8a823 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:55.499859 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3752a-0313-4b56-a74f-383461a8a823 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:55.499859 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3752a-0313-4b56-a74f-383461a8a823 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:55.501873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 557/1118] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:55.508406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd744b9d-1043-4c61-83d9-112640bb5231 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:55.508988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd744b9d-1043-4c61-83d9-112640bb5231 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:55.508988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd744b9d-1043-4c61-83d9-112640bb5231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:55.526169 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-bd744b9d-1043-4c61-83d9-112640bb5231 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:55.527376 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-bd744b9d-1043-4c61-83d9-112640bb5231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:55.595567 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 562/1119] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:55.619765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3752a-0313-4b56-a74f-383461a8a823 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:55.746431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3752a-0313-4b56-a74f-383461a8a823 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:55.787218 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415be9a-3d81-4581-9d00-d18a7e0981c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:55.787970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415be9a-3d81-4581-9d00-d18a7e0981c0 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:55.788274 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415be9a-3d81-4581-9d00-d18a7e0981c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:55.788543 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415be9a-3d81-4581-9d00-d18a7e0981c0 None admin] PATH_INFO: `/v3/roles/140f30ce618745eea43e96b91df3bbab` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:55.790013 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415be9a-3d81-4581-9d00-d18a7e0981c0 None admin] RBAC: Authorizing `identity:get_role(role_id=140f30ce618745eea43e96b91df3bbab)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:55.791384 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415be9a-3d81-4581-9d00-d18a7e0981c0 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:55.792802 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 558/1120] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:12:55 2022] GET /identity/v3/roles/140f30ce618745eea43e96b91df3bbab => generated 223 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:55.798854 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd744b9d-1043-4c61-83d9-112640bb5231 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:55.917089 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd744b9d-1043-4c61-83d9-112640bb5231 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:55.950530 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763170ea-3560-45c4-b95c-9604ac8771eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:55.951394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763170ea-3560-45c4-b95c-9604ac8771eb None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:55.951674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763170ea-3560-45c4-b95c-9604ac8771eb None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:55.951949 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763170ea-3560-45c4-b95c-9604ac8771eb None admin] PATH_INFO: `/v3/users/a205b23bdd1a4e4cbf889c5bcf53e423` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:55.953740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763170ea-3560-45c4-b95c-9604ac8771eb None admin] RBAC: Authorizing `identity:get_user(user_id=a205b23bdd1a4e4cbf889c5bcf53e423)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:55.955182 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763170ea-3560-45c4-b95c-9604ac8771eb None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:55.956905 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 563/1121] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:12:55 2022] GET /identity/v3/users/a205b23bdd1a4e4cbf889c5bcf53e423 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:55.966920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415be9a-3d81-4581-9d00-d18a7e0981c0 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:56.096086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415be9a-3d81-4581-9d00-d18a7e0981c0 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:56.133158 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d4860-4e5c-4518-9a34-43d3083f6a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:56.134016 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d4860-4e5c-4518-9a34-43d3083f6a55 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:56.134294 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d4860-4e5c-4518-9a34-43d3083f6a55 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:56.134564 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d4860-4e5c-4518-9a34-43d3083f6a55 None admin] PATH_INFO: `/v3/projects/7028f072b565430895db6b468244e66c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:56.135952 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d4860-4e5c-4518-9a34-43d3083f6a55 None admin] RBAC: Authorizing `identity:get_project(project_id=7028f072b565430895db6b468244e66c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:56.137482 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d4860-4e5c-4518-9a34-43d3083f6a55 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:56.139283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 559/1122] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:12:55 2022] GET /identity/v3/projects/7028f072b565430895db6b468244e66c => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:56.146841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763170ea-3560-45c4-b95c-9604ac8771eb None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:56.282410 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763170ea-3560-45c4-b95c-9604ac8771eb None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:56.337189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7d08d-171d-4332-b001-2c75554272b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:56.338738 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7d08d-171d-4332-b001-2c75554272b6 None admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:56.339250 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7d08d-171d-4332-b001-2c75554272b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:56.339742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7d08d-171d-4332-b001-2c75554272b6 None admin] PATH_INFO: `/v3/projects/7028f072b565430895db6b468244e66c/users/a205b23bdd1a4e4cbf889c5bcf53e423/roles/140f30ce618745eea43e96b91df3bbab` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:56.343726 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7d08d-171d-4332-b001-2c75554272b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7028f072b565430895db6b468244e66c, user_id=a205b23bdd1a4e4cbf889c5bcf53e423, role_id=140f30ce618745eea43e96b91df3bbab)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:56.346564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7d08d-171d-4332-b001-2c75554272b6 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:56.369220 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 564/1123] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:12:56 2022] PUT /identity/v3/projects/7028f072b565430895db6b468244e66c/users/a205b23bdd1a4e4cbf889c5bcf53e423/roles/140f30ce618745eea43e96b91df3bbab => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:12:58.708826 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a951bd-3ecf-4219-b8af-6ef27bbba704 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:58.709478 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a951bd-3ecf-4219-b8af-6ef27bbba704 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:58.709478 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a951bd-3ecf-4219-b8af-6ef27bbba704 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:58.710729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 560/1124] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:12:58.718142 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa234b7d-44fd-4485-a369-f3d895a4df6f None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:58.719303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa234b7d-44fd-4485-a369-f3d895a4df6f None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:58.719303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa234b7d-44fd-4485-a369-f3d895a4df6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:58.739518 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-aa234b7d-44fd-4485-a369-f3d895a4df6f None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:12:58.741539 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-aa234b7d-44fd-4485-a369-f3d895a4df6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:12:58.814628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 565/1125] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:12:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:12:58.838786 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a951bd-3ecf-4219-b8af-6ef27bbba704 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:58.937630 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a951bd-3ecf-4219-b8af-6ef27bbba704 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:58.971355 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98445c-9f18-4442-a601-49c41ab69495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:58.972119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98445c-9f18-4442-a601-49c41ab69495 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:58.972426 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98445c-9f18-4442-a601-49c41ab69495 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:58.972696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98445c-9f18-4442-a601-49c41ab69495 None admin] PATH_INFO: `/v3/roles/140f30ce618745eea43e96b91df3bbab` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:58.974157 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98445c-9f18-4442-a601-49c41ab69495 None admin] RBAC: Authorizing `identity:get_role(role_id=140f30ce618745eea43e96b91df3bbab)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:58.975525 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98445c-9f18-4442-a601-49c41ab69495 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:58.976917 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 561/1126] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:12:58 2022] GET /identity/v3/roles/140f30ce618745eea43e96b91df3bbab => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:58.982743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa234b7d-44fd-4485-a369-f3d895a4df6f None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:59.075331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa234b7d-44fd-4485-a369-f3d895a4df6f None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:59.107398 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240b42e-dda6-45ae-ba74-19f703644647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:59.108303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240b42e-dda6-45ae-ba74-19f703644647 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:59.108583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240b42e-dda6-45ae-ba74-19f703644647 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:59.108854 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240b42e-dda6-45ae-ba74-19f703644647 None admin] PATH_INFO: `/v3/users/a205b23bdd1a4e4cbf889c5bcf53e423` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:59.110025 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240b42e-dda6-45ae-ba74-19f703644647 None admin] RBAC: Authorizing `identity:get_user(user_id=a205b23bdd1a4e4cbf889c5bcf53e423)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:59.111450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240b42e-dda6-45ae-ba74-19f703644647 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:59.113094 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 566/1127] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:12:58 2022] GET /identity/v3/users/a205b23bdd1a4e4cbf889c5bcf53e423 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:59.118866 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98445c-9f18-4442-a601-49c41ab69495 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:59.220711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98445c-9f18-4442-a601-49c41ab69495 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:59.259706 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af61bcf-13b1-442b-b7c2-ffc74b73aef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:59.260383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af61bcf-13b1-442b-b7c2-ffc74b73aef5 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:59.260662 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af61bcf-13b1-442b-b7c2-ffc74b73aef5 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:59.260929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af61bcf-13b1-442b-b7c2-ffc74b73aef5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:59.328911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af61bcf-13b1-442b-b7c2-ffc74b73aef5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:59.330364 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af61bcf-13b1-442b-b7c2-ffc74b73aef5 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:59.431048 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 562/1128] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:12:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:12:59.438351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240b42e-dda6-45ae-ba74-19f703644647 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:59.540470 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240b42e-dda6-45ae-ba74-19f703644647 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:59.577445 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca419454-1fae-45cf-8db4-f6cf62aedad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:59.578620 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca419454-1fae-45cf-8db4-f6cf62aedad5 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:59.579014 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca419454-1fae-45cf-8db4-f6cf62aedad5 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:59.579309 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca419454-1fae-45cf-8db4-f6cf62aedad5 None admin] PATH_INFO: `/v3/projects/7028f072b565430895db6b468244e66c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:59.580628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca419454-1fae-45cf-8db4-f6cf62aedad5 None admin] RBAC: Authorizing `identity:get_project(project_id=7028f072b565430895db6b468244e66c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:59.582075 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca419454-1fae-45cf-8db4-f6cf62aedad5 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:59.583815 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 567/1129] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:12:59 2022] GET /identity/v3/projects/7028f072b565430895db6b468244e66c => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:12:59.590218 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af61bcf-13b1-442b-b7c2-ffc74b73aef5 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:12:59.689709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af61bcf-13b1-442b-b7c2-ffc74b73aef5 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:12:59.722062 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f786b-e490-4aad-a168-b713186bc68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:12:59.722759 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f786b-e490-4aad-a168-b713186bc68f None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:12:59.722969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f786b-e490-4aad-a168-b713186bc68f None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:12:59.723238 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f786b-e490-4aad-a168-b713186bc68f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:12:59.724060 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f786b-e490-4aad-a168-b713186bc68f None admin] RBAC: Adding query filter params (role.id=140f30ce618745eea43e96b91df3bbab, scope.project.id=7028f072b565430895db6b468244e66c, user.id=a205b23bdd1a4e4cbf889c5bcf53e423) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:12:59.724395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f786b-e490-4aad-a168-b713186bc68f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:12:59.725819 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f786b-e490-4aad-a168-b713186bc68f None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:12:59.731775 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 563/1130] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:12:59 2022] GET /identity/v3/role_assignments?user.id=a205b23bdd1a4e4cbf889c5bcf53e423&scope.project.id=7028f072b565430895db6b468244e66c&role.id=140f30ce618745eea43e96b91df3bbab => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:13:02.166790 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b96eeb-a8f6-4008-a49a-9411d3a4cb30 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:02.167337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b96eeb-a8f6-4008-a49a-9411d3a4cb30 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:02.167337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b96eeb-a8f6-4008-a49a-9411d3a4cb30 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:02.168714 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 568/1131] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:13:02.174651 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8790c84-4395-46aa-8354-e479faf92c0f None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:02.175067 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8790c84-4395-46aa-8354-e479faf92c0f None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:02.175185 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8790c84-4395-46aa-8354-e479faf92c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:02.191273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-c8790c84-4395-46aa-8354-e479faf92c0f None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:13:02.192479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c8790c84-4395-46aa-8354-e479faf92c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:13:02.255937 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 564/1132] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:13:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:13:02.279268 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b96eeb-a8f6-4008-a49a-9411d3a4cb30 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:02.378762 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b96eeb-a8f6-4008-a49a-9411d3a4cb30 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:02.413364 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ffa51-c232-45cf-97c4-a520d8146a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:02.414168 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ffa51-c232-45cf-97c4-a520d8146a04 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:02.414448 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ffa51-c232-45cf-97c4-a520d8146a04 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:02.414718 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ffa51-c232-45cf-97c4-a520d8146a04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:02.415871 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ffa51-c232-45cf-97c4-a520d8146a04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:02.417362 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ffa51-c232-45cf-97c4-a520d8146a04 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:02.418923 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 569/1133] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:13:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:13:02.425985 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8790c84-4395-46aa-8354-e479faf92c0f None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:02.531960 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8790c84-4395-46aa-8354-e479faf92c0f None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:02.565090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd378e6-4a72-43cd-963b-0abfe04f8a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:02.565744 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd378e6-4a72-43cd-963b-0abfe04f8a1d None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:02.566016 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd378e6-4a72-43cd-963b-0abfe04f8a1d None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:02.566281 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd378e6-4a72-43cd-963b-0abfe04f8a1d None admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:02.566990 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd378e6-4a72-43cd-963b-0abfe04f8a1d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:02.568452 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd378e6-4a72-43cd-963b-0abfe04f8a1d None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:02.593736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 565/1134] 10.222.0.71 () {60 vars in 1141 bytes} [Mon May 16 20:13:02 2022] POST /identity/v3/projects => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:13:04.945409 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b45ca7-ed47-4308-a984-27c1f52791c5 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:04.945963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b45ca7-ed47-4308-a984-27c1f52791c5 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:04.945963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b45ca7-ed47-4308-a984-27c1f52791c5 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:04.947419 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 570/1135] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:13:04.954824 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef81d7-6d42-4280-a9fb-9c5c3baac2b5 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:04.955420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef81d7-6d42-4280-a9fb-9c5c3baac2b5 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:04.955913 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef81d7-6d42-4280-a9fb-9c5c3baac2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:04.979359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-64ef81d7-6d42-4280-a9fb-9c5c3baac2b5 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:13:04.981170 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-64ef81d7-6d42-4280-a9fb-9c5c3baac2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:13:05.050517 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 566/1136] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:13:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:13:05.076080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b45ca7-ed47-4308-a984-27c1f52791c5 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:05.178675 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b45ca7-ed47-4308-a984-27c1f52791c5 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:05.211659 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09e767-cbe2-4864-aedf-187b76a32277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:05.212405 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09e767-cbe2-4864-aedf-187b76a32277 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:05.212689 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09e767-cbe2-4864-aedf-187b76a32277 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:05.212964 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09e767-cbe2-4864-aedf-187b76a32277 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:05.214133 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09e767-cbe2-4864-aedf-187b76a32277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:05.215560 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09e767-cbe2-4864-aedf-187b76a32277 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:05.217208 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 571/1137] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:13:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:13:05.222922 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef81d7-6d42-4280-a9fb-9c5c3baac2b5 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:05.318129 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef81d7-6d42-4280-a9fb-9c5c3baac2b5 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:05.350044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd4a1e-db83-411a-b2b2-55a411abf21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:05.350698 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd4a1e-db83-411a-b2b2-55a411abf21d None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:05.350976 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd4a1e-db83-411a-b2b2-55a411abf21d None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:05.351245 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd4a1e-db83-411a-b2b2-55a411abf21d None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:05.351949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd4a1e-db83-411a-b2b2-55a411abf21d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:05.353403 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd4a1e-db83-411a-b2b2-55a411abf21d None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:05.373046 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 567/1138] 10.222.0.71 () {60 vars in 1132 bytes} [Mon May 16 20:13:05 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:13:07.673260 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb4e8e-070b-4b96-a633-4240296085e9 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:07.673824 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb4e8e-070b-4b96-a633-4240296085e9 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:07.673824 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb4e8e-070b-4b96-a633-4240296085e9 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:07.675166 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 572/1139] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:13:07.680647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7a0a2-99de-4f4a-9306-e384b5c7ba90 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:07.681094 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7a0a2-99de-4f4a-9306-e384b5c7ba90 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:07.681198 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7a0a2-99de-4f4a-9306-e384b5c7ba90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:07.698168 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-4ba7a0a2-99de-4f4a-9306-e384b5c7ba90 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:13:07.699339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-4ba7a0a2-99de-4f4a-9306-e384b5c7ba90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:13:07.764075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 568/1140] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:13:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:13:07.789578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb4e8e-070b-4b96-a633-4240296085e9 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:07.889596 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb4e8e-070b-4b96-a633-4240296085e9 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:07.922525 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d4903-5fcd-485a-80de-1ae5fbb9c00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:07.923354 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d4903-5fcd-485a-80de-1ae5fbb9c00d None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:07.923616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d4903-5fcd-485a-80de-1ae5fbb9c00d None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:07.923858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d4903-5fcd-485a-80de-1ae5fbb9c00d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:07.933452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d4903-5fcd-485a-80de-1ae5fbb9c00d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:13:07.941799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-e21d4903-5fcd-485a-80de-1ae5fbb9c00d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:13:07.941799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:13:07.941799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:13:07.941799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:13:07.941799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:13:07.941799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:13:07.941799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:13:07.941799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:13:07.941799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:13:07.941799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:13:07.941799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:13:07.941799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:13:07.941799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:13:07.941799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:13:07.941799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:13:07.941799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:13:07.942991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:13:07.942991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:13:07.942991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:13:07.942991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:13:07.942991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:13:07.942991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:13:07.942991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:13:07.942991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:13:07.942991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:13:07.942991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:13:07.942991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:13:07.942991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:13:07.942991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:13:07.942991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:13:07.942991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:13:07.942991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:13:07.944310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:13:07.944310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:13:07.944310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:13:07.944310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:13:07.944310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:13:07.944310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:13:07.944310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:13:07.944310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:13:07.944310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:13:07.944310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:13:07.944310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:13:07.944310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:13:07.944310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 573/1141] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:13:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:13:07.949009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7a0a2-99de-4f4a-9306-e384b5c7ba90 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:08.042607 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7a0a2-99de-4f4a-9306-e384b5c7ba90 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:08.081187 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3154f87-bcf8-491f-a9ab-20532a801179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:08.081843 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3154f87-bcf8-491f-a9ab-20532a801179 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:08.082119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3154f87-bcf8-491f-a9ab-20532a801179 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:08.082388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3154f87-bcf8-491f-a9ab-20532a801179 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:08.083126 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3154f87-bcf8-491f-a9ab-20532a801179 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:13:08.083433 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3154f87-bcf8-491f-a9ab-20532a801179 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:08.084841 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3154f87-bcf8-491f-a9ab-20532a801179 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:08.093848 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 569/1142] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:13:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:13:08.099666 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d4903-5fcd-485a-80de-1ae5fbb9c00d None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:08.199363 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d4903-5fcd-485a-80de-1ae5fbb9c00d None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:08.234271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44588d0e-cb3e-4f49-bbcf-958bb901e3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:08.234871 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44588d0e-cb3e-4f49-bbcf-958bb901e3d6 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:08.235149 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44588d0e-cb3e-4f49-bbcf-958bb901e3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:08.235421 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44588d0e-cb3e-4f49-bbcf-958bb901e3d6 None admin] PATH_INFO: `/v3/users/1286ce45def04b04af23befc2969ce68` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:08.249932 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44588d0e-cb3e-4f49-bbcf-958bb901e3d6 None admin] RBAC: Authorizing `identity:get_user(user_id=1286ce45def04b04af23befc2969ce68)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:08.251370 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44588d0e-cb3e-4f49-bbcf-958bb901e3d6 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:08.253115 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 574/1143] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:13:08 2022] GET /identity/v3/users/1286ce45def04b04af23befc2969ce68 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:13:08.258914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3154f87-bcf8-491f-a9ab-20532a801179 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:08.359351 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3154f87-bcf8-491f-a9ab-20532a801179 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:08.391859 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ec552-d61d-44bd-990b-679de83b68c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:08.392542 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ec552-d61d-44bd-990b-679de83b68c8 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:08.392820 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ec552-d61d-44bd-990b-679de83b68c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:08.393089 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ec552-d61d-44bd-990b-679de83b68c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:08.460327 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ec552-d61d-44bd-990b-679de83b68c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:08.461702 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ec552-d61d-44bd-990b-679de83b68c8 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:08.560302 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 570/1144] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:13:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:13:08.566197 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44588d0e-cb3e-4f49-bbcf-958bb901e3d6 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:08.661002 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44588d0e-cb3e-4f49-bbcf-958bb901e3d6 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:08.692638 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e685be-83a7-45b1-bd0d-ab77c2c2476e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:08.693482 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e685be-83a7-45b1-bd0d-ab77c2c2476e None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:08.693758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e685be-83a7-45b1-bd0d-ab77c2c2476e None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:08.694027 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e685be-83a7-45b1-bd0d-ab77c2c2476e None admin] PATH_INFO: `/v3/projects/616ae188c2034799a59071d94b9c35fe` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:08.695183 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e685be-83a7-45b1-bd0d-ab77c2c2476e None admin] RBAC: Authorizing `identity:get_project(project_id=616ae188c2034799a59071d94b9c35fe)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:08.696631 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e685be-83a7-45b1-bd0d-ab77c2c2476e None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:08.698341 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 575/1145] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:13:08 2022] GET /identity/v3/projects/616ae188c2034799a59071d94b9c35fe => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:13:08.705045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ec552-d61d-44bd-990b-679de83b68c8 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:08.801689 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ec552-d61d-44bd-990b-679de83b68c8 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:08.834202 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1df828-3499-44eb-bedc-7ddf01a8cf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:08.834842 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1df828-3499-44eb-bedc-7ddf01a8cf47 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:08.835123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1df828-3499-44eb-bedc-7ddf01a8cf47 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:08.835397 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1df828-3499-44eb-bedc-7ddf01a8cf47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:08.836246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1df828-3499-44eb-bedc-7ddf01a8cf47 None admin] RBAC: Adding query filter params (role.id=6576d9225a0946de877f527e3d15db05, scope.project.id=616ae188c2034799a59071d94b9c35fe, user.id=1286ce45def04b04af23befc2969ce68) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:13:08.836556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1df828-3499-44eb-bedc-7ddf01a8cf47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:08.837976 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1df828-3499-44eb-bedc-7ddf01a8cf47 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:08.843857 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 571/1146] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:13:08 2022] GET /identity/v3/role_assignments?user.id=1286ce45def04b04af23befc2969ce68&scope.project.id=616ae188c2034799a59071d94b9c35fe&role.id=6576d9225a0946de877f527e3d15db05 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:13:11.073278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7226c4-a294-4b23-95d7-2462863d0bdf None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:11.073820 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7226c4-a294-4b23-95d7-2462863d0bdf None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:11.073820 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7226c4-a294-4b23-95d7-2462863d0bdf None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:11.075195 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 576/1147] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:13:11.081442 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f2cc8-05f5-47e2-ad24-a0b07752005a None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:11.081979 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f2cc8-05f5-47e2-ad24-a0b07752005a None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:11.081979 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f2cc8-05f5-47e2-ad24-a0b07752005a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:11.099320 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-353f2cc8-05f5-47e2-ad24-a0b07752005a None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:13:11.100543 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-353f2cc8-05f5-47e2-ad24-a0b07752005a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:13:11.168666 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 572/1148] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:13:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:13:11.210207 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7226c4-a294-4b23-95d7-2462863d0bdf None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:11.320318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7226c4-a294-4b23-95d7-2462863d0bdf None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:11.354680 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb815273-fb1c-47d0-a89c-aa5c7d6d3534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:11.355385 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb815273-fb1c-47d0-a89c-aa5c7d6d3534 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:11.355663 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb815273-fb1c-47d0-a89c-aa5c7d6d3534 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:11.355934 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb815273-fb1c-47d0-a89c-aa5c7d6d3534 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:11.366431 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb815273-fb1c-47d0-a89c-aa5c7d6d3534 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:13:11.374747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-eb815273-fb1c-47d0-a89c-aa5c7d6d3534 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:13:11.374747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:13:11.374747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:13:11.374747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:13:11.374747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:13:11.374747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:13:11.374747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:13:11.374747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:13:11.374747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:13:11.374747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:13:11.374747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:13:11.374747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:13:11.374747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:13:11.374747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:13:11.374747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:13:11.374747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:13:11.375725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:13:11.375725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:13:11.375725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:13:11.375725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:13:11.375725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:13:11.375725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:13:11.375725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:13:11.375725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:13:11.375725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:13:11.375725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:13:11.375725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:13:11.375725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:13:11.375725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:13:11.375725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:13:11.375725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:13:11.375725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:13:11.376756 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:13:11.376756 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:13:11.376756 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:13:11.376756 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:13:11.376756 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:13:11.376756 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:13:11.376756 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:13:11.376756 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:13:11.376756 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:13:11.376756 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:13:11.376756 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:13:11.376756 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:13:11.376756 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 577/1149] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:13:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:13:11.382197 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f2cc8-05f5-47e2-ad24-a0b07752005a None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:11.486446 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f2cc8-05f5-47e2-ad24-a0b07752005a None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:11.524627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d394117-061c-4dfe-bf7f-2100bdaed95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:11.525296 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d394117-061c-4dfe-bf7f-2100bdaed95c None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:11.525575 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d394117-061c-4dfe-bf7f-2100bdaed95c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:11.525845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d394117-061c-4dfe-bf7f-2100bdaed95c None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:11.526596 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d394117-061c-4dfe-bf7f-2100bdaed95c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:13:11.526900 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d394117-061c-4dfe-bf7f-2100bdaed95c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:11.528311 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d394117-061c-4dfe-bf7f-2100bdaed95c None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:11.537339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 573/1150] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:13:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:13:11.543384 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb815273-fb1c-47d0-a89c-aa5c7d6d3534 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:11.643879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb815273-fb1c-47d0-a89c-aa5c7d6d3534 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:11.677222 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbfec3-b5bc-4330-b34d-e72c5e55d200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:11.678090 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbfec3-b5bc-4330-b34d-e72c5e55d200 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:11.678377 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbfec3-b5bc-4330-b34d-e72c5e55d200 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:11.678649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbfec3-b5bc-4330-b34d-e72c5e55d200 None admin] PATH_INFO: `/v3/users/1286ce45def04b04af23befc2969ce68` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:11.679839 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbfec3-b5bc-4330-b34d-e72c5e55d200 None admin] RBAC: Authorizing `identity:get_user(user_id=1286ce45def04b04af23befc2969ce68)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:11.681300 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbfec3-b5bc-4330-b34d-e72c5e55d200 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:11.682960 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 578/1151] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:13:11 2022] GET /identity/v3/users/1286ce45def04b04af23befc2969ce68 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:13:11.689945 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d394117-061c-4dfe-bf7f-2100bdaed95c None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:11.787277 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d394117-061c-4dfe-bf7f-2100bdaed95c None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:11.820368 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed0629-4918-4d98-a64c-2a926ad4224a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:11.821209 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed0629-4918-4d98-a64c-2a926ad4224a None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:11.821490 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed0629-4918-4d98-a64c-2a926ad4224a None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:11.821764 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed0629-4918-4d98-a64c-2a926ad4224a None admin] PATH_INFO: `/v3/projects/616ae188c2034799a59071d94b9c35fe` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:11.822948 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed0629-4918-4d98-a64c-2a926ad4224a None admin] RBAC: Authorizing `identity:get_project(project_id=616ae188c2034799a59071d94b9c35fe)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:11.824421 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed0629-4918-4d98-a64c-2a926ad4224a None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:11.826158 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 574/1152] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:13:11 2022] GET /identity/v3/projects/616ae188c2034799a59071d94b9c35fe => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:13:11.832705 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbfec3-b5bc-4330-b34d-e72c5e55d200 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:11.932840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbfec3-b5bc-4330-b34d-e72c5e55d200 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:11.966394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa885c-13b9-4858-8188-094f2fce6bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:11.967833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa885c-13b9-4858-8188-094f2fce6bdc None admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:11.968051 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa885c-13b9-4858-8188-094f2fce6bdc None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:11.968364 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa885c-13b9-4858-8188-094f2fce6bdc None admin] PATH_INFO: `/v3/projects/616ae188c2034799a59071d94b9c35fe/users/1286ce45def04b04af23befc2969ce68/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:11.970355 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa885c-13b9-4858-8188-094f2fce6bdc None admin] RBAC: Authorizing `identity:create_grant(project_id=616ae188c2034799a59071d94b9c35fe, user_id=1286ce45def04b04af23befc2969ce68, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:11.971778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa885c-13b9-4858-8188-094f2fce6bdc None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:11.986303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 579/1153] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:13:11 2022] PUT /identity/v3/projects/616ae188c2034799a59071d94b9c35fe/users/1286ce45def04b04af23befc2969ce68/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:13:14.223761 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c49b5-74c9-4063-b492-ae9b0d6176f9 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:14.224319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c49b5-74c9-4063-b492-ae9b0d6176f9 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:14.224319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c49b5-74c9-4063-b492-ae9b0d6176f9 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:14.225692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 575/1154] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:13:14.231048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3b8aa-0744-43f5-9411-bfeeb3992d6c None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:14.231474 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3b8aa-0744-43f5-9411-bfeeb3992d6c None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:14.231607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3b8aa-0744-43f5-9411-bfeeb3992d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:14.247671 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-69f3b8aa-0744-43f5-9411-bfeeb3992d6c None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:13:14.249534 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-69f3b8aa-0744-43f5-9411-bfeeb3992d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:13:14.312030 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 580/1155] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:13:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:13:14.335974 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c49b5-74c9-4063-b492-ae9b0d6176f9 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:14.433028 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c49b5-74c9-4063-b492-ae9b0d6176f9 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:14.465589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bb060-cfb6-49de-97d2-97ef300626a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:14.466364 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bb060-cfb6-49de-97d2-97ef300626a0 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:14.466645 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bb060-cfb6-49de-97d2-97ef300626a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:14.466945 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bb060-cfb6-49de-97d2-97ef300626a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:14.477058 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bb060-cfb6-49de-97d2-97ef300626a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:13:14.485024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-d94bb060-cfb6-49de-97d2-97ef300626a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:13:14.485024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:13:14.485024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:13:14.485024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:13:14.485024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:13:14.485024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:13:14.485024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:13:14.485024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:13:14.485024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:13:14.485024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:13:14.485024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:13:14.485024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:13:14.485024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:13:14.485024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:13:14.485024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:13:14.485024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:13:14.486132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:13:14.486132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:13:14.486132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:13:14.486132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:13:14.486132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:13:14.486132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:13:14.486132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:13:14.486132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:13:14.486132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:13:14.486132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:13:14.486132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:13:14.486132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:13:14.486132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:13:14.486132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:13:14.486132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:13:14.486132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:13:14.487387 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:13:14.487387 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:13:14.487387 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:13:14.487387 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:13:14.487387 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:13:14.487387 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:13:14.487387 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:13:14.487387 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:13:14.487387 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:13:14.487387 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:13:14.487387 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:13:14.487387 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:13:14.487387 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 576/1156] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:13:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:13:14.492286 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3b8aa-0744-43f5-9411-bfeeb3992d6c None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:14.585312 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3b8aa-0744-43f5-9411-bfeeb3992d6c None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:14.617998 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b49ee1-e33c-4322-aed5-d758937bfc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:14.618657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b49ee1-e33c-4322-aed5-d758937bfc3f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:14.618936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b49ee1-e33c-4322-aed5-d758937bfc3f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:14.619214 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b49ee1-e33c-4322-aed5-d758937bfc3f None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:14.619950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b49ee1-e33c-4322-aed5-d758937bfc3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:13:14.620283 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b49ee1-e33c-4322-aed5-d758937bfc3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:14.621644 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b49ee1-e33c-4322-aed5-d758937bfc3f None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:14.630096 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 581/1157] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:13:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:13:14.635879 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bb060-cfb6-49de-97d2-97ef300626a0 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:14.738328 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bb060-cfb6-49de-97d2-97ef300626a0 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:14.771678 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572da1d-c64b-44d5-9abe-fc870c469d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:14.772592 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572da1d-c64b-44d5-9abe-fc870c469d69 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:14.772870 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572da1d-c64b-44d5-9abe-fc870c469d69 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:14.773139 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572da1d-c64b-44d5-9abe-fc870c469d69 None admin] PATH_INFO: `/v3/users/1286ce45def04b04af23befc2969ce68` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:14.774302 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572da1d-c64b-44d5-9abe-fc870c469d69 None admin] RBAC: Authorizing `identity:get_user(user_id=1286ce45def04b04af23befc2969ce68)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:14.775744 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572da1d-c64b-44d5-9abe-fc870c469d69 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:14.777399 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 577/1158] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:13:14 2022] GET /identity/v3/users/1286ce45def04b04af23befc2969ce68 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:13:14.783774 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b49ee1-e33c-4322-aed5-d758937bfc3f None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:14.885999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b49ee1-e33c-4322-aed5-d758937bfc3f None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:14.919880 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2fc6a-2f02-4cd2-ac81-30764fa41ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:14.921105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2fc6a-2f02-4cd2-ac81-30764fa41ab3 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:14.921385 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2fc6a-2f02-4cd2-ac81-30764fa41ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:14.921654 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2fc6a-2f02-4cd2-ac81-30764fa41ab3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:14.985303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2fc6a-2f02-4cd2-ac81-30764fa41ab3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:14.986734 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2fc6a-2f02-4cd2-ac81-30764fa41ab3 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:15.077204 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 582/1159] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:13:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:13:15.083168 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572da1d-c64b-44d5-9abe-fc870c469d69 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:15.177529 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572da1d-c64b-44d5-9abe-fc870c469d69 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:15.209080 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6f188-489c-4237-be23-95e1e2a15f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:15.209909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6f188-489c-4237-be23-95e1e2a15f30 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:15.210184 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6f188-489c-4237-be23-95e1e2a15f30 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:15.210449 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6f188-489c-4237-be23-95e1e2a15f30 None admin] PATH_INFO: `/v3/projects/616ae188c2034799a59071d94b9c35fe` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:15.211584 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6f188-489c-4237-be23-95e1e2a15f30 None admin] RBAC: Authorizing `identity:get_project(project_id=616ae188c2034799a59071d94b9c35fe)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:15.213030 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6f188-489c-4237-be23-95e1e2a15f30 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:15.214692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 578/1160] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:13:15 2022] GET /identity/v3/projects/616ae188c2034799a59071d94b9c35fe => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:13:15.221375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2fc6a-2f02-4cd2-ac81-30764fa41ab3 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:15.313465 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2fc6a-2f02-4cd2-ac81-30764fa41ab3 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:15.345923 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8b748-3b14-4c2a-8e86-4a3bc8d773e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:15.346492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8b748-3b14-4c2a-8e86-4a3bc8d773e5 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:15.346773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8b748-3b14-4c2a-8e86-4a3bc8d773e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:15.347050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8b748-3b14-4c2a-8e86-4a3bc8d773e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:15.347862 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8b748-3b14-4c2a-8e86-4a3bc8d773e5 None admin] RBAC: Adding query filter params (role.id=6576d9225a0946de877f527e3d15db05, scope.project.id=616ae188c2034799a59071d94b9c35fe, user.id=1286ce45def04b04af23befc2969ce68) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:13:15.348186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8b748-3b14-4c2a-8e86-4a3bc8d773e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:15.349602 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8b748-3b14-4c2a-8e86-4a3bc8d773e5 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:15.355228 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 583/1161] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:13:15 2022] GET /identity/v3/role_assignments?user.id=1286ce45def04b04af23befc2969ce68&scope.project.id=616ae188c2034799a59071d94b9c35fe&role.id=6576d9225a0946de877f527e3d15db05 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:13:17.690829 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72b746-525f-4410-8a8b-f1bebe714b8b None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:17.691370 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72b746-525f-4410-8a8b-f1bebe714b8b None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:17.691370 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72b746-525f-4410-8a8b-f1bebe714b8b None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:17.692745 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 579/1162] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:13:17.697970 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ac44d-6158-44ee-9aee-ba0f960cda6e None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:17.698353 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ac44d-6158-44ee-9aee-ba0f960cda6e None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:17.698532 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ac44d-6158-44ee-9aee-ba0f960cda6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:17.715884 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-a79ac44d-6158-44ee-9aee-ba0f960cda6e None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:13:17.718265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-a79ac44d-6158-44ee-9aee-ba0f960cda6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:13:17.783076 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 584/1163] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:13:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:13:17.806248 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72b746-525f-4410-8a8b-f1bebe714b8b None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:17.905374 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72b746-525f-4410-8a8b-f1bebe714b8b None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:17.937250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f7076-cc78-40d1-8a4e-186a7d5279e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:17.937877 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f7076-cc78-40d1-8a4e-186a7d5279e4 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:17.938151 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f7076-cc78-40d1-8a4e-186a7d5279e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:17.938418 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f7076-cc78-40d1-8a4e-186a7d5279e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:18.000546 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f7076-cc78-40d1-8a4e-186a7d5279e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:18.001895 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f7076-cc78-40d1-8a4e-186a7d5279e4 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:18.096708 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 580/1164] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:13:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 20:13:18.102784 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ac44d-6158-44ee-9aee-ba0f960cda6e None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:18.204641 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ac44d-6158-44ee-9aee-ba0f960cda6e None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:18.238250 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f8b04-d698-4b95-ba6a-2506eedb2663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:18.239135 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f8b04-d698-4b95-ba6a-2506eedb2663 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:18.239335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f8b04-d698-4b95-ba6a-2506eedb2663 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:18.239611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f8b04-d698-4b95-ba6a-2506eedb2663 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:18.246098 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f8b04-d698-4b95-ba6a-2506eedb2663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:18.247538 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f8b04-d698-4b95-ba6a-2506eedb2663 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:18.261931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-0e4f8b04-d698-4b95-ba6a-2506eedb2663 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 16 20:13:18.261931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:13:18.261931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 16 20:13:18.261931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 16 20:13:18.261931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:13:18.261931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:13:18.261931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:13:18.261931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:13:18.261931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 16 20:13:18.261931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:13:18.261931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:13:18.261931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:13:18.261931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:13:18.261931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:13:18.261931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:13:18.261931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:13:18.261931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:13:18.263189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:13:18.263189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:13:18.263189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:13:18.263189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:13:18.263189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:13:18.263189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:13:18.263189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:13:18.263189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:13:18.263189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:13:18.263189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:13:18.263189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:13:18.263189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:13:18.263189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:13:18.263189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:13:18.263189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:13:18.263189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:13:18.264941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:13:18.264941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:13:18.264941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:13:18.264941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:13:18.264941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:13:18.264941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:13:18.264941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:13:18.264941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:13:18.264941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:13:18.264941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:13:18.264941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 16 20:13:18.264941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:13:18.264941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 16 20:13:18.264941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:13:18.264941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 585/1165] 10.222.0.71 () {56 vars in 1117 bytes} [Mon May 16 20:13:18 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:13:18.269369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f7076-cc78-40d1-8a4e-186a7d5279e4 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:18.367130 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f7076-cc78-40d1-8a4e-186a7d5279e4 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:18.402168 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4367d55-403c-4f03-9c13-b0b4d7b242dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:18.402828 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4367d55-403c-4f03-9c13-b0b4d7b242dd None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:18.403104 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4367d55-403c-4f03-9c13-b0b4d7b242dd None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:18.403376 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4367d55-403c-4f03-9c13-b0b4d7b242dd None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:18.404101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4367d55-403c-4f03-9c13-b0b4d7b242dd None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:13:18.404472 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4367d55-403c-4f03-9c13-b0b4d7b242dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:18.406021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4367d55-403c-4f03-9c13-b0b4d7b242dd None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:18.413371 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 581/1166] 10.222.0.71 () {56 vars in 1115 bytes} [Mon May 16 20:13:18 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:13:20.665601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c541e39-5013-4223-bb7f-d2179727a086 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:20.666177 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c541e39-5013-4223-bb7f-d2179727a086 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:20.666177 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c541e39-5013-4223-bb7f-d2179727a086 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:20.667530 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 586/1167] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:13:20.673911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2354f-f9f0-42e8-97bd-a7fe17fdfd50 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:20.674495 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2354f-f9f0-42e8-97bd-a7fe17fdfd50 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:20.674495 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2354f-f9f0-42e8-97bd-a7fe17fdfd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:20.691704 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-e3e2354f-f9f0-42e8-97bd-a7fe17fdfd50 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:13:20.692949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-e3e2354f-f9f0-42e8-97bd-a7fe17fdfd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:13:20.760499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 582/1168] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:13:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:13:20.784557 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c541e39-5013-4223-bb7f-d2179727a086 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:20.899848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c541e39-5013-4223-bb7f-d2179727a086 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:20.933854 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b164582-c828-4b84-af5f-bc436cf0c177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:20.934425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b164582-c828-4b84-af5f-bc436cf0c177 None admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:20.934706 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b164582-c828-4b84-af5f-bc436cf0c177 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:20.934979 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b164582-c828-4b84-af5f-bc436cf0c177 None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:20.936865 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b164582-c828-4b84-af5f-bc436cf0c177 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:20.938246 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b164582-c828-4b84-af5f-bc436cf0c177 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:20.953819 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 587/1169] 10.222.0.71 () {60 vars in 1138 bytes} [Mon May 16 20:13:20 2022] POST /identity/v3/domains => generated 267 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:13:23.287189 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a45ab-4d15-4e0c-bcaa-e253f9ecafee None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:23.287772 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a45ab-4d15-4e0c-bcaa-e253f9ecafee None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:23.287772 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a45ab-4d15-4e0c-bcaa-e253f9ecafee None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:23.289149 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 583/1170] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:13:23.295359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d62dea-2c79-41d2-a78e-62fc8a67089e None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:23.295870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d62dea-2c79-41d2-a78e-62fc8a67089e None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:23.296077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d62dea-2c79-41d2-a78e-62fc8a67089e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:23.314454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-00d62dea-2c79-41d2-a78e-62fc8a67089e None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:13:23.315662 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-00d62dea-2c79-41d2-a78e-62fc8a67089e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:13:23.416334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 588/1171] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:13:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:13:23.440406 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a45ab-4d15-4e0c-bcaa-e253f9ecafee None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:23.551389 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a45ab-4d15-4e0c-bcaa-e253f9ecafee None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:23.585714 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de3044-fe37-4db1-9843-8ef211a5411c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:23.586568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de3044-fe37-4db1-9843-8ef211a5411c None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:23.586848 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de3044-fe37-4db1-9843-8ef211a5411c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:23.587122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de3044-fe37-4db1-9843-8ef211a5411c None admin] PATH_INFO: `/v3/domains/64068a528e364caf8ab628c2103e6bbd` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:23.598489 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de3044-fe37-4db1-9843-8ef211a5411c None admin] RBAC: Authorizing `identity:get_domain(domain_id=64068a528e364caf8ab628c2103e6bbd)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:23.600091 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de3044-fe37-4db1-9843-8ef211a5411c None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:23.601940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 584/1172] 10.222.0.71 () {56 vars in 1183 bytes} [Mon May 16 20:13:23 2022] GET /identity/v3/domains/64068a528e364caf8ab628c2103e6bbd => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:13:23.608594 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d62dea-2c79-41d2-a78e-62fc8a67089e None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:23.710246 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d62dea-2c79-41d2-a78e-62fc8a67089e None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:23.751538 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab75bd1-0316-4c06-9a9f-2dad41b7c3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:23.752241 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab75bd1-0316-4c06-9a9f-2dad41b7c3d6 None admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:23.752541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab75bd1-0316-4c06-9a9f-2dad41b7c3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:23.752812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab75bd1-0316-4c06-9a9f-2dad41b7c3d6 None admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:23.753554 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab75bd1-0316-4c06-9a9f-2dad41b7c3d6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:23.754987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab75bd1-0316-4c06-9a9f-2dad41b7c3d6 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:23.786657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 589/1173] 10.222.0.71 () {60 vars in 1141 bytes} [Mon May 16 20:13:23 2022] POST /identity/v3/projects => generated 361 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:13:26.168540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c0ff1-fa06-41d0-a9c1-a39bb26aaa4d None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:26.169129 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c0ff1-fa06-41d0-a9c1-a39bb26aaa4d None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:26.169129 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c0ff1-fa06-41d0-a9c1-a39bb26aaa4d None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:26.171217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 585/1174] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:13:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:13:26.176834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d349b-b6f7-4708-aaf0-a27135f642d2 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:26.177332 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d349b-b6f7-4708-aaf0-a27135f642d2 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:26.177426 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d349b-b6f7-4708-aaf0-a27135f642d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:26.194018 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-338d349b-b6f7-4708-aaf0-a27135f642d2 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:13:26.195253 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-338d349b-b6f7-4708-aaf0-a27135f642d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:13:26.271011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 590/1175] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:13:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:13:26.297169 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c0ff1-fa06-41d0-a9c1-a39bb26aaa4d None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:26.393402 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c0ff1-fa06-41d0-a9c1-a39bb26aaa4d None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:26.427018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9b85c-a963-4931-82b6-0f2d94014035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:26.427789 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9b85c-a963-4931-82b6-0f2d94014035 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:26.428066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9b85c-a963-4931-82b6-0f2d94014035 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:26.428363 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9b85c-a963-4931-82b6-0f2d94014035 None admin] PATH_INFO: `/v3/domains/64068a528e364caf8ab628c2103e6bbd` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:26.429529 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9b85c-a963-4931-82b6-0f2d94014035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=64068a528e364caf8ab628c2103e6bbd)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:26.430957 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9b85c-a963-4931-82b6-0f2d94014035 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:26.432597 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 586/1176] 10.222.0.71 () {56 vars in 1183 bytes} [Mon May 16 20:13:26 2022] GET /identity/v3/domains/64068a528e364caf8ab628c2103e6bbd => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:13:26.438482 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d349b-b6f7-4708-aaf0-a27135f642d2 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:26.535911 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d349b-b6f7-4708-aaf0-a27135f642d2 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:26.567863 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321faeee-abcc-4f15-a47c-eea5297dd4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:26.568555 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321faeee-abcc-4f15-a47c-eea5297dd4f0 None admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:26.568834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321faeee-abcc-4f15-a47c-eea5297dd4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:26.569103 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321faeee-abcc-4f15-a47c-eea5297dd4f0 None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:26.569804 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321faeee-abcc-4f15-a47c-eea5297dd4f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:26.571218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321faeee-abcc-4f15-a47c-eea5297dd4f0 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:26.592245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 591/1177] 10.222.0.71 () {60 vars in 1132 bytes} [Mon May 16 20:13:26 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:13:29.034157 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb7cfe-9464-42a1-a786-7e0dc95bc2c1 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:29.034726 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb7cfe-9464-42a1-a786-7e0dc95bc2c1 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:29.034726 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb7cfe-9464-42a1-a786-7e0dc95bc2c1 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:29.036080 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 587/1178] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:13:29.041434 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fb736-dedb-4d86-8a12-d43ed0df09a7 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:29.041841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fb736-dedb-4d86-8a12-d43ed0df09a7 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:29.042005 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fb736-dedb-4d86-8a12-d43ed0df09a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:29.059181 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-088fb736-dedb-4d86-8a12-d43ed0df09a7 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:13:29.061418 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-088fb736-dedb-4d86-8a12-d43ed0df09a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:13:29.129184 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 592/1179] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:13:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:13:29.153753 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb7cfe-9464-42a1-a786-7e0dc95bc2c1 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:29.258235 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb7cfe-9464-42a1-a786-7e0dc95bc2c1 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:29.290608 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7434a8d-18bc-471e-b79e-834d6a4e263c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:29.291319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7434a8d-18bc-471e-b79e-834d6a4e263c None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:29.291594 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7434a8d-18bc-471e-b79e-834d6a4e263c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:29.291865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7434a8d-18bc-471e-b79e-834d6a4e263c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:29.303143 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7434a8d-18bc-471e-b79e-834d6a4e263c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:13:29.312011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-d7434a8d-18bc-471e-b79e-834d6a4e263c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:13:29.312011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:13:29.312011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:13:29.312011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:13:29.312011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:13:29.312011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:13:29.312011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:13:29.312011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:13:29.312011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:13:29.312011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:13:29.312011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:13:29.312011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:13:29.312011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:13:29.312011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:13:29.312011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:13:29.312011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:13:29.313246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:13:29.313246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:13:29.313246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:13:29.313246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:13:29.313246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:13:29.313246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:13:29.313246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:13:29.313246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:13:29.313246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:13:29.313246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:13:29.313246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:13:29.313246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:13:29.313246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:13:29.313246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:13:29.313246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:13:29.313246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:13:29.314457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:13:29.314457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:13:29.314457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:13:29.314457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:13:29.314457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:13:29.314457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:13:29.314457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:13:29.314457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:13:29.314457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:13:29.314457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:13:29.314457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:13:29.314457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:13:29.314457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 588/1180] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:13:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:13:29.319458 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fb736-dedb-4d86-8a12-d43ed0df09a7 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:29.415175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fb736-dedb-4d86-8a12-d43ed0df09a7 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:29.447941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01577da2-4acd-4aab-838f-08a2022c2b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:29.448636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01577da2-4acd-4aab-838f-08a2022c2b9d None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:29.448918 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01577da2-4acd-4aab-838f-08a2022c2b9d None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:29.449191 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01577da2-4acd-4aab-838f-08a2022c2b9d None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:29.449937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01577da2-4acd-4aab-838f-08a2022c2b9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:13:29.450245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01577da2-4acd-4aab-838f-08a2022c2b9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:29.451623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01577da2-4acd-4aab-838f-08a2022c2b9d None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:29.459396 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 593/1181] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:13:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:13:29.465220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7434a8d-18bc-471e-b79e-834d6a4e263c None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:29.559386 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7434a8d-18bc-471e-b79e-834d6a4e263c None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:29.591088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687f33c-d98d-41db-8d45-652002c216ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:29.592558 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687f33c-d98d-41db-8d45-652002c216ee None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:29.592834 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687f33c-d98d-41db-8d45-652002c216ee None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:29.593104 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687f33c-d98d-41db-8d45-652002c216ee None admin] PATH_INFO: `/v3/users/3aaabc82557e4fefa2b7ccb3995e957c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:29.605501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687f33c-d98d-41db-8d45-652002c216ee None admin] RBAC: Authorizing `identity:get_user(user_id=3aaabc82557e4fefa2b7ccb3995e957c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:29.606960 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687f33c-d98d-41db-8d45-652002c216ee None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:29.608731 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 589/1182] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:13:29 2022] GET /identity/v3/users/3aaabc82557e4fefa2b7ccb3995e957c => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:13:29.614620 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01577da2-4acd-4aab-838f-08a2022c2b9d None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:29.718017 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01577da2-4acd-4aab-838f-08a2022c2b9d None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:29.752797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9892698-0907-4057-b446-752e65041b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:29.753458 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9892698-0907-4057-b446-752e65041b7f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:29.753745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9892698-0907-4057-b446-752e65041b7f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:29.754014 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9892698-0907-4057-b446-752e65041b7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:29.834006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9892698-0907-4057-b446-752e65041b7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:29.835456 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9892698-0907-4057-b446-752e65041b7f None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:29.947897 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 594/1183] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:13:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:13:29.955506 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687f33c-d98d-41db-8d45-652002c216ee None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:30.059808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687f33c-d98d-41db-8d45-652002c216ee None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:30.097865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410ef4d-123d-40cb-96e1-d26a44a0345c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:30.098636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410ef4d-123d-40cb-96e1-d26a44a0345c None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:30.098913 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410ef4d-123d-40cb-96e1-d26a44a0345c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:30.099187 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410ef4d-123d-40cb-96e1-d26a44a0345c None admin] PATH_INFO: `/v3/projects/abd0d27df5bd4d9b8ddcd329de4969e6` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:30.100421 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410ef4d-123d-40cb-96e1-d26a44a0345c None admin] RBAC: Authorizing `identity:get_project(project_id=abd0d27df5bd4d9b8ddcd329de4969e6)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:30.101865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410ef4d-123d-40cb-96e1-d26a44a0345c None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:30.103626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 590/1184] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:13:29 2022] GET /identity/v3/projects/abd0d27df5bd4d9b8ddcd329de4969e6 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:13:30.110954 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9892698-0907-4057-b446-752e65041b7f None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:30.215553 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9892698-0907-4057-b446-752e65041b7f None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:30.250002 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973e197-6732-4c27-981d-664dfa2b1dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:30.250663 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973e197-6732-4c27-981d-664dfa2b1dfa None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:30.250945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973e197-6732-4c27-981d-664dfa2b1dfa None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:30.251221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973e197-6732-4c27-981d-664dfa2b1dfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:30.252058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973e197-6732-4c27-981d-664dfa2b1dfa None admin] RBAC: Adding query filter params (role.id=6576d9225a0946de877f527e3d15db05, scope.project.id=abd0d27df5bd4d9b8ddcd329de4969e6, user.id=3aaabc82557e4fefa2b7ccb3995e957c) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:13:30.252394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973e197-6732-4c27-981d-664dfa2b1dfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:30.253846 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973e197-6732-4c27-981d-664dfa2b1dfa None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:30.260289 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 595/1185] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:13:30 2022] GET /identity/v3/role_assignments?user.id=3aaabc82557e4fefa2b7ccb3995e957c&scope.project.id=abd0d27df5bd4d9b8ddcd329de4969e6&role.id=6576d9225a0946de877f527e3d15db05 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:13:32.600975 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb0061-91b0-412b-920d-e7ef33f937d9 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:32.601564 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb0061-91b0-412b-920d-e7ef33f937d9 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:32.601564 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb0061-91b0-412b-920d-e7ef33f937d9 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:32.602878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 591/1186] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:13:32.609024 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44892bfe-e5a9-46e1-ab7e-b5b87f37a496 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:32.609459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44892bfe-e5a9-46e1-ab7e-b5b87f37a496 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:32.609556 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44892bfe-e5a9-46e1-ab7e-b5b87f37a496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:32.626360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-44892bfe-e5a9-46e1-ab7e-b5b87f37a496 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:13:32.627557 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-44892bfe-e5a9-46e1-ab7e-b5b87f37a496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:13:32.693467 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 596/1187] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:13:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:13:32.716970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb0061-91b0-412b-920d-e7ef33f937d9 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:32.823292 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb0061-91b0-412b-920d-e7ef33f937d9 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:32.856619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b2aad-f4d1-4d30-9aa6-b2641afd0522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:32.857437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b2aad-f4d1-4d30-9aa6-b2641afd0522 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:32.857715 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b2aad-f4d1-4d30-9aa6-b2641afd0522 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:32.857987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b2aad-f4d1-4d30-9aa6-b2641afd0522 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:32.867745 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b2aad-f4d1-4d30-9aa6-b2641afd0522 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:13:32.875784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-fa0b2aad-f4d1-4d30-9aa6-b2641afd0522 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:13:32.875784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:13:32.875784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:13:32.875784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:13:32.875784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:13:32.875784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:13:32.875784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:13:32.875784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:13:32.875784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:13:32.875784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:13:32.875784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:13:32.875784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:13:32.875784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:13:32.875784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:13:32.875784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:13:32.875784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:13:32.876941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:13:32.876941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:13:32.876941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:13:32.876941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:13:32.876941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:13:32.876941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:13:32.876941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:13:32.876941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:13:32.876941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:13:32.876941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:13:32.876941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:13:32.876941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:13:32.876941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:13:32.876941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:13:32.876941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:13:32.876941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:13:32.877950 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:13:32.877950 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:13:32.877950 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:13:32.877950 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:13:32.877950 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:13:32.877950 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:13:32.877950 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:13:32.877950 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:13:32.877950 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:13:32.877950 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:13:32.877950 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:13:32.877950 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:13:32.877950 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 592/1188] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:13:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:13:32.883319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44892bfe-e5a9-46e1-ab7e-b5b87f37a496 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:32.979317 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44892bfe-e5a9-46e1-ab7e-b5b87f37a496 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:33.017491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab261c-f563-4d17-826f-1a164687c523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:33.018150 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab261c-f563-4d17-826f-1a164687c523 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:33.018425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab261c-f563-4d17-826f-1a164687c523 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:33.018694 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab261c-f563-4d17-826f-1a164687c523 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:33.019421 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab261c-f563-4d17-826f-1a164687c523 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:13:33.019720 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab261c-f563-4d17-826f-1a164687c523 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:33.021105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab261c-f563-4d17-826f-1a164687c523 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:33.029463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 597/1189] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:13:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:13:33.035335 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b2aad-f4d1-4d30-9aa6-b2641afd0522 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:33.146853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b2aad-f4d1-4d30-9aa6-b2641afd0522 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:33.200614 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900fdb1-4262-47ee-9d7b-374e77d75182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:33.202193 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900fdb1-4262-47ee-9d7b-374e77d75182 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:33.202476 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900fdb1-4262-47ee-9d7b-374e77d75182 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:33.202749 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900fdb1-4262-47ee-9d7b-374e77d75182 None admin] PATH_INFO: `/v3/users/3aaabc82557e4fefa2b7ccb3995e957c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:33.203964 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900fdb1-4262-47ee-9d7b-374e77d75182 None admin] RBAC: Authorizing `identity:get_user(user_id=3aaabc82557e4fefa2b7ccb3995e957c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:33.205479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900fdb1-4262-47ee-9d7b-374e77d75182 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:33.207792 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 593/1190] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:13:33 2022] GET /identity/v3/users/3aaabc82557e4fefa2b7ccb3995e957c => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:13:33.213649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab261c-f563-4d17-826f-1a164687c523 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:33.316306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab261c-f563-4d17-826f-1a164687c523 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:33.349000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298182db-d94c-4433-99c3-31fa98954e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:33.349855 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298182db-d94c-4433-99c3-31fa98954e49 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:33.350137 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298182db-d94c-4433-99c3-31fa98954e49 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:33.350412 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298182db-d94c-4433-99c3-31fa98954e49 None admin] PATH_INFO: `/v3/projects/abd0d27df5bd4d9b8ddcd329de4969e6` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:33.351595 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298182db-d94c-4433-99c3-31fa98954e49 None admin] RBAC: Authorizing `identity:get_project(project_id=abd0d27df5bd4d9b8ddcd329de4969e6)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:33.353042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298182db-d94c-4433-99c3-31fa98954e49 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:33.354788 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 598/1191] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:13:33 2022] GET /identity/v3/projects/abd0d27df5bd4d9b8ddcd329de4969e6 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:13:33.361486 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900fdb1-4262-47ee-9d7b-374e77d75182 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:33.469724 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900fdb1-4262-47ee-9d7b-374e77d75182 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:33.514861 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e65cd3-e91b-4e1a-be27-bb50c0576015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:33.515751 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e65cd3-e91b-4e1a-be27-bb50c0576015 None admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:33.516033 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e65cd3-e91b-4e1a-be27-bb50c0576015 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:33.516338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e65cd3-e91b-4e1a-be27-bb50c0576015 None admin] PATH_INFO: `/v3/projects/abd0d27df5bd4d9b8ddcd329de4969e6/users/3aaabc82557e4fefa2b7ccb3995e957c/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:33.519056 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e65cd3-e91b-4e1a-be27-bb50c0576015 None admin] RBAC: Authorizing `identity:create_grant(project_id=abd0d27df5bd4d9b8ddcd329de4969e6, user_id=3aaabc82557e4fefa2b7ccb3995e957c, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:33.520942 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e65cd3-e91b-4e1a-be27-bb50c0576015 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:33.538349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 594/1192] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:13:33 2022] PUT /identity/v3/projects/abd0d27df5bd4d9b8ddcd329de4969e6/users/3aaabc82557e4fefa2b7ccb3995e957c/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:13:35.862590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71273c-74a6-431b-b812-ef901a9bc3d6 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:35.863141 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71273c-74a6-431b-b812-ef901a9bc3d6 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:35.863141 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71273c-74a6-431b-b812-ef901a9bc3d6 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:35.864542 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 599/1193] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:13:35.869938 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f253794-08e5-4ae4-a95e-20a672f006bd None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:35.870391 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f253794-08e5-4ae4-a95e-20a672f006bd None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:35.870497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f253794-08e5-4ae4-a95e-20a672f006bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:35.887123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-4f253794-08e5-4ae4-a95e-20a672f006bd None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:13:35.888340 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-4f253794-08e5-4ae4-a95e-20a672f006bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:13:35.957235 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 595/1194] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:13:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:13:35.981831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71273c-74a6-431b-b812-ef901a9bc3d6 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:36.086962 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71273c-74a6-431b-b812-ef901a9bc3d6 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:36.119175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae523a0-3e6c-4256-8029-a0b4ac421620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:36.119864 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae523a0-3e6c-4256-8029-a0b4ac421620 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:36.120144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae523a0-3e6c-4256-8029-a0b4ac421620 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:36.120448 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae523a0-3e6c-4256-8029-a0b4ac421620 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:36.132670 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae523a0-3e6c-4256-8029-a0b4ac421620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:13:36.141200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-0ae523a0-3e6c-4256-8029-a0b4ac421620 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:13:36.141200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:13:36.141200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:13:36.141200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:13:36.141200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:13:36.141200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:13:36.141200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:13:36.141200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:13:36.141200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:13:36.141200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:13:36.141200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:13:36.141200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:13:36.141200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:13:36.141200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:13:36.141200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:13:36.141200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:13:36.142417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:13:36.142417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:13:36.142417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:13:36.142417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:13:36.142417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:13:36.142417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:13:36.142417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:13:36.142417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:13:36.142417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:13:36.142417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:13:36.142417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:13:36.142417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:13:36.142417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:13:36.142417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:13:36.142417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:13:36.142417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:13:36.143713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:13:36.143713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:13:36.143713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:13:36.143713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:13:36.143713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:13:36.143713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:13:36.143713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:13:36.143713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:13:36.143713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:13:36.143713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:13:36.143713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:13:36.143713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:13:36.143713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 600/1195] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:13:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:13:36.148732 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f253794-08e5-4ae4-a95e-20a672f006bd None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:36.250106 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f253794-08e5-4ae4-a95e-20a672f006bd None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:36.285295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d4d33-d101-43c3-96dd-ad7f78a63d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:36.285968 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d4d33-d101-43c3-96dd-ad7f78a63d3b None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:36.286250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d4d33-d101-43c3-96dd-ad7f78a63d3b None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:36.286524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d4d33-d101-43c3-96dd-ad7f78a63d3b None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:36.287285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d4d33-d101-43c3-96dd-ad7f78a63d3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:13:36.287590 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d4d33-d101-43c3-96dd-ad7f78a63d3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:36.289035 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d4d33-d101-43c3-96dd-ad7f78a63d3b None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:36.299029 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 596/1196] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:13:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:13:36.307737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae523a0-3e6c-4256-8029-a0b4ac421620 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:36.425689 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae523a0-3e6c-4256-8029-a0b4ac421620 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:36.477127 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb7c59-c340-463a-a8e6-af56f59f15ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:36.478440 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb7c59-c340-463a-a8e6-af56f59f15ea None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:36.478960 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb7c59-c340-463a-a8e6-af56f59f15ea None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:36.479465 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb7c59-c340-463a-a8e6-af56f59f15ea None admin] PATH_INFO: `/v3/users/3aaabc82557e4fefa2b7ccb3995e957c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:36.481611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb7c59-c340-463a-a8e6-af56f59f15ea None admin] RBAC: Authorizing `identity:get_user(user_id=3aaabc82557e4fefa2b7ccb3995e957c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:36.484659 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb7c59-c340-463a-a8e6-af56f59f15ea None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:36.487055 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 601/1197] 10.222.0.71 () {56 vars in 1177 bytes} [Mon May 16 20:13:36 2022] GET /identity/v3/users/3aaabc82557e4fefa2b7ccb3995e957c => generated 311 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:13:36.493095 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d4d33-d101-43c3-96dd-ad7f78a63d3b None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:36.597690 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d4d33-d101-43c3-96dd-ad7f78a63d3b None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:36.637013 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e88f07-e61a-48fc-87de-99a07d8d3295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:36.637658 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e88f07-e61a-48fc-87de-99a07d8d3295 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:36.637961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e88f07-e61a-48fc-87de-99a07d8d3295 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:36.639817 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e88f07-e61a-48fc-87de-99a07d8d3295 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:36.709298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e88f07-e61a-48fc-87de-99a07d8d3295 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:36.710683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e88f07-e61a-48fc-87de-99a07d8d3295 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:36.817612 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 597/1198] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:13:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:13:36.823731 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb7c59-c340-463a-a8e6-af56f59f15ea None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:36.931954 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb7c59-c340-463a-a8e6-af56f59f15ea None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:36.971086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241aaffb-5f02-4b26-bddf-9eefb7cd0497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:36.971856 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241aaffb-5f02-4b26-bddf-9eefb7cd0497 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:36.972133 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241aaffb-5f02-4b26-bddf-9eefb7cd0497 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:36.972438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241aaffb-5f02-4b26-bddf-9eefb7cd0497 None admin] PATH_INFO: `/v3/projects/abd0d27df5bd4d9b8ddcd329de4969e6` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:36.973630 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241aaffb-5f02-4b26-bddf-9eefb7cd0497 None admin] RBAC: Authorizing `identity:get_project(project_id=abd0d27df5bd4d9b8ddcd329de4969e6)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:36.975056 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241aaffb-5f02-4b26-bddf-9eefb7cd0497 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:36.976810 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 602/1199] 10.222.0.71 () {56 vars in 1186 bytes} [Mon May 16 20:13:36 2022] GET /identity/v3/projects/abd0d27df5bd4d9b8ddcd329de4969e6 => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:13:36.983622 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e88f07-e61a-48fc-87de-99a07d8d3295 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:13:37.089762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e88f07-e61a-48fc-87de-99a07d8d3295 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:13:37.126350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b22e07-1033-45b0-ada8-7446dead11ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:13:37.127008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b22e07-1033-45b0-ada8-7446dead11ad None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:13:37.127286 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b22e07-1033-45b0-ada8-7446dead11ad None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:13:37.127557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b22e07-1033-45b0-ada8-7446dead11ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:13:37.128431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b22e07-1033-45b0-ada8-7446dead11ad None admin] RBAC: Adding query filter params (role.id=6576d9225a0946de877f527e3d15db05, scope.project.id=abd0d27df5bd4d9b8ddcd329de4969e6, user.id=3aaabc82557e4fefa2b7ccb3995e957c) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:13:37.128739 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b22e07-1033-45b0-ada8-7446dead11ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:13:37.130219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b22e07-1033-45b0-ada8-7446dead11ad None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:13:37.137209 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 598/1200] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:13:36 2022] GET /identity/v3/role_assignments?user.id=3aaabc82557e4fefa2b7ccb3995e957c&scope.project.id=abd0d27df5bd4d9b8ddcd329de4969e6&role.id=6576d9225a0946de877f527e3d15db05 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:14:42.097930 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7a07c-fbb8-4ed8-92aa-5b676556daa0 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:42.098690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7a07c-fbb8-4ed8-92aa-5b676556daa0 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:42.098973 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7a07c-fbb8-4ed8-92aa-5b676556daa0 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:42.101743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 603/1201] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:14:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:14:42.109410 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fae0b-6fdd-4ecd-954f-51fde1df50fb None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:42.110411 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fae0b-6fdd-4ecd-954f-51fde1df50fb None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:42.110411 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fae0b-6fdd-4ecd-954f-51fde1df50fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:42.138112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-c98fae0b-6fdd-4ecd-954f-51fde1df50fb None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:14:42.140504 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c98fae0b-6fdd-4ecd-954f-51fde1df50fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:14:42.279844 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 599/1202] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:14:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:14:42.309859 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7a07c-fbb8-4ed8-92aa-5b676556daa0 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:42.466520 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7a07c-fbb8-4ed8-92aa-5b676556daa0 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:42.523132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1a5a3-458b-4d38-8184-d2c16f21f1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:42.525170 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1a5a3-458b-4d38-8184-d2c16f21f1bf None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:42.525888 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1a5a3-458b-4d38-8184-d2c16f21f1bf None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:42.526551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1a5a3-458b-4d38-8184-d2c16f21f1bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:42.545081 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1a5a3-458b-4d38-8184-d2c16f21f1bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:42.546588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1a5a3-458b-4d38-8184-d2c16f21f1bf None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:42.572835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-26d1a5a3-458b-4d38-8184-d2c16f21f1bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:14:42.572835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:14:42.572835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:14:42.572835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:14:42.572835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:14:42.572835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:14:42.572835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:14:42.572835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:14:42.572835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:14:42.572835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:14:42.572835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:14:42.572835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:14:42.572835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:14:42.572835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:14:42.572835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:14:42.574189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:14:42.574189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:14:42.574189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:14:42.574189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:14:42.574189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:14:42.574189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:14:42.574189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:14:42.574189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:14:42.574189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:14:42.574189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:14:42.574189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:14:42.574189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:14:42.574189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:14:42.574189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:14:42.574189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:14:42.574189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:14:42.574189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:14:42.583678 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:14:42.583678 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:14:42.583678 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:14:42.583678 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:14:42.583678 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 604/1203] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:14:42.584305 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fae0b-6fdd-4ecd-954f-51fde1df50fb None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:42.735694 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fae0b-6fdd-4ecd-954f-51fde1df50fb None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:42.798623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1bfe3-3502-491b-8488-47f0c1249475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:42.799762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1bfe3-3502-491b-8488-47f0c1249475 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:42.800466 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1bfe3-3502-491b-8488-47f0c1249475 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:42.800948 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1bfe3-3502-491b-8488-47f0c1249475 None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:42.802253 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1bfe3-3502-491b-8488-47f0c1249475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:14:42.802783 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1bfe3-3502-491b-8488-47f0c1249475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:42.805116 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1bfe3-3502-491b-8488-47f0c1249475 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:42.824443 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 600/1204] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:14:42.830735 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1a5a3-458b-4d38-8184-d2c16f21f1bf None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:42.962201 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1a5a3-458b-4d38-8184-d2c16f21f1bf None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:43.007606 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcc583-5220-402c-bb9b-ce2c9d3ff2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:43.008325 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcc583-5220-402c-bb9b-ce2c9d3ff2fa None admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:43.008564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcc583-5220-402c-bb9b-ce2c9d3ff2fa None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:43.008862 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcc583-5220-402c-bb9b-ce2c9d3ff2fa None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:43.009637 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fcc583-5220-402c-bb9b-ce2c9d3ff2fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:43.011763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fcc583-5220-402c-bb9b-ce2c9d3ff2fa None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:43.048186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 605/1205] 10.222.0.71 () {60 vars in 1132 bytes} [Mon May 16 20:14:42 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:14:45.765243 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bba23-1a70-42d7-9b29-954e1d6a09e9 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:45.765857 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bba23-1a70-42d7-9b29-954e1d6a09e9 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:45.766799 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bba23-1a70-42d7-9b29-954e1d6a09e9 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:45.767724 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 601/1206] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:14:45 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:14:45.774814 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8aa4e1-2fe1-46d9-a3e0-8c2cccab594b None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:45.775376 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8aa4e1-2fe1-46d9-a3e0-8c2cccab594b None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:45.775376 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8aa4e1-2fe1-46d9-a3e0-8c2cccab594b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:45.795144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-6c8aa4e1-2fe1-46d9-a3e0-8c2cccab594b None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:14:45.796402 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-6c8aa4e1-2fe1-46d9-a3e0-8c2cccab594b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:14:45.915364 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 606/1207] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:14:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 20:14:45.940954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bba23-1a70-42d7-9b29-954e1d6a09e9 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:46.072853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bba23-1a70-42d7-9b29-954e1d6a09e9 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:46.115002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc4db5-7e64-4f75-96f2-40995160fa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:46.116031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc4db5-7e64-4f75-96f2-40995160fa29 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:46.116395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc4db5-7e64-4f75-96f2-40995160fa29 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:46.116728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc4db5-7e64-4f75-96f2-40995160fa29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:46.131961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc4db5-7e64-4f75-96f2-40995160fa29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:14:46.141970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-dcbc4db5-7e64-4f75-96f2-40995160fa29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:14:46.141970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:14:46.141970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:14:46.141970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:14:46.141970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:14:46.141970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:14:46.141970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:14:46.141970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:14:46.141970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:14:46.141970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:14:46.141970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:14:46.141970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:14:46.141970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:14:46.141970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:14:46.141970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:14:46.141970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:14:46.143111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:14:46.143111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:14:46.143111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:14:46.143111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:14:46.143111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:14:46.143111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:14:46.143111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:14:46.143111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:14:46.143111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:14:46.143111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:14:46.143111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:14:46.143111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:14:46.143111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:14:46.143111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:14:46.143111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:14:46.143111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:14:46.144037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:14:46.144037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:14:46.144037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:14:46.144037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:14:46.144037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:14:46.144037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:14:46.144037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:14:46.144037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:14:46.144037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:14:46.144037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:14:46.144037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:14:46.144037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:14:46.148970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 602/1208] 10.222.0.71 () {56 vars in 1102 bytes} [Mon May 16 20:14:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:14:46.149907 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8aa4e1-2fe1-46d9-a3e0-8c2cccab594b None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:46.296857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8aa4e1-2fe1-46d9-a3e0-8c2cccab594b None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:46.348111 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d435e-15af-46fc-834e-c57e0fe6d2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:46.348764 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d435e-15af-46fc-834e-c57e0fe6d2d2 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:46.349195 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d435e-15af-46fc-834e-c57e0fe6d2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:46.349618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d435e-15af-46fc-834e-c57e0fe6d2d2 None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:46.350456 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d435e-15af-46fc-834e-c57e0fe6d2d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:14:46.350755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d435e-15af-46fc-834e-c57e0fe6d2d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:46.352556 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d435e-15af-46fc-834e-c57e0fe6d2d2 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:46.365923 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 607/1209] 10.222.0.71 () {56 vars in 1103 bytes} [Mon May 16 20:14:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:14:46.373264 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc4db5-7e64-4f75-96f2-40995160fa29 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:46.516118 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc4db5-7e64-4f75-96f2-40995160fa29 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:46.576410 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d488d-72b4-48cd-9e48-68636bdb96e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:46.577798 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d488d-72b4-48cd-9e48-68636bdb96e9 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:46.578254 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d488d-72b4-48cd-9e48-68636bdb96e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:46.578750 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d488d-72b4-48cd-9e48-68636bdb96e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:46.599102 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d488d-72b4-48cd-9e48-68636bdb96e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:46.601833 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d488d-72b4-48cd-9e48-68636bdb96e9 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:46.638349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-f42d488d-72b4-48cd-9e48-68636bdb96e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:14:46.638349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:14:46.638349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:14:46.638349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:14:46.638349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:14:46.638349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:14:46.638349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:14:46.638349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:14:46.638349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:14:46.638349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:14:46.638349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:14:46.638349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:14:46.638349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:14:46.638349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:14:46.638349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:14:46.646892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:14:46.646892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:14:46.646892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:14:46.646892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:14:46.646892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:14:46.646892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:14:46.646892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:14:46.646892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:14:46.646892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:14:46.646892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:14:46.646892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:14:46.646892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:14:46.646892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:14:46.646892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:14:46.646892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:14:46.646892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:14:46.646892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:14:46.648360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:14:46.648360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:14:46.648360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:14:46.648360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:14:46.648360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 603/1210] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:14:46.648737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d435e-15af-46fc-834e-c57e0fe6d2d2 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:46.825198 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d435e-15af-46fc-834e-c57e0fe6d2d2 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:46.880902 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e12a8c-387e-4dbb-b2f3-d2496b416680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:46.881731 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e12a8c-387e-4dbb-b2f3-d2496b416680 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:46.882222 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e12a8c-387e-4dbb-b2f3-d2496b416680 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:46.882691 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e12a8c-387e-4dbb-b2f3-d2496b416680 None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:46.883839 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e12a8c-387e-4dbb-b2f3-d2496b416680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:14:46.884464 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e12a8c-387e-4dbb-b2f3-d2496b416680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:46.886985 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e12a8c-387e-4dbb-b2f3-d2496b416680 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:46.912220 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 608/1211] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:14:46.921961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d488d-72b4-48cd-9e48-68636bdb96e9 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:47.097585 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d488d-72b4-48cd-9e48-68636bdb96e9 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:47.168607 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d6d27-c092-45f0-acd7-bb8893dc7be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:47.169133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d6d27-c092-45f0-acd7-bb8893dc7be1 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:47.169628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d6d27-c092-45f0-acd7-bb8893dc7be1 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:47.170040 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d6d27-c092-45f0-acd7-bb8893dc7be1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:47.181550 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d6d27-c092-45f0-acd7-bb8893dc7be1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:47.183708 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d6d27-c092-45f0-acd7-bb8893dc7be1 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:47.203481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-ec4d6d27-c092-45f0-acd7-bb8893dc7be1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 20:14:47.203481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:14:47.203481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:14:47.203481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:14:47.203481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:14:47.203481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:14:47.203481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:14:47.203481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:14:47.203481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:14:47.203481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:14:47.203481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:14:47.203481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:14:47.203481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:14:47.203481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:14:47.203481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:14:47.203481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:14:47.204628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:14:47.204628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:14:47.204628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:14:47.204628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:14:47.204628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:14:47.204628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:14:47.204628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:14:47.204628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:14:47.204628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:14:47.204628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:14:47.204628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:14:47.204628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:14:47.204628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:14:47.204628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:14:47.204628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:14:47.204628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:14:47.204628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:14:47.204628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:14:47.205671 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:14:47.205671 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:14:47.205671 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:14:47.205671 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:14:47.205671 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:14:47.205671 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:14:47.205671 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:14:47.205671 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:14:47.205671 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 20:14:47.205671 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:14:47.205671 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 604/1212] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:14:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:14:47.211388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e12a8c-387e-4dbb-b2f3-d2496b416680 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:47.369700 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e12a8c-387e-4dbb-b2f3-d2496b416680 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:47.432910 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f6bfa-f7f6-4462-b950-009e31ffee2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:47.432910 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f6bfa-f7f6-4462-b950-009e31ffee2c None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:47.433724 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f6bfa-f7f6-4462-b950-009e31ffee2c None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:47.434126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f6bfa-f7f6-4462-b950-009e31ffee2c None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:47.435254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f6bfa-f7f6-4462-b950-009e31ffee2c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:14:47.435599 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f6bfa-f7f6-4462-b950-009e31ffee2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:47.437334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f6bfa-f7f6-4462-b950-009e31ffee2c None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:47.463114 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 609/1213] 10.222.0.71 () {56 vars in 1143 bytes} [Mon May 16 20:14:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:14:47.470837 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d6d27-c092-45f0-acd7-bb8893dc7be1 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:47.594133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d6d27-c092-45f0-acd7-bb8893dc7be1 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:47.633472 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc360a4c-27e1-4643-95d0-6d85f8b8a65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:47.634127 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc360a4c-27e1-4643-95d0-6d85f8b8a65a None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:47.634442 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc360a4c-27e1-4643-95d0-6d85f8b8a65a None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:47.634715 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc360a4c-27e1-4643-95d0-6d85f8b8a65a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:47.716388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc360a4c-27e1-4643-95d0-6d85f8b8a65a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:47.717876 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc360a4c-27e1-4643-95d0-6d85f8b8a65a None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:47.847634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 605/1214] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:14:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:14:47.853924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f6bfa-f7f6-4462-b950-009e31ffee2c None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:47.985509 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f6bfa-f7f6-4462-b950-009e31ffee2c None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:48.024238 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da51540-b32a-4574-bf87-562b71a68c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:48.025032 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da51540-b32a-4574-bf87-562b71a68c51 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:48.025543 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da51540-b32a-4574-bf87-562b71a68c51 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:48.025971 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da51540-b32a-4574-bf87-562b71a68c51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:48.040302 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da51540-b32a-4574-bf87-562b71a68c51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:48.042054 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da51540-b32a-4574-bf87-562b71a68c51 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:48.062502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-3da51540-b32a-4574-bf87-562b71a68c51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:14:48.062502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:14:48.062502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:14:48.062502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:14:48.062502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:14:48.062502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:14:48.062502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:14:48.062502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:14:48.062502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:14:48.062502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:14:48.062502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:14:48.062502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:14:48.062502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:14:48.062502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:14:48.062502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:14:48.063928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:14:48.063928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:14:48.063928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:14:48.063928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:14:48.063928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:14:48.063928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:14:48.063928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:14:48.063928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:14:48.063928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:14:48.063928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:14:48.063928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:14:48.063928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:14:48.063928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:14:48.063928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:14:48.063928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:14:48.063928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:14:48.063928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:14:48.065023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:14:48.065023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:14:48.065023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:14:48.065023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:14:48.065023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 610/1215] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:14:48.070059 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc360a4c-27e1-4643-95d0-6d85f8b8a65a None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:48.197405 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc360a4c-27e1-4643-95d0-6d85f8b8a65a None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:48.241832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91c663-90f9-483a-bd8b-443cfaff674f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:48.241832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91c663-90f9-483a-bd8b-443cfaff674f None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:48.241832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91c663-90f9-483a-bd8b-443cfaff674f None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:48.242186 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91c663-90f9-483a-bd8b-443cfaff674f None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:48.242750 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91c663-90f9-483a-bd8b-443cfaff674f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:14:48.243087 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91c663-90f9-483a-bd8b-443cfaff674f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:48.244632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91c663-90f9-483a-bd8b-443cfaff674f None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:48.262910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 606/1216] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:14:48.267267 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da51540-b32a-4574-bf87-562b71a68c51 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:48.422541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da51540-b32a-4574-bf87-562b71a68c51 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:48.476450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2adc6-af85-4960-be77-87a0dc5287dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:48.477661 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2adc6-af85-4960-be77-87a0dc5287dd None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:48.478208 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2adc6-af85-4960-be77-87a0dc5287dd None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:48.478712 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2adc6-af85-4960-be77-87a0dc5287dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:48.491275 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2adc6-af85-4960-be77-87a0dc5287dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:48.493122 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2adc6-af85-4960-be77-87a0dc5287dd None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:48.516340 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-f2f2adc6-af85-4960-be77-87a0dc5287dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:14:48.516340 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:14:48.516340 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:14:48.516340 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:14:48.516340 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:14:48.516340 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:14:48.516340 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:14:48.516340 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:14:48.516340 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:14:48.516340 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:14:48.516340 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:14:48.516340 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:14:48.516340 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:14:48.516340 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:14:48.516340 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:14:48.518468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:14:48.518468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:14:48.518468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:14:48.518468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:14:48.518468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:14:48.518468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:14:48.518468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:14:48.518468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:14:48.518468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:14:48.518468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:14:48.518468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:14:48.518468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:14:48.518468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:14:48.518468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:14:48.518468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:14:48.518468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:14:48.518468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:14:48.519823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:14:48.519823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:14:48.519823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:14:48.519823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:14:48.519823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:14:48.519823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:14:48.519823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:14:48.519823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:14:48.519823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 611/1217] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:14:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:14:48.527601 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91c663-90f9-483a-bd8b-443cfaff674f None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:48.707514 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91c663-90f9-483a-bd8b-443cfaff674f None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:48.763205 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8b87a-dd51-4b4e-b397-0d02b3c3d20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:48.764043 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8b87a-dd51-4b4e-b397-0d02b3c3d20c None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:48.764327 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8b87a-dd51-4b4e-b397-0d02b3c3d20c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:48.764612 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8b87a-dd51-4b4e-b397-0d02b3c3d20c None admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:48.765412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8b87a-dd51-4b4e-b397-0d02b3c3d20c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:14:48.765820 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8b87a-dd51-4b4e-b397-0d02b3c3d20c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:48.767340 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8b87a-dd51-4b4e-b397-0d02b3c3d20c None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:48.785753 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 607/1218] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:14:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:14:48.792925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2adc6-af85-4960-be77-87a0dc5287dd None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:48.935706 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2adc6-af85-4960-be77-87a0dc5287dd None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:48.973569 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062272d6-2e84-428b-83a9-fd4db9063270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:48.974217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062272d6-2e84-428b-83a9-fd4db9063270 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:48.974498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062272d6-2e84-428b-83a9-fd4db9063270 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:48.974769 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062272d6-2e84-428b-83a9-fd4db9063270 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:48.975592 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062272d6-2e84-428b-83a9-fd4db9063270 None admin] RBAC: Adding query filter params (role.id=bd4b3497427646f48a7c4d949e498ebc, scope.project.id=121ed31a143d49b3a16ac6c5c6b28955, user.id=72e2c8b4ff2349919750aa0f3f7309bd) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:14:48.975897 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062272d6-2e84-428b-83a9-fd4db9063270 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:48.977353 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062272d6-2e84-428b-83a9-fd4db9063270 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:48.984200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 612/1219] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:14:48 2022] GET /identity/v3/role_assignments?user.id=72e2c8b4ff2349919750aa0f3f7309bd&scope.project.id=121ed31a143d49b3a16ac6c5c6b28955&role.id=bd4b3497427646f48a7c4d949e498ebc => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:14:51.429314 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8ae08-908c-4738-a6e5-5beeb18a76cd None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:51.429941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8ae08-908c-4738-a6e5-5beeb18a76cd None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:51.429941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8ae08-908c-4738-a6e5-5beeb18a76cd None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:51.431503 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 608/1220] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:14:51.437769 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588db33f-9faf-470d-981d-af4282b2d67b None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:51.438344 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588db33f-9faf-470d-981d-af4282b2d67b None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:51.438344 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588db33f-9faf-470d-981d-af4282b2d67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:51.456694 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-588db33f-9faf-470d-981d-af4282b2d67b None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:14:51.457987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-588db33f-9faf-470d-981d-af4282b2d67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:14:51.544083 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 613/1221] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:14:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:14:51.570996 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8ae08-908c-4738-a6e5-5beeb18a76cd None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:51.754823 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8ae08-908c-4738-a6e5-5beeb18a76cd None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:51.820253 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6927d-c59f-4111-b072-e3bc3931a2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:51.821383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6927d-c59f-4111-b072-e3bc3931a2a5 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:51.821887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6927d-c59f-4111-b072-e3bc3931a2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:51.822360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6927d-c59f-4111-b072-e3bc3931a2a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:51.844207 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6927d-c59f-4111-b072-e3bc3931a2a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:14:51.851120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-3fa6927d-c59f-4111-b072-e3bc3931a2a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:14:51.851120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:14:51.851120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:14:51.851120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:14:51.851120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:14:51.851120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:14:51.851120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:14:51.851120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:14:51.851120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:14:51.851120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:14:51.851120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:14:51.851120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:14:51.851120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:14:51.851120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:14:51.851120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:14:51.851120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:14:51.852812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:14:51.852812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:14:51.852812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:14:51.852812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:14:51.852812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:14:51.852812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:14:51.852812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:14:51.852812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:14:51.852812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:14:51.852812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:14:51.852812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:14:51.852812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:14:51.852812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:14:51.852812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:14:51.852812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:14:51.852812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:14:51.854072 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:14:51.854072 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:14:51.854072 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:14:51.854072 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:14:51.854072 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:14:51.854072 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:14:51.854072 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:14:51.854072 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:14:51.854072 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:14:51.854072 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:14:51.854072 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:14:51.854072 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:14:51.854072 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 609/1222] 10.222.0.71 () {56 vars in 1102 bytes} [Mon May 16 20:14:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:14:51.859012 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588db33f-9faf-470d-981d-af4282b2d67b None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:51.986622 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588db33f-9faf-470d-981d-af4282b2d67b None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:52.047472 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7eb8c-524a-4550-99c1-2323b3763aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:52.048217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7eb8c-524a-4550-99c1-2323b3763aad None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:52.048506 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7eb8c-524a-4550-99c1-2323b3763aad None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:52.048806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7eb8c-524a-4550-99c1-2323b3763aad None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:52.049617 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7eb8c-524a-4550-99c1-2323b3763aad None admin] RBAC: Adding query filter params (name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:14:52.049926 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7eb8c-524a-4550-99c1-2323b3763aad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:52.051385 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7eb8c-524a-4550-99c1-2323b3763aad None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:52.061994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 614/1223] 10.222.0.71 () {56 vars in 1103 bytes} [Mon May 16 20:14:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:14:52.068291 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6927d-c59f-4111-b072-e3bc3931a2a5 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:52.211433 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6927d-c59f-4111-b072-e3bc3931a2a5 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:52.265524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02143bb4-ca1e-4b8c-a33a-8310aba99890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:52.266701 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02143bb4-ca1e-4b8c-a33a-8310aba99890 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:52.267081 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02143bb4-ca1e-4b8c-a33a-8310aba99890 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:52.267544 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02143bb4-ca1e-4b8c-a33a-8310aba99890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:52.286017 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02143bb4-ca1e-4b8c-a33a-8310aba99890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:52.289250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02143bb4-ca1e-4b8c-a33a-8310aba99890 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:52.329360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-02143bb4-ca1e-4b8c-a33a-8310aba99890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:14:52.329360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:14:52.329360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:14:52.329360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:14:52.329360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:14:52.329360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:14:52.329360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:14:52.329360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:14:52.329360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:14:52.329360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:14:52.329360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:14:52.329360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:14:52.329360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:14:52.329360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:14:52.329360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:14:52.330610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:14:52.330610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:14:52.330610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:14:52.330610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:14:52.330610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:14:52.330610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:14:52.330610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:14:52.330610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:14:52.330610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:14:52.330610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:14:52.330610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:14:52.330610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:14:52.330610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:14:52.330610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:14:52.330610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:14:52.330610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:14:52.330610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:14:52.331699 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:14:52.331699 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:14:52.331699 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:14:52.331699 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:14:52.332414 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 610/1224] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:14:52.341985 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7eb8c-524a-4550-99c1-2323b3763aad None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:52.503045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7eb8c-524a-4550-99c1-2323b3763aad None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:52.550776 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df2f37-fb43-474a-bfec-69b7f68afd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:52.551770 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df2f37-fb43-474a-bfec-69b7f68afd40 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:52.552357 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df2f37-fb43-474a-bfec-69b7f68afd40 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:52.552813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df2f37-fb43-474a-bfec-69b7f68afd40 None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:52.555273 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df2f37-fb43-474a-bfec-69b7f68afd40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:14:52.555884 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df2f37-fb43-474a-bfec-69b7f68afd40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:52.558124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df2f37-fb43-474a-bfec-69b7f68afd40 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:52.574531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 615/1225] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:14:52.581424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02143bb4-ca1e-4b8c-a33a-8310aba99890 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:52.752674 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02143bb4-ca1e-4b8c-a33a-8310aba99890 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:52.798753 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388f715-a5f4-447f-8217-7de7b8987291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:52.799539 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388f715-a5f4-447f-8217-7de7b8987291 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:52.799712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388f715-a5f4-447f-8217-7de7b8987291 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:52.799985 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388f715-a5f4-447f-8217-7de7b8987291 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:52.810677 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388f715-a5f4-447f-8217-7de7b8987291 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:52.813396 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388f715-a5f4-447f-8217-7de7b8987291 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:52.832670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-b388f715-a5f4-447f-8217-7de7b8987291 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 20:14:52.832670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:14:52.832670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:14:52.832670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:14:52.832670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:14:52.832670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:14:52.832670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:14:52.832670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:14:52.832670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:14:52.832670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:14:52.832670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:14:52.832670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:14:52.832670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:14:52.832670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:14:52.832670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:14:52.832670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:14:52.833884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:14:52.833884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:14:52.833884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:14:52.833884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:14:52.833884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:14:52.833884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:14:52.833884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:14:52.833884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:14:52.833884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:14:52.833884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:14:52.833884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:14:52.833884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:14:52.833884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:14:52.833884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:14:52.833884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:14:52.833884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:14:52.833884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:14:52.833884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:14:52.835583 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:14:52.835583 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:14:52.835583 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:14:52.835583 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:14:52.835583 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:14:52.835583 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:14:52.835583 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:14:52.835583 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:14:52.835583 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 20:14:52.835583 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:14:52.835583 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 611/1226] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:14:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:14:52.843333 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df2f37-fb43-474a-bfec-69b7f68afd40 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:52.970820 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df2f37-fb43-474a-bfec-69b7f68afd40 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:53.011352 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317227b3-9f87-4978-91cc-ec7532f53b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:53.011875 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317227b3-9f87-4978-91cc-ec7532f53b36 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:53.012178 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317227b3-9f87-4978-91cc-ec7532f53b36 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:53.012456 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317227b3-9f87-4978-91cc-ec7532f53b36 None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:53.013301 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317227b3-9f87-4978-91cc-ec7532f53b36 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:14:53.013610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317227b3-9f87-4978-91cc-ec7532f53b36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:53.015309 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317227b3-9f87-4978-91cc-ec7532f53b36 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:53.034222 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 616/1227] 10.222.0.71 () {56 vars in 1143 bytes} [Mon May 16 20:14:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:14:53.040469 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388f715-a5f4-447f-8217-7de7b8987291 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:53.192071 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388f715-a5f4-447f-8217-7de7b8987291 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:53.237674 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfedc17-e33d-4273-ab99-76a5ceabe479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:53.238481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfedc17-e33d-4273-ab99-76a5ceabe479 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:53.238765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfedc17-e33d-4273-ab99-76a5ceabe479 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:53.239028 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfedc17-e33d-4273-ab99-76a5ceabe479 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:53.255644 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfedc17-e33d-4273-ab99-76a5ceabe479 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:53.257227 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfedc17-e33d-4273-ab99-76a5ceabe479 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:53.277587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-2bfedc17-e33d-4273-ab99-76a5ceabe479 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:14:53.277587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:14:53.277587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:14:53.277587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:14:53.277587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:14:53.277587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:14:53.277587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:14:53.277587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:14:53.277587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:14:53.277587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:14:53.277587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:14:53.277587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:14:53.277587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:14:53.277587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:14:53.277587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:14:53.279382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:14:53.279382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:14:53.279382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:14:53.279382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:14:53.279382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:14:53.279382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:14:53.279382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:14:53.279382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:14:53.279382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:14:53.279382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:14:53.279382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:14:53.279382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:14:53.279382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:14:53.279382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:14:53.279382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:14:53.279382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:14:53.279382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:14:53.281062 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:14:53.281062 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:14:53.281062 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:14:53.281062 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:14:53.281062 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 612/1228] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:14:53.285691 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317227b3-9f87-4978-91cc-ec7532f53b36 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:53.410050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317227b3-9f87-4978-91cc-ec7532f53b36 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:53.459246 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84d93f-31e2-43a9-b11a-20de73202b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:53.460246 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84d93f-31e2-43a9-b11a-20de73202b50 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:53.460682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84d93f-31e2-43a9-b11a-20de73202b50 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:53.461147 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84d93f-31e2-43a9-b11a-20de73202b50 None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:53.462145 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84d93f-31e2-43a9-b11a-20de73202b50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:14:53.462584 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84d93f-31e2-43a9-b11a-20de73202b50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:53.464596 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84d93f-31e2-43a9-b11a-20de73202b50 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:53.479831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 617/1229] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:14:53.485952 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfedc17-e33d-4273-ab99-76a5ceabe479 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:53.609867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfedc17-e33d-4273-ab99-76a5ceabe479 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:53.655897 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312a38f-6d95-4e80-97b9-26f25b03897c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:53.656846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312a38f-6d95-4e80-97b9-26f25b03897c None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:53.657186 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312a38f-6d95-4e80-97b9-26f25b03897c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:53.657541 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312a38f-6d95-4e80-97b9-26f25b03897c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:53.665792 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312a38f-6d95-4e80-97b9-26f25b03897c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:53.668615 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312a38f-6d95-4e80-97b9-26f25b03897c None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:53.687240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-4312a38f-6d95-4e80-97b9-26f25b03897c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:14:53.687240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:14:53.687240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:14:53.687240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:14:53.687240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:14:53.687240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:14:53.687240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:14:53.687240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:14:53.687240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:14:53.687240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:14:53.687240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:14:53.687240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:14:53.687240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:14:53.687240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:14:53.687240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:14:53.689231 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:14:53.689231 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:14:53.689231 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:14:53.689231 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:14:53.689231 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:14:53.689231 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:14:53.689231 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:14:53.689231 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:14:53.689231 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:14:53.689231 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:14:53.689231 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:14:53.689231 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:14:53.689231 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:14:53.689231 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:14:53.689231 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:14:53.689231 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:14:53.689231 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:14:53.690603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:14:53.690603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:14:53.690603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:14:53.690603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:14:53.690603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:14:53.690603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:14:53.690603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:14:53.690603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:14:53.690603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 613/1230] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:14:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:14:53.695814 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84d93f-31e2-43a9-b11a-20de73202b50 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:53.849062 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84d93f-31e2-43a9-b11a-20de73202b50 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:53.890455 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722ea34-3da7-46c1-8b82-1c5c3bee92d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:53.891137 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722ea34-3da7-46c1-8b82-1c5c3bee92d4 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:53.891422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722ea34-3da7-46c1-8b82-1c5c3bee92d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:53.891699 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722ea34-3da7-46c1-8b82-1c5c3bee92d4 None admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:53.892547 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722ea34-3da7-46c1-8b82-1c5c3bee92d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:14:53.892859 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722ea34-3da7-46c1-8b82-1c5c3bee92d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:53.894321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722ea34-3da7-46c1-8b82-1c5c3bee92d4 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:53.908550 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 618/1231] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:14:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:14:53.914911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312a38f-6d95-4e80-97b9-26f25b03897c None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:54.037398 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312a38f-6d95-4e80-97b9-26f25b03897c None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:54.085653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2654894-a8b4-4c76-8395-195b24083075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:54.087172 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2654894-a8b4-4c76-8395-195b24083075 None admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:54.087654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2654894-a8b4-4c76-8395-195b24083075 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:54.088137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2654894-a8b4-4c76-8395-195b24083075 None admin] PATH_INFO: `/v3/projects/121ed31a143d49b3a16ac6c5c6b28955/users/72e2c8b4ff2349919750aa0f3f7309bd/roles/bd4b3497427646f48a7c4d949e498ebc` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:54.109600 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2654894-a8b4-4c76-8395-195b24083075 None admin] RBAC: Authorizing `identity:create_grant(project_id=121ed31a143d49b3a16ac6c5c6b28955, user_id=72e2c8b4ff2349919750aa0f3f7309bd, role_id=bd4b3497427646f48a7c4d949e498ebc)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:54.110988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2654894-a8b4-4c76-8395-195b24083075 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:54.123962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 614/1232] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:14:53 2022] PUT /identity/v3/projects/121ed31a143d49b3a16ac6c5c6b28955/users/72e2c8b4ff2349919750aa0f3f7309bd/roles/bd4b3497427646f48a7c4d949e498ebc => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:14:56.629167 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c8a64-3b1a-4500-8441-6042a372fc5b None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:56.629167 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c8a64-3b1a-4500-8441-6042a372fc5b None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:56.629167 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c8a64-3b1a-4500-8441-6042a372fc5b None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:56.630183 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 619/1233] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:14:56.639228 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105480b-8da2-4bb3-9117-6e80b4d9ca10 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:56.639842 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105480b-8da2-4bb3-9117-6e80b4d9ca10 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:56.639842 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105480b-8da2-4bb3-9117-6e80b4d9ca10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:56.661682 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-f105480b-8da2-4bb3-9117-6e80b4d9ca10 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:14:56.663971 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f105480b-8da2-4bb3-9117-6e80b4d9ca10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:14:56.741382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 615/1234] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:14:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:14:56.769266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c8a64-3b1a-4500-8441-6042a372fc5b None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:56.910561 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c8a64-3b1a-4500-8441-6042a372fc5b None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:56.957314 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fde33-a448-4de3-b333-5fb7d33ecfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:56.958246 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fde33-a448-4de3-b333-5fb7d33ecfe3 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:56.958524 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fde33-a448-4de3-b333-5fb7d33ecfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:56.958803 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fde33-a448-4de3-b333-5fb7d33ecfe3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:56.970751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937fde33-a448-4de3-b333-5fb7d33ecfe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:14:56.978931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-937fde33-a448-4de3-b333-5fb7d33ecfe3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 20:14:56.978931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:14:56.978931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:14:56.978931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:14:56.978931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:14:56.978931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:14:56.978931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:14:56.978931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:14:56.978931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:14:56.978931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:14:56.978931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:14:56.978931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:14:56.978931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:14:56.978931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:14:56.978931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:14:56.978931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:14:56.981037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:14:56.981037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:14:56.981037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:14:56.981037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:14:56.981037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:14:56.981037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:14:56.981037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:14:56.981037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:14:56.981037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:14:56.981037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:14:56.981037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:14:56.981037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:14:56.981037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:14:56.981037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:14:56.981037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:14:56.981037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:14:56.982164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:14:56.982164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:14:56.982164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:14:56.982164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:14:56.982164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:14:56.982164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:14:56.982164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:14:56.982164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:14:56.982164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:14:56.982164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:14:56.982164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 20:14:56.982164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:14:56.982164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 620/1235] 10.222.0.71 () {56 vars in 1102 bytes} [Mon May 16 20:14:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:14:56.986814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105480b-8da2-4bb3-9117-6e80b4d9ca10 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:57.119790 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105480b-8da2-4bb3-9117-6e80b4d9ca10 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:57.159362 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d602c9-f405-4a4a-a7a3-5b934dd84c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:57.160133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d602c9-f405-4a4a-a7a3-5b934dd84c69 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:57.160451 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d602c9-f405-4a4a-a7a3-5b934dd84c69 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:57.160782 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d602c9-f405-4a4a-a7a3-5b934dd84c69 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:57.161474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d602c9-f405-4a4a-a7a3-5b934dd84c69 None admin] RBAC: Adding query filter params (name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:14:57.161775 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d602c9-f405-4a4a-a7a3-5b934dd84c69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:57.163179 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d602c9-f405-4a4a-a7a3-5b934dd84c69 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:57.174523 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 616/1236] 10.222.0.71 () {56 vars in 1103 bytes} [Mon May 16 20:14:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:14:57.181504 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fde33-a448-4de3-b333-5fb7d33ecfe3 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:57.295303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fde33-a448-4de3-b333-5fb7d33ecfe3 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:57.334123 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b630b-2a99-4308-bcfe-20dd39cae582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:57.334966 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b630b-2a99-4308-bcfe-20dd39cae582 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:57.335313 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b630b-2a99-4308-bcfe-20dd39cae582 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:57.335593 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b630b-2a99-4308-bcfe-20dd39cae582 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:57.350038 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b630b-2a99-4308-bcfe-20dd39cae582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:57.351505 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b630b-2a99-4308-bcfe-20dd39cae582 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:57.378980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-681b630b-2a99-4308-bcfe-20dd39cae582 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:14:57.378980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:14:57.378980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:14:57.378980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:14:57.378980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:14:57.378980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:14:57.378980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:14:57.378980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:14:57.378980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:14:57.378980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:14:57.378980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:14:57.378980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:14:57.378980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:14:57.378980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:14:57.378980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:14:57.381115 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:14:57.381115 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:14:57.381115 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:14:57.381115 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:14:57.381115 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:14:57.381115 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:14:57.381115 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:14:57.381115 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:14:57.381115 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:14:57.381115 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:14:57.381115 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:14:57.381115 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:14:57.381115 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:14:57.381115 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:14:57.381115 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:14:57.381115 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:14:57.381115 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:14:57.382223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:14:57.382223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:14:57.382223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:14:57.382223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:14:57.382223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 621/1237] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:14:57.390308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d602c9-f405-4a4a-a7a3-5b934dd84c69 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:57.501152 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d602c9-f405-4a4a-a7a3-5b934dd84c69 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:57.537430 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7aa81-63b4-48a7-9a11-c8363283f440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:57.538119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7aa81-63b4-48a7-9a11-c8363283f440 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:57.538396 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7aa81-63b4-48a7-9a11-c8363283f440 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:57.538665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7aa81-63b4-48a7-9a11-c8363283f440 None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:57.539387 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7aa81-63b4-48a7-9a11-c8363283f440 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:14:57.539680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7aa81-63b4-48a7-9a11-c8363283f440 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:57.541101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7aa81-63b4-48a7-9a11-c8363283f440 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:57.553000 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 617/1238] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:14:57.559003 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b630b-2a99-4308-bcfe-20dd39cae582 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:57.672653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b630b-2a99-4308-bcfe-20dd39cae582 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:57.707470 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccda7d-ed71-4d40-9f3d-65d5e6c3ded6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:57.708310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccda7d-ed71-4d40-9f3d-65d5e6c3ded6 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:57.708596 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccda7d-ed71-4d40-9f3d-65d5e6c3ded6 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:57.708871 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccda7d-ed71-4d40-9f3d-65d5e6c3ded6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:57.716992 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccda7d-ed71-4d40-9f3d-65d5e6c3ded6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:57.718768 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccda7d-ed71-4d40-9f3d-65d5e6c3ded6 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:57.733885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-17ccda7d-ed71-4d40-9f3d-65d5e6c3ded6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 20:14:57.733885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:14:57.733885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:14:57.733885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:14:57.733885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:14:57.733885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:14:57.733885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:14:57.733885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:14:57.733885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:14:57.733885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:14:57.733885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:14:57.733885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:14:57.733885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:14:57.733885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:14:57.733885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:14:57.733885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:14:57.735060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:14:57.735060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:14:57.735060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:14:57.735060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:14:57.735060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:14:57.735060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:14:57.735060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:14:57.735060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:14:57.735060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:14:57.735060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:14:57.735060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:14:57.735060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:14:57.735060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:14:57.735060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:14:57.735060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:14:57.735060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:14:57.735060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:14:57.735060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:14:57.736496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:14:57.736496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:14:57.736496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:14:57.736496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:14:57.736496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:14:57.736496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:14:57.736496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:14:57.736496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:14:57.736496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 20:14:57.736496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:14:57.736496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 622/1239] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:14:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:14:57.740941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7aa81-63b4-48a7-9a11-c8363283f440 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:57.847121 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7aa81-63b4-48a7-9a11-c8363283f440 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:57.892629 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6209a9-11ee-47aa-aa6b-09f539f44bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:57.893307 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6209a9-11ee-47aa-aa6b-09f539f44bea None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:57.893570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6209a9-11ee-47aa-aa6b-09f539f44bea None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:57.893839 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6209a9-11ee-47aa-aa6b-09f539f44bea None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:57.894684 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6209a9-11ee-47aa-aa6b-09f539f44bea None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:14:57.894983 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6209a9-11ee-47aa-aa6b-09f539f44bea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:57.896476 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6209a9-11ee-47aa-aa6b-09f539f44bea None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:57.922877 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 618/1240] 10.222.0.71 () {56 vars in 1143 bytes} [Mon May 16 20:14:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:14:57.929017 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccda7d-ed71-4d40-9f3d-65d5e6c3ded6 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:58.046164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccda7d-ed71-4d40-9f3d-65d5e6c3ded6 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:58.084737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f333174-fbf2-44aa-92be-9478f67a0561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:58.085392 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f333174-fbf2-44aa-92be-9478f67a0561 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:58.085688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f333174-fbf2-44aa-92be-9478f67a0561 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:58.086007 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f333174-fbf2-44aa-92be-9478f67a0561 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:58.166333 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f333174-fbf2-44aa-92be-9478f67a0561 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:58.169001 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f333174-fbf2-44aa-92be-9478f67a0561 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:58.300334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 623/1241] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:14:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:14:58.306146 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6209a9-11ee-47aa-aa6b-09f539f44bea None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:58.442325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6209a9-11ee-47aa-aa6b-09f539f44bea None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:58.496512 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae67b40-0c09-4c81-b587-cd5bee14367c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:58.497314 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae67b40-0c09-4c81-b587-cd5bee14367c None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:58.497587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae67b40-0c09-4c81-b587-cd5bee14367c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:58.497868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae67b40-0c09-4c81-b587-cd5bee14367c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:58.510279 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae67b40-0c09-4c81-b587-cd5bee14367c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:58.512424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae67b40-0c09-4c81-b587-cd5bee14367c None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:58.536250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-6ae67b40-0c09-4c81-b587-cd5bee14367c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:14:58.536250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:14:58.536250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:14:58.536250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:14:58.536250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:14:58.536250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:14:58.536250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:14:58.536250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:14:58.536250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:14:58.536250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:14:58.536250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:14:58.536250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:14:58.536250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:14:58.536250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:14:58.536250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:14:58.537501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:14:58.537501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:14:58.537501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:14:58.537501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:14:58.537501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:14:58.537501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:14:58.537501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:14:58.537501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:14:58.537501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:14:58.537501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:14:58.537501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:14:58.537501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:14:58.537501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:14:58.537501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:14:58.537501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:14:58.537501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:14:58.537501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:14:58.538572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:14:58.538572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:14:58.538572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:14:58.538572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:14:58.538572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 619/1242] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:14:58.544445 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f333174-fbf2-44aa-92be-9478f67a0561 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:58.669508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f333174-fbf2-44aa-92be-9478f67a0561 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:58.708863 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d026d-4d76-4d33-99a6-1683c7510353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:58.709743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d026d-4d76-4d33-99a6-1683c7510353 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:58.709743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d026d-4d76-4d33-99a6-1683c7510353 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:58.710032 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d026d-4d76-4d33-99a6-1683c7510353 None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:58.710842 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d026d-4d76-4d33-99a6-1683c7510353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:14:58.711171 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d026d-4d76-4d33-99a6-1683c7510353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:58.712756 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d026d-4d76-4d33-99a6-1683c7510353 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:58.728855 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 624/1243] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:14:58.738464 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae67b40-0c09-4c81-b587-cd5bee14367c None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:58.909622 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae67b40-0c09-4c81-b587-cd5bee14367c None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:58.954210 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d3803-8724-4449-8bba-08b3801286b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:58.955160 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d3803-8724-4449-8bba-08b3801286b7 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:58.955527 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d3803-8724-4449-8bba-08b3801286b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:58.955850 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d3803-8724-4449-8bba-08b3801286b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:58.964658 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d3803-8724-4449-8bba-08b3801286b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:58.966954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d3803-8724-4449-8bba-08b3801286b7 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:58.989883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-473d3803-8724-4449-8bba-08b3801286b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:14:58.989883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:14:58.989883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:14:58.989883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:14:58.989883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:14:58.989883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:14:58.989883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:14:58.989883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:14:58.989883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:14:58.989883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:14:58.989883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:14:58.989883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:14:58.989883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:14:58.989883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:14:58.989883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:14:58.991054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:14:58.991054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:14:58.991054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:14:58.991054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:14:58.991054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:14:58.991054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:14:58.991054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:14:58.991054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:14:58.991054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:14:58.991054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:14:58.991054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:14:58.991054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:14:58.991054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:14:58.991054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:14:58.991054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:14:58.991054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:14:58.991054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:14:58.992075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:14:58.992075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:14:58.992075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:14:58.992075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:14:58.992075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:14:58.992075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:14:58.992075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:14:58.992075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:14:58.992075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 620/1244] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:14:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:14:58.998199 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d026d-4d76-4d33-99a6-1683c7510353 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:59.147552 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d026d-4d76-4d33-99a6-1683c7510353 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:59.196105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516e0ab-51ba-4988-8e7c-6b1249bb88d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:59.196827 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516e0ab-51ba-4988-8e7c-6b1249bb88d4 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:59.197104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516e0ab-51ba-4988-8e7c-6b1249bb88d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:59.197376 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516e0ab-51ba-4988-8e7c-6b1249bb88d4 None admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:59.198518 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516e0ab-51ba-4988-8e7c-6b1249bb88d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:14:59.199120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516e0ab-51ba-4988-8e7c-6b1249bb88d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:59.200121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516e0ab-51ba-4988-8e7c-6b1249bb88d4 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:59.216664 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 625/1245] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:14:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:14:59.223670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d3803-8724-4449-8bba-08b3801286b7 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:14:59.347715 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d3803-8724-4449-8bba-08b3801286b7 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:14:59.401893 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6036199-8c72-4e4e-a4bb-0f5dc0105dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:14:59.402661 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6036199-8c72-4e4e-a4bb-0f5dc0105dc0 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:14:59.402958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6036199-8c72-4e4e-a4bb-0f5dc0105dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:14:59.403346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6036199-8c72-4e4e-a4bb-0f5dc0105dc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:14:59.404489 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6036199-8c72-4e4e-a4bb-0f5dc0105dc0 None admin] RBAC: Adding query filter params (role.id=bd4b3497427646f48a7c4d949e498ebc, scope.project.id=121ed31a143d49b3a16ac6c5c6b28955, user.id=72e2c8b4ff2349919750aa0f3f7309bd) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:14:59.404803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6036199-8c72-4e4e-a4bb-0f5dc0105dc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:14:59.406567 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6036199-8c72-4e4e-a4bb-0f5dc0105dc0 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:14:59.414550 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 621/1246] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:14:59 2022] GET /identity/v3/role_assignments?user.id=72e2c8b4ff2349919750aa0f3f7309bd&scope.project.id=121ed31a143d49b3a16ac6c5c6b28955&role.id=bd4b3497427646f48a7c4d949e498ebc => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:15:02.179646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789683f3-8ef9-4a2e-931a-5266be46846c None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:02.180318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789683f3-8ef9-4a2e-931a-5266be46846c None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:02.180618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789683f3-8ef9-4a2e-931a-5266be46846c None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:02.182805 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 626/1247] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:15:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:15:02.188925 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fddb9-79f8-4de7-9888-260c9d3d0236 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:02.189562 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fddb9-79f8-4de7-9888-260c9d3d0236 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:02.189562 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fddb9-79f8-4de7-9888-260c9d3d0236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:02.210774 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-910fddb9-79f8-4de7-9888-260c9d3d0236 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:15:02.211910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-910fddb9-79f8-4de7-9888-260c9d3d0236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:15:02.288752 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 622/1248] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:15:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:15:02.313842 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789683f3-8ef9-4a2e-931a-5266be46846c None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:02.452676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789683f3-8ef9-4a2e-931a-5266be46846c None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:02.504031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219474a4-0cb8-4c26-9694-23bf422d0f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:02.505029 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219474a4-0cb8-4c26-9694-23bf422d0f3f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:02.505510 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219474a4-0cb8-4c26-9694-23bf422d0f3f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:02.505904 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219474a4-0cb8-4c26-9694-23bf422d0f3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:02.520778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219474a4-0cb8-4c26-9694-23bf422d0f3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:15:02.531049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-219474a4-0cb8-4c26-9694-23bf422d0f3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:15:02.531049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:15:02.531049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:15:02.531049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:15:02.531049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:15:02.531049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:15:02.531049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:15:02.531049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:15:02.531049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:15:02.531049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:15:02.531049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:15:02.531049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:15:02.531049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:15:02.531049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:15:02.531049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:15:02.531049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:15:02.533578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:15:02.533578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:15:02.533578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:15:02.533578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:15:02.533578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:15:02.533578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:15:02.533578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:15:02.533578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:15:02.533578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:15:02.533578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:15:02.533578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:15:02.533578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:15:02.533578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:15:02.533578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:15:02.533578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:15:02.533578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:15:02.534734 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:15:02.534734 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:15:02.534734 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:15:02.534734 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:15:02.534734 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:15:02.534734 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:15:02.534734 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:15:02.534734 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:15:02.534734 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:15:02.534734 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:15:02.534734 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:15:02.534734 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:15:02.534734 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 627/1249] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:15:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:15:02.538926 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fddb9-79f8-4de7-9888-260c9d3d0236 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:02.694232 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fddb9-79f8-4de7-9888-260c9d3d0236 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:02.752869 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7002b1-776c-4b64-bd7a-f199ad7304a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:02.753884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7002b1-776c-4b64-bd7a-f199ad7304a0 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:02.754320 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7002b1-776c-4b64-bd7a-f199ad7304a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:02.754763 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7002b1-776c-4b64-bd7a-f199ad7304a0 None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:02.756160 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7002b1-776c-4b64-bd7a-f199ad7304a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:15:02.756678 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7002b1-776c-4b64-bd7a-f199ad7304a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:02.759345 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7002b1-776c-4b64-bd7a-f199ad7304a0 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:02.778372 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 623/1250] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:15:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:15:02.788124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219474a4-0cb8-4c26-9694-23bf422d0f3f None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:02.933619 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219474a4-0cb8-4c26-9694-23bf422d0f3f None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:02.987093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f710ab-e55c-476e-a56f-0f9a79f01a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:02.988386 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f710ab-e55c-476e-a56f-0f9a79f01a8f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:02.988780 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f710ab-e55c-476e-a56f-0f9a79f01a8f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:02.989151 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f710ab-e55c-476e-a56f-0f9a79f01a8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:03.008676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f710ab-e55c-476e-a56f-0f9a79f01a8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:03.012134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f710ab-e55c-476e-a56f-0f9a79f01a8f None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:03.040556 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-14f710ab-e55c-476e-a56f-0f9a79f01a8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:15:03.040556 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:15:03.040556 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:15:03.040556 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:15:03.040556 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:15:03.040556 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:15:03.040556 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:15:03.040556 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:15:03.040556 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:15:03.040556 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:15:03.040556 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:15:03.040556 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:15:03.040556 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:15:03.040556 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:15:03.040556 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:15:03.041558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:15:03.041558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:15:03.041558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:15:03.041558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:15:03.041558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:15:03.041558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:15:03.041558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:15:03.041558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:15:03.041558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:15:03.041558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:15:03.041558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:15:03.041558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:15:03.041558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:15:03.041558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:15:03.041558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:15:03.041558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:15:03.041558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:15:03.044836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:15:03.044836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:15:03.044836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:15:03.044836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:15:03.044836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 628/1251] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:15:03.051427 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7002b1-776c-4b64-bd7a-f199ad7304a0 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:03.206611 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7002b1-776c-4b64-bd7a-f199ad7304a0 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:03.266049 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e0b18-0961-45e9-90b7-e61f533f8367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:03.266599 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e0b18-0961-45e9-90b7-e61f533f8367 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:03.266871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e0b18-0961-45e9-90b7-e61f533f8367 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:03.267139 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e0b18-0961-45e9-90b7-e61f533f8367 None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:03.267885 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e0b18-0961-45e9-90b7-e61f533f8367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:15:03.268352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e0b18-0961-45e9-90b7-e61f533f8367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:03.270543 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e0b18-0961-45e9-90b7-e61f533f8367 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:03.287560 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 624/1252] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:15:03.296185 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f710ab-e55c-476e-a56f-0f9a79f01a8f None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:03.446067 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f710ab-e55c-476e-a56f-0f9a79f01a8f None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:03.487102 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85961be5-ab3c-4d4c-8be9-9ecb8be7ae16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:03.488111 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85961be5-ab3c-4d4c-8be9-9ecb8be7ae16 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:03.488457 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85961be5-ab3c-4d4c-8be9-9ecb8be7ae16 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:03.488909 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85961be5-ab3c-4d4c-8be9-9ecb8be7ae16 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:03.500452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85961be5-ab3c-4d4c-8be9-9ecb8be7ae16 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:03.501994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85961be5-ab3c-4d4c-8be9-9ecb8be7ae16 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:03.521257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-85961be5-ab3c-4d4c-8be9-9ecb8be7ae16 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 20:15:03.521257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:15:03.521257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:15:03.521257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:15:03.521257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:15:03.521257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:15:03.521257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:15:03.521257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:15:03.521257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:15:03.521257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:15:03.521257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:15:03.521257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:15:03.521257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:15:03.521257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:15:03.521257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:15:03.521257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:15:03.522324 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:15:03.522324 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:15:03.522324 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:15:03.522324 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:15:03.522324 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:15:03.522324 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:15:03.522324 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:15:03.522324 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:15:03.522324 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:15:03.522324 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:15:03.522324 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:15:03.522324 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:15:03.522324 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:15:03.522324 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:15:03.522324 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:15:03.522324 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:15:03.522324 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:15:03.522324 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:15:03.523306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:15:03.523306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:15:03.523306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:15:03.523306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:15:03.523306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:15:03.523306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:15:03.523306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:15:03.523306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:15:03.523306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 20:15:03.523306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:15:03.523306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 629/1253] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:15:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:15:03.529748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e0b18-0961-45e9-90b7-e61f533f8367 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:03.665000 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e0b18-0961-45e9-90b7-e61f533f8367 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:03.707033 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd9dcf-ca46-4e57-aa97-a95079935031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:03.707803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd9dcf-ca46-4e57-aa97-a95079935031 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:03.708091 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd9dcf-ca46-4e57-aa97-a95079935031 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:03.708436 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd9dcf-ca46-4e57-aa97-a95079935031 None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:03.709511 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd9dcf-ca46-4e57-aa97-a95079935031 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:15:03.709835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd9dcf-ca46-4e57-aa97-a95079935031 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:03.711716 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd9dcf-ca46-4e57-aa97-a95079935031 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:03.738549 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 625/1254] 10.222.0.71 () {56 vars in 1143 bytes} [Mon May 16 20:15:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:15:03.744680 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85961be5-ab3c-4d4c-8be9-9ecb8be7ae16 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:03.888392 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85961be5-ab3c-4d4c-8be9-9ecb8be7ae16 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:03.934678 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3b33c-5d84-4dce-bd1c-488fc3763563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:03.936143 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3b33c-5d84-4dce-bd1c-488fc3763563 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:03.936526 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3b33c-5d84-4dce-bd1c-488fc3763563 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:03.936857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3b33c-5d84-4dce-bd1c-488fc3763563 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:04.029058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3b33c-5d84-4dce-bd1c-488fc3763563 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:04.030561 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3b33c-5d84-4dce-bd1c-488fc3763563 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:04.178936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 630/1255] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:15:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 20:15:04.188989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd9dcf-ca46-4e57-aa97-a95079935031 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:04.341335 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd9dcf-ca46-4e57-aa97-a95079935031 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:04.391120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2678b-d9b2-466d-a240-3c9f00eda0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:04.392074 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2678b-d9b2-466d-a240-3c9f00eda0c9 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:04.392465 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2678b-d9b2-466d-a240-3c9f00eda0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:04.392739 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2678b-d9b2-466d-a240-3c9f00eda0c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:04.408986 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a2678b-d9b2-466d-a240-3c9f00eda0c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:04.411168 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a2678b-d9b2-466d-a240-3c9f00eda0c9 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:04.434838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-09a2678b-d9b2-466d-a240-3c9f00eda0c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:15:04.434838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:15:04.434838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:15:04.434838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:15:04.434838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:15:04.434838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:15:04.434838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:15:04.434838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:15:04.434838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:15:04.434838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:15:04.434838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:15:04.434838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:15:04.434838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:15:04.434838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:15:04.434838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:15:04.436240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:15:04.436240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:15:04.436240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:15:04.436240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:15:04.436240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:15:04.436240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:15:04.436240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:15:04.436240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:15:04.436240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:15:04.436240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:15:04.436240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:15:04.436240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:15:04.436240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:15:04.436240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:15:04.436240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:15:04.436240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:15:04.436240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:15:04.438486 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:15:04.438486 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:15:04.438486 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:15:04.438486 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:15:04.438486 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 626/1256] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:15:04.443440 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3b33c-5d84-4dce-bd1c-488fc3763563 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:04.570015 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3b33c-5d84-4dce-bd1c-488fc3763563 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:04.620382 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359a6fa-9edb-4755-981b-3e1bb3922605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:04.621790 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359a6fa-9edb-4755-981b-3e1bb3922605 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:04.622528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359a6fa-9edb-4755-981b-3e1bb3922605 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:04.623156 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359a6fa-9edb-4755-981b-3e1bb3922605 None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:04.624848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359a6fa-9edb-4755-981b-3e1bb3922605 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:15:04.625331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359a6fa-9edb-4755-981b-3e1bb3922605 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:04.627279 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359a6fa-9edb-4755-981b-3e1bb3922605 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:04.644636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 631/1257] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:15:04.650926 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2678b-d9b2-466d-a240-3c9f00eda0c9 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:04.772138 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2678b-d9b2-466d-a240-3c9f00eda0c9 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:04.813205 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d390b7-cec6-46fb-b21a-72d9d6922776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:04.814025 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d390b7-cec6-46fb-b21a-72d9d6922776 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:04.814299 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d390b7-cec6-46fb-b21a-72d9d6922776 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:04.814564 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d390b7-cec6-46fb-b21a-72d9d6922776 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:04.821635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d390b7-cec6-46fb-b21a-72d9d6922776 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:04.823681 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d390b7-cec6-46fb-b21a-72d9d6922776 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:04.840733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-71d390b7-cec6-46fb-b21a-72d9d6922776 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:15:04.840733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:15:04.840733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:15:04.840733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:15:04.840733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:15:04.840733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:15:04.840733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:15:04.840733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:15:04.840733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:15:04.840733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:15:04.840733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:15:04.840733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:15:04.840733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:15:04.840733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:15:04.840733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:15:04.841860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:15:04.841860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:15:04.841860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:15:04.841860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:15:04.841860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:15:04.841860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:15:04.841860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:15:04.841860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:15:04.841860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:15:04.841860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:15:04.841860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:15:04.841860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:15:04.841860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:15:04.841860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:15:04.841860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:15:04.841860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:15:04.841860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:15:04.844335 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:15:04.844335 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:15:04.844335 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:15:04.844335 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:15:04.844335 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:15:04.844335 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:15:04.844335 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:15:04.844335 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:15:04.844335 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 627/1258] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:15:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:15:04.848326 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359a6fa-9edb-4755-981b-3e1bb3922605 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:04.979142 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359a6fa-9edb-4755-981b-3e1bb3922605 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:05.022715 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a18e1e-197b-4f93-8372-b439078d590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:05.023454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a18e1e-197b-4f93-8372-b439078d590f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:05.023807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a18e1e-197b-4f93-8372-b439078d590f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:05.024211 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a18e1e-197b-4f93-8372-b439078d590f None admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:05.025006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a18e1e-197b-4f93-8372-b439078d590f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:15:05.025319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a18e1e-197b-4f93-8372-b439078d590f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:05.027312 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a18e1e-197b-4f93-8372-b439078d590f None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:05.043425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 632/1259] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:15:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:15:05.049462 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d390b7-cec6-46fb-b21a-72d9d6922776 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:05.159429 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d390b7-cec6-46fb-b21a-72d9d6922776 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:05.211434 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b3853-2509-49b8-b037-ff98fa9a3631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:05.212592 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b3853-2509-49b8-b037-ff98fa9a3631 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:05.213069 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b3853-2509-49b8-b037-ff98fa9a3631 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:05.213629 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b3853-2509-49b8-b037-ff98fa9a3631 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:05.215992 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b3853-2509-49b8-b037-ff98fa9a3631 None admin] RBAC: Adding query filter params (role.id=6576d9225a0946de877f527e3d15db05, scope.project.id=121ed31a143d49b3a16ac6c5c6b28955, user.id=72e2c8b4ff2349919750aa0f3f7309bd) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:15:05.216625 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b3853-2509-49b8-b037-ff98fa9a3631 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:05.219950 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b3853-2509-49b8-b037-ff98fa9a3631 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:05.240305 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 628/1260] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:15:05 2022] GET /identity/v3/role_assignments?user.id=72e2c8b4ff2349919750aa0f3f7309bd&scope.project.id=121ed31a143d49b3a16ac6c5c6b28955&role.id=6576d9225a0946de877f527e3d15db05 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:15:07.663274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad58fb-76d4-4c4c-9887-f6ea69b4768e None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:07.664290 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad58fb-76d4-4c4c-9887-f6ea69b4768e None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:07.664290 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad58fb-76d4-4c4c-9887-f6ea69b4768e None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:07.666210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 633/1261] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:15:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:15:07.673068 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e3de1-24b4-4812-be70-c443ddf703cc None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:07.673920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e3de1-24b4-4812-be70-c443ddf703cc None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:07.674080 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e3de1-24b4-4812-be70-c443ddf703cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:07.693037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-3c4e3de1-24b4-4812-be70-c443ddf703cc None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:15:07.694264 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-3c4e3de1-24b4-4812-be70-c443ddf703cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:15:07.768781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 629/1262] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:15:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:15:07.793690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad58fb-76d4-4c4c-9887-f6ea69b4768e None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:07.900983 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad58fb-76d4-4c4c-9887-f6ea69b4768e None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:07.937660 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b55049-c852-4d32-a1d1-da70b338b820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:07.938366 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b55049-c852-4d32-a1d1-da70b338b820 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:07.938649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b55049-c852-4d32-a1d1-da70b338b820 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:07.938924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b55049-c852-4d32-a1d1-da70b338b820 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:07.949920 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b55049-c852-4d32-a1d1-da70b338b820 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:15:07.957849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-a1b55049-c852-4d32-a1d1-da70b338b820 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:15:07.957849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:15:07.957849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:15:07.957849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:15:07.957849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:15:07.957849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:15:07.957849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:15:07.957849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:15:07.957849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:15:07.957849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:15:07.957849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:15:07.957849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:15:07.957849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:15:07.957849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:15:07.957849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:15:07.957849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:15:07.958955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:15:07.958955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:15:07.958955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:15:07.958955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:15:07.958955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:15:07.958955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:15:07.958955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:15:07.958955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:15:07.958955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:15:07.958955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:15:07.958955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:15:07.958955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:15:07.958955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:15:07.958955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:15:07.958955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:15:07.958955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:15:07.959836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:15:07.959836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:15:07.959836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:15:07.959836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:15:07.959836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:15:07.959836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:15:07.959836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:15:07.959836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:15:07.959836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:15:07.959836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:15:07.959836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:15:07.959836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:15:07.959836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 634/1263] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:15:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:15:07.966679 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e3de1-24b4-4812-be70-c443ddf703cc None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:08.089431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e3de1-24b4-4812-be70-c443ddf703cc None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:08.124091 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc5c81-0e51-4bf4-9b07-5802fba01a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:08.124783 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc5c81-0e51-4bf4-9b07-5802fba01a1e None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:08.125058 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc5c81-0e51-4bf4-9b07-5802fba01a1e None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:08.125330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc5c81-0e51-4bf4-9b07-5802fba01a1e None admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:08.126077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc5c81-0e51-4bf4-9b07-5802fba01a1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:15:08.126373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc5c81-0e51-4bf4-9b07-5802fba01a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:08.127761 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc5c81-0e51-4bf4-9b07-5802fba01a1e None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:08.136860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 630/1264] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:15:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:15:08.143023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b55049-c852-4d32-a1d1-da70b338b820 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:08.247576 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b55049-c852-4d32-a1d1-da70b338b820 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:08.286549 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ccd2f-4023-4607-855a-71f859d33f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:08.287344 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ccd2f-4023-4607-855a-71f859d33f2b None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:08.287624 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ccd2f-4023-4607-855a-71f859d33f2b None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:08.287900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ccd2f-4023-4607-855a-71f859d33f2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:08.299309 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ccd2f-4023-4607-855a-71f859d33f2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:08.300828 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ccd2f-4023-4607-855a-71f859d33f2b None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:08.319797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-4e0ccd2f-4023-4607-855a-71f859d33f2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:15:08.319797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:15:08.319797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:15:08.319797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:15:08.319797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:15:08.319797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:15:08.319797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:15:08.319797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:15:08.319797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:15:08.319797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:15:08.319797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:15:08.319797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:15:08.319797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:15:08.319797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:15:08.319797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:15:08.321000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:15:08.321000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:15:08.321000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:15:08.321000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:15:08.321000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:15:08.321000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:15:08.321000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:15:08.321000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:15:08.321000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:15:08.321000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:15:08.321000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:15:08.321000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:15:08.321000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:15:08.321000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:15:08.321000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:15:08.321000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:15:08.321000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:15:08.322094 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:15:08.322094 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:15:08.322094 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:15:08.322094 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:15:08.322094 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 635/1265] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:15:08.328523 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc5c81-0e51-4bf4-9b07-5802fba01a1e None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:08.464025 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc5c81-0e51-4bf4-9b07-5802fba01a1e None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:08.503453 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0355513-ffb5-4846-aeb6-7eef496e9b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:08.504033 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0355513-ffb5-4846-aeb6-7eef496e9b2d None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:08.504346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0355513-ffb5-4846-aeb6-7eef496e9b2d None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:08.504620 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0355513-ffb5-4846-aeb6-7eef496e9b2d None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:08.505356 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0355513-ffb5-4846-aeb6-7eef496e9b2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:15:08.505660 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0355513-ffb5-4846-aeb6-7eef496e9b2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:08.507069 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0355513-ffb5-4846-aeb6-7eef496e9b2d None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:08.522667 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 631/1266] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:15:08.530469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ccd2f-4023-4607-855a-71f859d33f2b None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:08.648316 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ccd2f-4023-4607-855a-71f859d33f2b None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:08.700847 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cef76-13c6-497b-8dd6-e98e86e1be5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:08.701677 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cef76-13c6-497b-8dd6-e98e86e1be5d None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:08.701955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cef76-13c6-497b-8dd6-e98e86e1be5d None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:08.702227 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cef76-13c6-497b-8dd6-e98e86e1be5d None admin] PATH_INFO: `/v3/users/placement` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:08.711102 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3cef76-13c6-497b-8dd6-e98e86e1be5d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:08.712621 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3cef76-13c6-497b-8dd6-e98e86e1be5d None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:08.735468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-6f3cef76-13c6-497b-8dd6-e98e86e1be5d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 20:15:08.735468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:15:08.735468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:15:08.735468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:15:08.735468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:15:08.735468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:15:08.735468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:15:08.735468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:15:08.735468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:15:08.735468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:15:08.735468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:15:08.735468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:15:08.735468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:15:08.735468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:15:08.735468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:15:08.735468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:15:08.736845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:15:08.736845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:15:08.736845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:15:08.736845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:15:08.736845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:15:08.736845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:15:08.736845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:15:08.736845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:15:08.736845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:15:08.736845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:15:08.736845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:15:08.736845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:15:08.736845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:15:08.736845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:15:08.736845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:15:08.736845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:15:08.736845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:15:08.736845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:15:08.738061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:15:08.738061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:15:08.738061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:15:08.738061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:15:08.738061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:15:08.738061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:15:08.738061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:15:08.738061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:15:08.738061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 20:15:08.738061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:15:08.738061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 636/1267] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:15:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:15:08.745345 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0355513-ffb5-4846-aeb6-7eef496e9b2d None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:08.851031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0355513-ffb5-4846-aeb6-7eef496e9b2d None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:08.889010 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badae4d7-0203-4ab2-945e-8e0c9c5a765d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:08.889990 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badae4d7-0203-4ab2-945e-8e0c9c5a765d None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:08.890314 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badae4d7-0203-4ab2-945e-8e0c9c5a765d None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:08.890639 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badae4d7-0203-4ab2-945e-8e0c9c5a765d None admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:08.891534 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badae4d7-0203-4ab2-945e-8e0c9c5a765d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:15:08.891885 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badae4d7-0203-4ab2-945e-8e0c9c5a765d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:08.893432 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badae4d7-0203-4ab2-945e-8e0c9c5a765d None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:08.917442 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 632/1268] 10.222.0.71 () {56 vars in 1143 bytes} [Mon May 16 20:15:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:15:08.923895 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cef76-13c6-497b-8dd6-e98e86e1be5d None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:09.089487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cef76-13c6-497b-8dd6-e98e86e1be5d None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:09.125566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aaaf6f-005f-4446-85aa-90daad11a446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:09.126276 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aaaf6f-005f-4446-85aa-90daad11a446 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:09.126560 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aaaf6f-005f-4446-85aa-90daad11a446 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:09.126834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aaaf6f-005f-4446-85aa-90daad11a446 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:09.138859 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aaaf6f-005f-4446-85aa-90daad11a446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:09.140675 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aaaf6f-005f-4446-85aa-90daad11a446 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:09.158453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-38aaaf6f-005f-4446-85aa-90daad11a446 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:15:09.158453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:15:09.158453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:15:09.158453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:15:09.158453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:15:09.158453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:15:09.158453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:15:09.158453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:15:09.158453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:15:09.158453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:15:09.158453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:15:09.158453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:15:09.158453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:15:09.158453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:15:09.158453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:15:09.160091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:15:09.160091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:15:09.160091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:15:09.160091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:15:09.160091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:15:09.160091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:15:09.160091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:15:09.160091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:15:09.160091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:15:09.160091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:15:09.160091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:15:09.160091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:15:09.160091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:15:09.160091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:15:09.160091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:15:09.160091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:15:09.160091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:15:09.161945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:15:09.161945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:15:09.161945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:15:09.161945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:15:09.161945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 637/1269] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:15:09.166284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badae4d7-0203-4ab2-945e-8e0c9c5a765d None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:09.275838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badae4d7-0203-4ab2-945e-8e0c9c5a765d None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:09.312015 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc9316-ba7f-4dae-8feb-2f17eec5952f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:09.312704 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc9316-ba7f-4dae-8feb-2f17eec5952f None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:09.312982 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc9316-ba7f-4dae-8feb-2f17eec5952f None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:09.313252 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc9316-ba7f-4dae-8feb-2f17eec5952f None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:09.313976 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc9316-ba7f-4dae-8feb-2f17eec5952f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:15:09.314277 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc9316-ba7f-4dae-8feb-2f17eec5952f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:09.315675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc9316-ba7f-4dae-8feb-2f17eec5952f None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:09.328103 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 633/1270] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:15:09.335040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aaaf6f-005f-4446-85aa-90daad11a446 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:09.443434 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aaaf6f-005f-4446-85aa-90daad11a446 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:09.478150 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e316e1d-fa92-4759-93ad-0becaf442b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:09.478951 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e316e1d-fa92-4759-93ad-0becaf442b5e None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:09.479338 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e316e1d-fa92-4759-93ad-0becaf442b5e None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:09.480183 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e316e1d-fa92-4759-93ad-0becaf442b5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:09.487557 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e316e1d-fa92-4759-93ad-0becaf442b5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:09.489083 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e316e1d-fa92-4759-93ad-0becaf442b5e None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:09.505008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-8e316e1d-fa92-4759-93ad-0becaf442b5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:15:09.505008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:15:09.505008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:15:09.505008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:15:09.505008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:15:09.505008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:15:09.505008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:15:09.505008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:15:09.505008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:15:09.505008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:15:09.505008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:15:09.505008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:15:09.505008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:15:09.505008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:15:09.505008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:15:09.506551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:15:09.506551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:15:09.506551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:15:09.506551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:15:09.506551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:15:09.506551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:15:09.506551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:15:09.506551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:15:09.506551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:15:09.506551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:15:09.506551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:15:09.506551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:15:09.506551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:15:09.506551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:15:09.506551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:15:09.506551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:15:09.506551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:15:09.507954 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:15:09.507954 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:15:09.507954 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:15:09.507954 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:15:09.507954 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:15:09.507954 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:15:09.507954 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:15:09.507954 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:15:09.507954 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 638/1271] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:15:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:15:09.512605 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc9316-ba7f-4dae-8feb-2f17eec5952f None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:09.622245 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc9316-ba7f-4dae-8feb-2f17eec5952f None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:09.657465 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5795502-732d-4a77-a530-4014e4c2e7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:09.658123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5795502-732d-4a77-a530-4014e4c2e7bc None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:09.658397 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5795502-732d-4a77-a530-4014e4c2e7bc None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:09.658663 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5795502-732d-4a77-a530-4014e4c2e7bc None admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:09.659445 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5795502-732d-4a77-a530-4014e4c2e7bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:15:09.659746 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5795502-732d-4a77-a530-4014e4c2e7bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:09.661260 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5795502-732d-4a77-a530-4014e4c2e7bc None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:09.675286 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 634/1272] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:15:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:15:09.682483 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e316e1d-fa92-4759-93ad-0becaf442b5e None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:09.789551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e316e1d-fa92-4759-93ad-0becaf442b5e None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:09.825399 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f98ce6-9fcc-436e-8acc-a8d15dcea7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:09.826289 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f98ce6-9fcc-436e-8acc-a8d15dcea7f5 None admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:09.826565 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f98ce6-9fcc-436e-8acc-a8d15dcea7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:09.826837 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f98ce6-9fcc-436e-8acc-a8d15dcea7f5 None admin] PATH_INFO: `/v3/projects/121ed31a143d49b3a16ac6c5c6b28955/users/72e2c8b4ff2349919750aa0f3f7309bd/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:09.828956 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f98ce6-9fcc-436e-8acc-a8d15dcea7f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=121ed31a143d49b3a16ac6c5c6b28955, user_id=72e2c8b4ff2349919750aa0f3f7309bd, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:09.830415 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f98ce6-9fcc-436e-8acc-a8d15dcea7f5 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:09.846652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 639/1273] 10.222.0.71 () {58 vars in 1439 bytes} [Mon May 16 20:15:09 2022] PUT /identity/v3/projects/121ed31a143d49b3a16ac6c5c6b28955/users/72e2c8b4ff2349919750aa0f3f7309bd/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:15:12.290598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66011c-d4ff-4401-b257-3948b58ad503 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:12.291163 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66011c-d4ff-4401-b257-3948b58ad503 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:12.291163 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66011c-d4ff-4401-b257-3948b58ad503 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:12.292880 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 635/1274] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:15:12.298445 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50104af-c1cd-4231-a698-86a8aaa9e231 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:12.298928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50104af-c1cd-4231-a698-86a8aaa9e231 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:12.299036 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50104af-c1cd-4231-a698-86a8aaa9e231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:12.317174 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-a50104af-c1cd-4231-a698-86a8aaa9e231 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:15:12.318393 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-a50104af-c1cd-4231-a698-86a8aaa9e231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:15:12.402879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 640/1275] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:15:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:15:12.430327 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66011c-d4ff-4401-b257-3948b58ad503 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:12.541525 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66011c-d4ff-4401-b257-3948b58ad503 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:12.579225 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e20f1-17da-4d7e-9fb2-10e7bef318bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:12.580011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e20f1-17da-4d7e-9fb2-10e7bef318bc None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:12.580330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e20f1-17da-4d7e-9fb2-10e7bef318bc None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:12.580600 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e20f1-17da-4d7e-9fb2-10e7bef318bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:12.591791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e20f1-17da-4d7e-9fb2-10e7bef318bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 20:15:12.599633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-1a4e20f1-17da-4d7e-9fb2-10e7bef318bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:15:12.599633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:15:12.599633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:15:12.599633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:15:12.599633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:15:12.599633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:15:12.599633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:15:12.599633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:15:12.599633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:15:12.599633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:15:12.599633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:15:12.599633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:15:12.599633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 20:15:12.599633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 20:15:12.599633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 20:15:12.599633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 20:15:12.601269 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 20:15:12.601269 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 20:15:12.601269 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 20:15:12.601269 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 20:15:12.601269 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:15:12.601269 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:15:12.601269 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:15:12.601269 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:15:12.601269 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:15:12.601269 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:15:12.601269 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:15:12.601269 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:15:12.601269 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:15:12.601269 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:15:12.601269 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:15:12.601269 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:15:12.602463 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:15:12.602463 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:15:12.602463 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:15:12.602463 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:15:12.602463 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 20:15:12.602463 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 20:15:12.602463 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 20:15:12.602463 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 20:15:12.602463 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 20:15:12.602463 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 20:15:12.602463 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 20:15:12.602463 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:15:12.602463 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 636/1276] 10.222.0.71 () {56 vars in 1096 bytes} [Mon May 16 20:15:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:15:12.607524 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50104af-c1cd-4231-a698-86a8aaa9e231 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:12.717605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50104af-c1cd-4231-a698-86a8aaa9e231 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:12.753717 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f442b34-5f8a-4660-86d0-8d4de04d3bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:12.754392 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f442b34-5f8a-4660-86d0-8d4de04d3bdc None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:12.754672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f442b34-5f8a-4660-86d0-8d4de04d3bdc None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:12.754944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f442b34-5f8a-4660-86d0-8d4de04d3bdc None admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:12.755682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f442b34-5f8a-4660-86d0-8d4de04d3bdc None admin] RBAC: Adding query filter params (name=admin) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:15:12.755984 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f442b34-5f8a-4660-86d0-8d4de04d3bdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:12.757401 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f442b34-5f8a-4660-86d0-8d4de04d3bdc None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:12.766520 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 641/1277] 10.222.0.71 () {56 vars in 1099 bytes} [Mon May 16 20:15:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:15:12.772413 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e20f1-17da-4d7e-9fb2-10e7bef318bc None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:12.880896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e20f1-17da-4d7e-9fb2-10e7bef318bc None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:12.916396 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350bd61-cfdc-40de-a071-6e1b358aa44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:12.917712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350bd61-cfdc-40de-a071-6e1b358aa44c None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:12.917989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350bd61-cfdc-40de-a071-6e1b358aa44c None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:12.918275 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350bd61-cfdc-40de-a071-6e1b358aa44c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:12.928942 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350bd61-cfdc-40de-a071-6e1b358aa44c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:12.930402 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350bd61-cfdc-40de-a071-6e1b358aa44c None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:12.947741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-3350bd61-cfdc-40de-a071-6e1b358aa44c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:15:12.947741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:15:12.947741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:15:12.947741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:15:12.947741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:15:12.947741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:15:12.947741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:15:12.947741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:15:12.947741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:15:12.947741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:15:12.947741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:15:12.947741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:15:12.947741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:15:12.947741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:15:12.947741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:15:12.948851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:15:12.948851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:15:12.948851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:15:12.948851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:15:12.948851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:15:12.948851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:15:12.948851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:15:12.948851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:15:12.948851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:15:12.948851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:15:12.948851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:15:12.948851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:15:12.948851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:15:12.948851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:15:12.948851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:15:12.948851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:15:12.948851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:15:12.949769 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:15:12.949769 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:15:12.949769 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:15:12.949769 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:15:12.949769 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 637/1278] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:15:12.955778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f442b34-5f8a-4660-86d0-8d4de04d3bdc None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:13.068274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f442b34-5f8a-4660-86d0-8d4de04d3bdc None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:13.104383 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dc3ad-281d-41fa-8b59-4f5f7b683572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:13.105169 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dc3ad-281d-41fa-8b59-4f5f7b683572 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:13.105446 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dc3ad-281d-41fa-8b59-4f5f7b683572 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:13.105720 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dc3ad-281d-41fa-8b59-4f5f7b683572 None admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:13.106435 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165dc3ad-281d-41fa-8b59-4f5f7b683572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:15:13.106742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165dc3ad-281d-41fa-8b59-4f5f7b683572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:13.108100 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165dc3ad-281d-41fa-8b59-4f5f7b683572 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:13.119816 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 642/1279] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:15:13.126261 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350bd61-cfdc-40de-a071-6e1b358aa44c None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:13.227590 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350bd61-cfdc-40de-a071-6e1b358aa44c None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:13.262344 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a63e9-655e-460e-8f6c-c96eb12ec12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:13.263130 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a63e9-655e-460e-8f6c-c96eb12ec12f None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:13.263406 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a63e9-655e-460e-8f6c-c96eb12ec12f None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:13.263675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a63e9-655e-460e-8f6c-c96eb12ec12f None admin] PATH_INFO: `/v3/users/placement` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:13.271766 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a63e9-655e-460e-8f6c-c96eb12ec12f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:13.273226 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a63e9-655e-460e-8f6c-c96eb12ec12f None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:13.287561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-b64a63e9-655e-460e-8f6c-c96eb12ec12f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 20:15:13.287561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:15:13.287561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:15:13.287561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:15:13.287561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:15:13.287561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:15:13.287561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:15:13.287561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:15:13.287561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:15:13.287561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:15:13.287561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:15:13.287561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:15:13.287561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 20:15:13.287561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 20:15:13.287561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 20:15:13.287561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 20:15:13.289438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:15:13.289438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:15:13.289438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 20:15:13.289438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:15:13.289438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 20:15:13.289438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 20:15:13.289438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:15:13.289438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:15:13.289438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:15:13.289438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:15:13.289438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:15:13.289438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:15:13.289438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:15:13.289438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:15:13.289438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:15:13.289438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:15:13.289438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:15:13.289438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:15:13.291930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:15:13.291930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:15:13.291930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 20:15:13.291930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 20:15:13.291930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 20:15:13.291930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 20:15:13.291930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 20:15:13.291930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 20:15:13.291930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 20:15:13.291930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:15:13.291930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 638/1280] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:15:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:15:13.295235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dc3ad-281d-41fa-8b59-4f5f7b683572 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:13.406757 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dc3ad-281d-41fa-8b59-4f5f7b683572 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:13.450830 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d32f19-bcc8-4cbc-8bbb-f6d991bb408f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:13.451500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d32f19-bcc8-4cbc-8bbb-f6d991bb408f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:13.451779 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d32f19-bcc8-4cbc-8bbb-f6d991bb408f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:13.452048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d32f19-bcc8-4cbc-8bbb-f6d991bb408f None admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:13.452928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d32f19-bcc8-4cbc-8bbb-f6d991bb408f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:15:13.453232 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d32f19-bcc8-4cbc-8bbb-f6d991bb408f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:13.454674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d32f19-bcc8-4cbc-8bbb-f6d991bb408f None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:13.475378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 643/1281] 10.222.0.71 () {56 vars in 1143 bytes} [Mon May 16 20:15:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:15:13.483971 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a63e9-655e-460e-8f6c-c96eb12ec12f None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:13.594998 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a63e9-655e-460e-8f6c-c96eb12ec12f None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:13.631339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e5475-a097-4faa-8205-663d431a6f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:13.632121 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e5475-a097-4faa-8205-663d431a6f9b None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:13.632532 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e5475-a097-4faa-8205-663d431a6f9b None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:13.632888 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e5475-a097-4faa-8205-663d431a6f9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:13.705680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e5475-a097-4faa-8205-663d431a6f9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:13.707159 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e5475-a097-4faa-8205-663d431a6f9b None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:13.808450 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 639/1282] 10.222.0.71 () {58 vars in 1282 bytes} [Mon May 16 20:15:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 20:15:13.814252 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d32f19-bcc8-4cbc-8bbb-f6d991bb408f None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:13.916721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d32f19-bcc8-4cbc-8bbb-f6d991bb408f None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:13.952937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3691e4b-1ce2-4fa3-9042-812ae4b40dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:13.953755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3691e4b-1ce2-4fa3-9042-812ae4b40dfb None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:13.954025 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3691e4b-1ce2-4fa3-9042-812ae4b40dfb None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:13.954299 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3691e4b-1ce2-4fa3-9042-812ae4b40dfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:13.966379 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3691e4b-1ce2-4fa3-9042-812ae4b40dfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:13.967845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3691e4b-1ce2-4fa3-9042-812ae4b40dfb None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:13.986755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-c3691e4b-1ce2-4fa3-9042-812ae4b40dfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:15:13.986755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:15:13.986755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:15:13.986755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:15:13.986755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:15:13.986755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:15:13.986755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:15:13.986755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:15:13.986755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:15:13.986755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:15:13.986755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:15:13.986755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:15:13.986755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 20:15:13.986755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 20:15:13.986755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 20:15:13.988019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 20:15:13.988019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:15:13.988019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:15:13.988019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:15:13.988019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:15:13.988019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:15:13.988019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:15:13.988019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:15:13.988019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:15:13.988019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:15:13.988019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:15:13.988019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:15:13.988019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:15:13.988019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:15:13.988019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:15:13.988019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:15:13.988019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:15:13.989065 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 20:15:13.989065 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 20:15:13.989065 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 20:15:13.989065 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:15:13.989065 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 644/1283] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:15:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:15:13.994289 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e5475-a097-4faa-8205-663d431a6f9b None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:14.100662 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e5475-a097-4faa-8205-663d431a6f9b None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:14.137012 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9260df1-09ab-49ba-9ccc-e8e2c6db59fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:14.137686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9260df1-09ab-49ba-9ccc-e8e2c6db59fe None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:14.137970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9260df1-09ab-49ba-9ccc-e8e2c6db59fe None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:14.138240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9260df1-09ab-49ba-9ccc-e8e2c6db59fe None admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:14.138978 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9260df1-09ab-49ba-9ccc-e8e2c6db59fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:15:14.139281 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9260df1-09ab-49ba-9ccc-e8e2c6db59fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:14.140965 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9260df1-09ab-49ba-9ccc-e8e2c6db59fe None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:14.154251 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 640/1284] 10.222.0.71 () {56 vars in 1109 bytes} [Mon May 16 20:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:15:14.160578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3691e4b-1ce2-4fa3-9042-812ae4b40dfb None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:14.263104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3691e4b-1ce2-4fa3-9042-812ae4b40dfb None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:14.297619 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8018700-5905-4be5-bc42-967837771dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:14.298399 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8018700-5905-4be5-bc42-967837771dce None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:14.298679 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8018700-5905-4be5-bc42-967837771dce None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:14.298952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8018700-5905-4be5-bc42-967837771dce None admin] PATH_INFO: `/v3/projects/service` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:14.305927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8018700-5905-4be5-bc42-967837771dce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:14.307397 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8018700-5905-4be5-bc42-967837771dce None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:14.321645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application [None req-f8018700-5905-4be5-bc42-967837771dce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:15:14.321645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:15:14.321645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:15:14.321645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:15:14.321645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:15:14.321645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:15:14.321645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:15:14.321645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:15:14.321645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:15:14.321645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:15:14.321645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:15:14.321645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:15:14.321645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 20:15:14.321645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 20:15:14.321645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 20:15:14.322742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 20:15:14.322742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:15:14.322742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:15:14.322742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:15:14.322742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:15:14.322742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:15:14.322742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:15:14.322742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:15:14.322742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application with Lock( May 16 20:15:14.322742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:15:14.322742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._enter() May 16 20:15:14.322742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:15:14.322742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:15:14.322742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:15:14.322742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.creator() May 16 20:15:14.322742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:15:14.322742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application created_value = creator( May 16 20:15:14.324419 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 20:15:14.324419 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 20:15:14.324419 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 20:15:14.324419 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 20:15:14.324419 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 20:15:14.324419 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 20:15:14.324419 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 20:15:14.324419 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: ERROR keystone.server.flask.application May 16 20:15:14.324419 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 645/1285] 10.222.0.71 () {56 vars in 1111 bytes} [Mon May 16 20:15:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:15:14.332188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9260df1-09ab-49ba-9ccc-e8e2c6db59fe None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:14.445689 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9260df1-09ab-49ba-9ccc-e8e2c6db59fe None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:14.481027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66193a1d-ccd3-4521-b197-842dfe0f05d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:14.481692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66193a1d-ccd3-4521-b197-842dfe0f05d4 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:14.481971 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66193a1d-ccd3-4521-b197-842dfe0f05d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:14.482246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66193a1d-ccd3-4521-b197-842dfe0f05d4 None admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:14.483041 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66193a1d-ccd3-4521-b197-842dfe0f05d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:15:14.483350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66193a1d-ccd3-4521-b197-842dfe0f05d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:14.484839 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66193a1d-ccd3-4521-b197-842dfe0f05d4 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:14.498692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 641/1286] 10.222.0.71 () {56 vars in 1148 bytes} [Mon May 16 20:15:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:15:14.504832 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8018700-5905-4be5-bc42-967837771dce None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:14.604598 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8018700-5905-4be5-bc42-967837771dce None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:14.637897 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3139167-7c91-4c7c-aac0-f73b06251763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:14.638553 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3139167-7c91-4c7c-aac0-f73b06251763 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:14.638833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3139167-7c91-4c7c-aac0-f73b06251763 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:14.639108 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3139167-7c91-4c7c-aac0-f73b06251763 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:14.640274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3139167-7c91-4c7c-aac0-f73b06251763 None admin] RBAC: Adding query filter params (role.id=6576d9225a0946de877f527e3d15db05, scope.project.id=121ed31a143d49b3a16ac6c5c6b28955, user.id=72e2c8b4ff2349919750aa0f3f7309bd) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:15:14.640585 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3139167-7c91-4c7c-aac0-f73b06251763 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:14.642039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3139167-7c91-4c7c-aac0-f73b06251763 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:14.648043 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 646/1287] 10.222.0.71 () {56 vars in 1374 bytes} [Mon May 16 20:15:14 2022] GET /identity/v3/role_assignments?user.id=72e2c8b4ff2349919750aa0f3f7309bd&scope.project.id=121ed31a143d49b3a16ac6c5c6b28955&role.id=6576d9225a0946de877f527e3d15db05 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:15:16.996092 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac11501-538c-4d82-afaf-4ab63f1d0f18 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:16.996671 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac11501-538c-4d82-afaf-4ab63f1d0f18 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:16.996671 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac11501-538c-4d82-afaf-4ab63f1d0f18 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:16.998021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 642/1288] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:15:17.003515 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd536f-b132-49ca-b93e-f69dfd111aeb None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:17.004185 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd536f-b132-49ca-b93e-f69dfd111aeb None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:17.004185 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd536f-b132-49ca-b93e-f69dfd111aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:17.021186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-c3dd536f-b132-49ca-b93e-f69dfd111aeb None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:15:17.022789 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-c3dd536f-b132-49ca-b93e-f69dfd111aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:15:17.089319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 647/1289] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:15:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:15:17.112814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac11501-538c-4d82-afaf-4ab63f1d0f18 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:17.218782 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac11501-538c-4d82-afaf-4ab63f1d0f18 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:17.252475 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61c2a7-7626-478d-930a-a0d3f03e1250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:17.253185 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61c2a7-7626-478d-930a-a0d3f03e1250 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:17.253460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61c2a7-7626-478d-930a-a0d3f03e1250 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:17.253730 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61c2a7-7626-478d-930a-a0d3f03e1250 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:17.254379 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61c2a7-7626-478d-930a-a0d3f03e1250 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:17.255747 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61c2a7-7626-478d-930a-a0d3f03e1250 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:17.268865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-ba61c2a7-7626-478d-930a-a0d3f03e1250 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 20:15:17.268865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:15:17.268865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:15:17.268865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:15:17.268865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:15:17.268865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:15:17.268865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:15:17.268865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:15:17.268865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 20:15:17.268865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:15:17.268865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:15:17.268865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:15:17.268865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:15:17.268865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:15:17.268865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:15:17.268865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:15:17.268865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:15:17.270791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:15:17.270791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:15:17.270791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:15:17.270791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:15:17.270791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:15:17.270791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:15:17.270791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:15:17.270791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:15:17.270791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:15:17.270791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:15:17.270791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:15:17.270791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:15:17.270791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:15:17.270791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:15:17.270791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:15:17.270791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:15:17.272553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:15:17.272553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:15:17.272553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:15:17.272553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:15:17.272553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:15:17.272553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:15:17.272553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:15:17.272553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:15:17.272553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:15:17.272553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:15:17.272553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:15:17.272553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:15:17.272553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 20:15:17.272553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:15:17.272553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 643/1290] 10.222.0.71 () {56 vars in 1117 bytes} [Mon May 16 20:15:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 20:15:17.279293 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd536f-b132-49ca-b93e-f69dfd111aeb None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:17.391841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd536f-b132-49ca-b93e-f69dfd111aeb None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:17.439773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647f2f4-707c-45a7-b5cc-b381b5b380ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:17.440475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647f2f4-707c-45a7-b5cc-b381b5b380ae None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:17.440762 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647f2f4-707c-45a7-b5cc-b381b5b380ae None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:17.441037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647f2f4-707c-45a7-b5cc-b381b5b380ae None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:17.441758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647f2f4-707c-45a7-b5cc-b381b5b380ae None admin] RBAC: Adding query filter params (name=placement) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:15:17.442064 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647f2f4-707c-45a7-b5cc-b381b5b380ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:17.443444 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647f2f4-707c-45a7-b5cc-b381b5b380ae None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:17.449393 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 648/1291] 10.222.0.71 () {56 vars in 1116 bytes} [Mon May 16 20:15:17 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:15:17.455439 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61c2a7-7626-478d-930a-a0d3f03e1250 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:17.565999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61c2a7-7626-478d-930a-a0d3f03e1250 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:17.604005 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3e75d-2251-4afd-ba0d-b0075a1330bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:17.604821 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3e75d-2251-4afd-ba0d-b0075a1330bc None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:17.605104 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3e75d-2251-4afd-ba0d-b0075a1330bc None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:17.605456 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3e75d-2251-4afd-ba0d-b0075a1330bc None admin] PATH_INFO: `/v3/services` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:17.606296 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3e75d-2251-4afd-ba0d-b0075a1330bc None admin] RBAC: Adding query filter params (type=placement) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:15:17.606600 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3e75d-2251-4afd-ba0d-b0075a1330bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:17.607985 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3e75d-2251-4afd-ba0d-b0075a1330bc None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:17.612962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 644/1292] 10.222.0.71 () {56 vars in 1116 bytes} [Mon May 16 20:15:17 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:15:19.958280 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfc94d-8a2b-4f49-9d17-6cde4b6d632b None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:19.958838 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfc94d-8a2b-4f49-9d17-6cde4b6d632b None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:19.958838 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfc94d-8a2b-4f49-9d17-6cde4b6d632b None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:19.960213 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 649/1293] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:15:19.967145 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4e1de-4603-4076-af23-9b6ea52d41b5 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:19.967659 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4e1de-4603-4076-af23-9b6ea52d41b5 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:19.967754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4e1de-4603-4076-af23-9b6ea52d41b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:19.985973 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-65b4e1de-4603-4076-af23-9b6ea52d41b5 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:15:19.987246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-65b4e1de-4603-4076-af23-9b6ea52d41b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:15:20.057092 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 645/1294] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:15:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:15:20.081594 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfc94d-8a2b-4f49-9d17-6cde4b6d632b None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:20.185763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfc94d-8a2b-4f49-9d17-6cde4b6d632b None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:20.221309 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08c804-a258-4393-9269-985e44f09bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:20.222055 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08c804-a258-4393-9269-985e44f09bfe None admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:20.222350 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08c804-a258-4393-9269-985e44f09bfe None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:20.222625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08c804-a258-4393-9269-985e44f09bfe None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:20.223444 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08c804-a258-4393-9269-985e44f09bfe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:20.225313 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08c804-a258-4393-9269-985e44f09bfe None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:20.239500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 650/1295] 10.222.0.71 () {60 vars in 1141 bytes} [Mon May 16 20:15:20 2022] POST /identity/v3/services => generated 246 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:15:22.589005 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5aee64-93ab-4465-8ae0-a75b1be00a6f None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:22.589716 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5aee64-93ab-4465-8ae0-a75b1be00a6f None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:22.589716 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5aee64-93ab-4465-8ae0-a75b1be00a6f None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:22.591313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 646/1296] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:15:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:15:22.597422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5f93a-748c-4ff2-9dd3-e9409504a10a None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:22.597965 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5f93a-748c-4ff2-9dd3-e9409504a10a None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:22.597965 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5f93a-748c-4ff2-9dd3-e9409504a10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:22.616430 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-c6c5f93a-748c-4ff2-9dd3-e9409504a10a None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:15:22.617654 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-c6c5f93a-748c-4ff2-9dd3-e9409504a10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:15:22.694427 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 651/1297] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:15:22 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:15:22.717644 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5aee64-93ab-4465-8ae0-a75b1be00a6f None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:22.822850 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5aee64-93ab-4465-8ae0-a75b1be00a6f None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:22.857860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526dde4-5aed-4f81-8e75-0dbcf47bef58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:22.858568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526dde4-5aed-4f81-8e75-0dbcf47bef58 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:22.858843 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526dde4-5aed-4f81-8e75-0dbcf47bef58 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:22.859109 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526dde4-5aed-4f81-8e75-0dbcf47bef58 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:22.859765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526dde4-5aed-4f81-8e75-0dbcf47bef58 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:22.861200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526dde4-5aed-4f81-8e75-0dbcf47bef58 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:22.873479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-6526dde4-5aed-4f81-8e75-0dbcf47bef58 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 20:15:22.873479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:15:22.873479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:15:22.873479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:15:22.873479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:15:22.873479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:15:22.873479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:15:22.873479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:15:22.873479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 20:15:22.873479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:15:22.873479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:15:22.873479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:15:22.873479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:15:22.873479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:15:22.873479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:15:22.873479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:15:22.873479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:15:22.874856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:15:22.874856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:15:22.874856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:15:22.874856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:15:22.874856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:15:22.874856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:15:22.874856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:15:22.874856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:15:22.874856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:15:22.874856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:15:22.874856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:15:22.874856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:15:22.874856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:15:22.874856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:15:22.874856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:15:22.874856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:15:22.876174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:15:22.876174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:15:22.876174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:15:22.876174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:15:22.876174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:15:22.876174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:15:22.876174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:15:22.876174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:15:22.876174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:15:22.876174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:15:22.876174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:15:22.876174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:15:22.876174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 20:15:22.876174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:15:22.876174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 647/1298] 10.222.0.71 () {56 vars in 1117 bytes} [Mon May 16 20:15:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:15:22.880934 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5f93a-748c-4ff2-9dd3-e9409504a10a None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:22.975568 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5f93a-748c-4ff2-9dd3-e9409504a10a None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:23.007793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfa260-04ac-46ba-8ede-03f67a68c9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:23.008498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfa260-04ac-46ba-8ede-03f67a68c9a5 None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:23.008778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfa260-04ac-46ba-8ede-03f67a68c9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:23.009073 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfa260-04ac-46ba-8ede-03f67a68c9a5 None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:23.009816 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfa260-04ac-46ba-8ede-03f67a68c9a5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:15:23.010116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfa260-04ac-46ba-8ede-03f67a68c9a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:23.011725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfa260-04ac-46ba-8ede-03f67a68c9a5 None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:23.016961 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 652/1299] 10.222.0.71 () {56 vars in 1116 bytes} [Mon May 16 20:15:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:15:23.022847 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526dde4-5aed-4f81-8e75-0dbcf47bef58 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:23.119136 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526dde4-5aed-4f81-8e75-0dbcf47bef58 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:23.150319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb873326-dee7-4977-8c4d-80868b0dd554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:23.150960 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb873326-dee7-4977-8c4d-80868b0dd554 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:23.151738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb873326-dee7-4977-8c4d-80868b0dd554 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:23.152004 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb873326-dee7-4977-8c4d-80868b0dd554 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:23.152813 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb873326-dee7-4977-8c4d-80868b0dd554 None admin] RBAC: Adding query filter params (interface=public, service_id=5b7223e15f184ad5872841ed03e9f0d7, region_id=RegionOne) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:15:23.153117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb873326-dee7-4977-8c4d-80868b0dd554 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:23.154474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb873326-dee7-4977-8c4d-80868b0dd554 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:23.159336 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 648/1300] 10.222.0.71 () {56 vars in 1251 bytes} [Mon May 16 20:15:23 2022] GET /identity/v3/endpoints?service_id=5b7223e15f184ad5872841ed03e9f0d7&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:15:23.164933 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfa260-04ac-46ba-8ede-03f67a68c9a5 None admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:23.263103 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfa260-04ac-46ba-8ede-03f67a68c9a5 None admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:23.295700 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58e261-72bd-4e4e-a3bf-1b71a71a13cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:23.296381 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58e261-72bd-4e4e-a3bf-1b71a71a13cb None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:23.296670 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58e261-72bd-4e4e-a3bf-1b71a71a13cb None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:23.296942 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58e261-72bd-4e4e-a3bf-1b71a71a13cb None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:23.297614 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58e261-72bd-4e4e-a3bf-1b71a71a13cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:23.298964 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58e261-72bd-4e4e-a3bf-1b71a71a13cb None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:23.305560 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 653/1301] 10.222.0.71 () {56 vars in 1087 bytes} [Mon May 16 20:15:23 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:15:25.615557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26e3f8-aec3-4532-8940-98a8f77fb6c7 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:25.616122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26e3f8-aec3-4532-8940-98a8f77fb6c7 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:25.616122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26e3f8-aec3-4532-8940-98a8f77fb6c7 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:25.617509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 649/1302] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:15:25.623642 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8cf25-12ed-4dc9-bbe1-d90c2774006f None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:25.624217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8cf25-12ed-4dc9-bbe1-d90c2774006f None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:25.624217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8cf25-12ed-4dc9-bbe1-d90c2774006f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:25.641921 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-f3a8cf25-12ed-4dc9-bbe1-d90c2774006f None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:15:25.643104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f3a8cf25-12ed-4dc9-bbe1-d90c2774006f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:15:25.715892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 654/1303] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:15:25 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 20:15:25.740453 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26e3f8-aec3-4532-8940-98a8f77fb6c7 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:25.853915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26e3f8-aec3-4532-8940-98a8f77fb6c7 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:25.892765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522ec6c-356e-4e6f-8a32-149c06d3a360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:25.893540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522ec6c-356e-4e6f-8a32-149c06d3a360 None admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:25.893901 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522ec6c-356e-4e6f-8a32-149c06d3a360 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:25.894221 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522ec6c-356e-4e6f-8a32-149c06d3a360 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:25.894930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522ec6c-356e-4e6f-8a32-149c06d3a360 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:25.896355 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522ec6c-356e-4e6f-8a32-149c06d3a360 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:25.909537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application [None req-2522ec6c-356e-4e6f-8a32-149c06d3a360 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 20:15:25.909537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:15:25.909537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 20:15:25.909537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 20:15:25.909537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 20:15:25.909537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 20:15:25.909537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 20:15:25.909537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:15:25.909537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 20:15:25.909537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:15:25.909537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 20:15:25.909537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:15:25.909537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 20:15:25.909537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 20:15:25.909537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 20:15:25.909537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 20:15:25.909537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 20:15:25.911619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 20:15:25.911619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 20:15:25.911619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 20:15:25.911619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 20:15:25.911619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 20:15:25.911619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 20:15:25.911619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 20:15:25.911619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 20:15:25.911619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 20:15:25.911619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 20:15:25.911619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 20:15:25.911619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 20:15:25.911619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 20:15:25.911619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 20:15:25.911619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 20:15:25.911619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.get_or_create( May 16 20:15:25.913637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 20:15:25.913637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application with Lock( May 16 20:15:25.913637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 20:15:25.913637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self._enter() May 16 20:15:25.913637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 20:15:25.913637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 20:15:25.913637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 20:15:25.913637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application return self.creator() May 16 20:15:25.913637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 20:15:25.913637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application created_value = creator( May 16 20:15:25.913637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 20:15:25.913637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 20:15:25.913637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 20:15:25.913637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: ERROR keystone.server.flask.application May 16 20:15:25.913637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 650/1304] 10.222.0.71 () {56 vars in 1117 bytes} [Mon May 16 20:15:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 20:15:25.919363 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8cf25-12ed-4dc9-bbe1-d90c2774006f None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:26.019452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8cf25-12ed-4dc9-bbe1-d90c2774006f None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:26.053506 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4609a-4423-4d9f-81ee-5ade9e47165f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:26.054171 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4609a-4423-4d9f-81ee-5ade9e47165f None admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:26.054454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4609a-4423-4d9f-81ee-5ade9e47165f None admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:26.054725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4609a-4423-4d9f-81ee-5ade9e47165f None admin] PATH_INFO: `/v3/services` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:26.055445 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4609a-4423-4d9f-81ee-5ade9e47165f None admin] RBAC: Adding query filter params (name=placement) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:15:26.055750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4609a-4423-4d9f-81ee-5ade9e47165f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:26.057155 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4609a-4423-4d9f-81ee-5ade9e47165f None admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:26.063453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 655/1305] 10.222.0.71 () {56 vars in 1116 bytes} [Mon May 16 20:15:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:15:26.075573 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522ec6c-356e-4e6f-8a32-149c06d3a360 None admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:15:26.179668 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522ec6c-356e-4e6f-8a32-149c06d3a360 None admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:15:26.223650 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadfe71-0b64-4461-94aa-7e5cdd470a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:15:26.224824 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadfe71-0b64-4461-94aa-7e5cdd470a68 None admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:15:26.225174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadfe71-0b64-4461-94aa-7e5cdd470a68 None admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:15:26.225543 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadfe71-0b64-4461-94aa-7e5cdd470a68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:15:26.226945 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadfe71-0b64-4461-94aa-7e5cdd470a68 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:15:26.230372 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadfe71-0b64-4461-94aa-7e5cdd470a68 None admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:15:26.260020 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 651/1306] 10.222.0.71 () {60 vars in 1144 bytes} [Mon May 16 20:15:26 2022] POST /identity/v3/endpoints => generated 331 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:16:37.565861 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd8e28-fafc-4889-9066-ecb7613c7c84 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:16:37.566722 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd8e28-fafc-4889-9066-ecb7613c7c84 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:16:37.566722 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd8e28-fafc-4889-9066-ecb7613c7c84 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:16:37.576510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ec614-2211-4b64-b5c1-a658601b47ef None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:16:37.577478 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ec614-2211-4b64-b5c1-a658601b47ef None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:16:37.577478 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ec614-2211-4b64-b5c1-a658601b47ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:16:37.580612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 656/1307] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:16:37 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:16:37.684335 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-5b2ec614-2211-4b64-b5c1-a658601b47ef None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:16:37.685565 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-5b2ec614-2211-4b64-b5c1-a658601b47ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:16:37.836720 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 652/1308] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:16:37.901586 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45223c-49d9-4b20-9750-af83f491e9dd None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:16:37.902880 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45223c-49d9-4b20-9750-af83f491e9dd None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:16:37.903926 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45223c-49d9-4b20-9750-af83f491e9dd None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:16:37.908096 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 657/1309] 10.222.0.71 () {54 vars in 964 bytes} [Mon May 16 20:16:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:16:37.919819 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e69451-5227-45b1-8935-8c8974e75794 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:16:37.920724 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e69451-5227-45b1-8935-8c8974e75794 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:16:37.921515 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e69451-5227-45b1-8935-8c8974e75794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:16:38.046442 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-c3e69451-5227-45b1-8935-8c8974e75794 None None] MFA Rules not processed for user `eedc173e2cdc48b489ac40f3d9dccb7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:16:38.048049 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c3e69451-5227-45b1-8935-8c8974e75794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:16:38.150761 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 653/1310] 10.222.0.71 () {58 vars in 1061 bytes} [Mon May 16 20:16:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:16:38.166980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45223c-49d9-4b20-9750-af83f491e9dd None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:16:38.171892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-ae45223c-49d9-4b20-9750-af83f491e9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:16:38.390025 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45223c-49d9-4b20-9750-af83f491e9dd None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:16:38.511200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a1eb8-4706-4380-8ef0-6cde36bddc04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:16:38.511866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a1eb8-4706-4380-8ef0-6cde36bddc04 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:16:38.512170 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a1eb8-4706-4380-8ef0-6cde36bddc04 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:16:38.512618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a1eb8-4706-4380-8ef0-6cde36bddc04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:16:38.514347 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-701a1eb8-4706-4380-8ef0-6cde36bddc04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:16:38.671032 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a1eb8-4706-4380-8ef0-6cde36bddc04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:16:38.672603 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a1eb8-4706-4380-8ef0-6cde36bddc04 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:16:38.699508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 658/1311] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:16:41.847482 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd09ce-9d58-4785-9276-325b0bfd5ad4 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:16:41.848602 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd09ce-9d58-4785-9276-325b0bfd5ad4 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:16:41.848602 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd09ce-9d58-4785-9276-325b0bfd5ad4 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:16:41.850032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 654/1312] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:16:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:16:41.857632 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534b527-81b7-475e-850b-5f5a05ae11ed None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:16:41.858694 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534b527-81b7-475e-850b-5f5a05ae11ed None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:16:41.859089 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534b527-81b7-475e-850b-5f5a05ae11ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:16:41.975511 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-0534b527-81b7-475e-850b-5f5a05ae11ed None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:16:41.976973 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-0534b527-81b7-475e-850b-5f5a05ae11ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:16:42.109271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 659/1313] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:16:42.161630 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd09ce-9d58-4785-9276-325b0bfd5ad4 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:16:42.163772 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-75fd09ce-9d58-4785-9276-325b0bfd5ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:16:42.311826 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd09ce-9d58-4785-9276-325b0bfd5ad4 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:16:42.454990 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b0d62-acb6-4894-b88d-19d712ed72b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:16:42.455602 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b0d62-acb6-4894-b88d-19d712ed72b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:16:42.455981 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b0d62-acb6-4894-b88d-19d712ed72b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:16:42.456315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b0d62-acb6-4894-b88d-19d712ed72b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:16:42.458555 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-e12b0d62-acb6-4894-b88d-19d712ed72b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:16:42.638240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b0d62-acb6-4894-b88d-19d712ed72b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:16:42.641771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b0d62-acb6-4894-b88d-19d712ed72b0 service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:16:42.677486 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 655/1314] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:16:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:16:45.600559 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ac65e-00bc-4ae7-9229-69d6d02838d2 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:16:45.601274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ac65e-00bc-4ae7-9229-69d6d02838d2 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:16:45.601274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ac65e-00bc-4ae7-9229-69d6d02838d2 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:16:45.602607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 660/1315] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:16:45.609199 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03859b-b925-4130-b4c3-ea219a8b966b None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:16:45.609812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03859b-b925-4130-b4c3-ea219a8b966b None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:16:45.609812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03859b-b925-4130-b4c3-ea219a8b966b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:16:45.682613 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-bd03859b-b925-4130-b4c3-ea219a8b966b None None] MFA Rules not processed for user `485b8697788141cb873e8d65a1b6b4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:16:45.683995 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-bd03859b-b925-4130-b4c3-ea219a8b966b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:16:45.797317 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 656/1316] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:16:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:16:45.839746 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ac65e-00bc-4ae7-9229-69d6d02838d2 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:16:45.841453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-6d3ac65e-00bc-4ae7-9229-69d6d02838d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:16:45.964747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ac65e-00bc-4ae7-9229-69d6d02838d2 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:16:46.050751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be8fb3-c72e-4f93-82a9-2b61bb2d6065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:16:46.051397 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be8fb3-c72e-4f93-82a9-2b61bb2d6065 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:16:46.051676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be8fb3-c72e-4f93-82a9-2b61bb2d6065 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:16:46.051948 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be8fb3-c72e-4f93-82a9-2b61bb2d6065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:16:46.053639 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-25be8fb3-c72e-4f93-82a9-2b61bb2d6065 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:16:46.184144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be8fb3-c72e-4f93-82a9-2b61bb2d6065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:16:46.185582 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be8fb3-c72e-4f93-82a9-2b61bb2d6065 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:16:46.208864 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 661/1317] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:16:45 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:16:49.090213 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf83373-ba9d-492e-8c5a-3e3c904e0804 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:16:49.090817 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf83373-ba9d-492e-8c5a-3e3c904e0804 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:16:49.090817 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf83373-ba9d-492e-8c5a-3e3c904e0804 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:16:49.092119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 657/1318] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:16:49.097601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fe8da-03ee-478f-90de-be1408a50b6a None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:16:49.097991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fe8da-03ee-478f-90de-be1408a50b6a None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:16:49.098155 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fe8da-03ee-478f-90de-be1408a50b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:16:49.162723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-f91fe8da-03ee-478f-90de-be1408a50b6a None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:16:49.163910 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f91fe8da-03ee-478f-90de-be1408a50b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:16:49.259656 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 662/1319] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:16:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:16:49.299931 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf83373-ba9d-492e-8c5a-3e3c904e0804 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:16:49.301513 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-ecf83373-ba9d-492e-8c5a-3e3c904e0804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:16:49.411448 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf83373-ba9d-492e-8c5a-3e3c904e0804 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:16:49.487848 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a799605-956c-4160-ae89-2a25d331649f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:16:49.488519 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a799605-956c-4160-ae89-2a25d331649f service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:16:49.488798 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a799605-956c-4160-ae89-2a25d331649f service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:16:49.489069 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a799605-956c-4160-ae89-2a25d331649f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:16:49.490729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-7a799605-956c-4160-ae89-2a25d331649f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:16:49.619778 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a799605-956c-4160-ae89-2a25d331649f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:16:49.621632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a799605-956c-4160-ae89-2a25d331649f service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:16:49.643950 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 658/1320] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:16:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:16:52.922392 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080fde4-125a-4f26-83b3-1d3ac159452c None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:16:52.923014 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080fde4-125a-4f26-83b3-1d3ac159452c None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:16:52.923014 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080fde4-125a-4f26-83b3-1d3ac159452c None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:16:52.924608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 663/1321] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:16:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:16:52.930492 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5c2a2-4afc-4a8b-8996-e355c479835a None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:16:52.931070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5c2a2-4afc-4a8b-8996-e355c479835a None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:16:52.931070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5c2a2-4afc-4a8b-8996-e355c479835a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:16:53.002529 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-fea5c2a2-4afc-4a8b-8996-e355c479835a None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:16:53.003751 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-fea5c2a2-4afc-4a8b-8996-e355c479835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:16:53.116797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 659/1322] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:16:53.170790 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbeb83-b8f8-4a05-aea4-69ee1b615edb None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:16:53.171112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbeb83-b8f8-4a05-aea4-69ee1b615edb None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:16:53.171379 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbeb83-b8f8-4a05-aea4-69ee1b615edb None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:16:53.172903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 664/1323] 10.222.0.71 () {54 vars in 964 bytes} [Mon May 16 20:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:16:53.180123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422fdfb-378c-412a-bea8-2606d4d6aef2 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:16:53.180434 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422fdfb-378c-412a-bea8-2606d4d6aef2 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:16:53.180711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422fdfb-378c-412a-bea8-2606d4d6aef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:16:53.266901 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-9422fdfb-378c-412a-bea8-2606d4d6aef2 None None] MFA Rules not processed for user `eedc173e2cdc48b489ac40f3d9dccb7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:16:53.268120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-9422fdfb-378c-412a-bea8-2606d4d6aef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:16:53.359434 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 660/1324] 10.222.0.71 () {58 vars in 1061 bytes} [Mon May 16 20:16:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:16:53.369063 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbeb83-b8f8-4a05-aea4-69ee1b615edb None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:16:53.372875 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-a8cbeb83-b8f8-4a05-aea4-69ee1b615edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:16:53.528494 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbeb83-b8f8-4a05-aea4-69ee1b615edb None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:16:53.636330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee770b-e8cf-43d1-ab81-2e9f1e1caa03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:16:53.637231 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee770b-e8cf-43d1-ab81-2e9f1e1caa03 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:16:53.637670 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee770b-e8cf-43d1-ab81-2e9f1e1caa03 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:16:53.638126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee770b-e8cf-43d1-ab81-2e9f1e1caa03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:16:53.640090 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-dfee770b-e8cf-43d1-ab81-2e9f1e1caa03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:16:53.781826 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee770b-e8cf-43d1-ab81-2e9f1e1caa03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:16:53.783451 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee770b-e8cf-43d1-ab81-2e9f1e1caa03 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:16:53.806527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 665/1325] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:16:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:16:56.685076 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a5320-8abf-4c3b-9408-8fe41d1fd049 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:16:56.685673 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a5320-8abf-4c3b-9408-8fe41d1fd049 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:16:56.685673 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a5320-8abf-4c3b-9408-8fe41d1fd049 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:16:56.687035 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 661/1326] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:16:56.692770 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8bf66-38c7-404c-a772-507097f77af3 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:16:56.693458 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8bf66-38c7-404c-a772-507097f77af3 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:16:56.693458 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8bf66-38c7-404c-a772-507097f77af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:16:56.777773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-25c8bf66-38c7-404c-a772-507097f77af3 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:16:56.779181 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-25c8bf66-38c7-404c-a772-507097f77af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:16:56.910998 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 666/1327] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:16:56.974697 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a5320-8abf-4c3b-9408-8fe41d1fd049 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:16:56.976324 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-a95a5320-8abf-4c3b-9408-8fe41d1fd049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:16:57.121433 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a5320-8abf-4c3b-9408-8fe41d1fd049 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:16:57.236372 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40660c-3000-4ae4-bedd-992b33353919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:16:57.237456 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40660c-3000-4ae4-bedd-992b33353919 service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:16:57.237929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40660c-3000-4ae4-bedd-992b33353919 service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:16:57.238394 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40660c-3000-4ae4-bedd-992b33353919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:16:57.242084 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-2d40660c-3000-4ae4-bedd-992b33353919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:16:57.393000 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40660c-3000-4ae4-bedd-992b33353919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:16:57.394493 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40660c-3000-4ae4-bedd-992b33353919 service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:16:57.417719 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 662/1328] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:16:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:17:00.051482 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3137bf3-4692-4831-9ca5-7735a54aacb1 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:00.052365 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3137bf3-4692-4831-9ca5-7735a54aacb1 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:00.052365 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3137bf3-4692-4831-9ca5-7735a54aacb1 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:00.053788 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 667/1329] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:17:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:17:00.063640 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11c20d-022d-4641-ab6d-2befa24e72f3 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:00.064524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11c20d-022d-4641-ab6d-2befa24e72f3 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:00.064804 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11c20d-022d-4641-ab6d-2befa24e72f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:00.145385 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-1e11c20d-022d-4641-ab6d-2befa24e72f3 None None] MFA Rules not processed for user `485b8697788141cb873e8d65a1b6b4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:17:00.146660 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-1e11c20d-022d-4641-ab6d-2befa24e72f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:00.271592 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 663/1330] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:17:00 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:17:00.312058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3137bf3-4692-4831-9ca5-7735a54aacb1 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:17:00.313877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-d3137bf3-4692-4831-9ca5-7735a54aacb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:00.457993 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3137bf3-4692-4831-9ca5-7735a54aacb1 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:17:00.552436 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face94c2-e39f-4045-9e48-715b9fbc8626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:17:00.553107 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face94c2-e39f-4045-9e48-715b9fbc8626 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:00.553394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face94c2-e39f-4045-9e48-715b9fbc8626 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:00.553668 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face94c2-e39f-4045-9e48-715b9fbc8626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:00.555556 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-face94c2-e39f-4045-9e48-715b9fbc8626 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:00.696948 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face94c2-e39f-4045-9e48-715b9fbc8626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:17:00.699430 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face94c2-e39f-4045-9e48-715b9fbc8626 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:17:00.727460 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 668/1331] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:17:00 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:17:03.663299 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbfc4f-a389-4860-9464-cd9cda8c5c26 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:03.663924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbfc4f-a389-4860-9464-cd9cda8c5c26 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:03.663924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbfc4f-a389-4860-9464-cd9cda8c5c26 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:03.665360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 664/1332] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:17:03.671496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4cd37-f707-4f37-a359-234d87dd983b None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:03.672060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4cd37-f707-4f37-a359-234d87dd983b None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:03.672394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4cd37-f707-4f37-a359-234d87dd983b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:03.773643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-b8f4cd37-f707-4f37-a359-234d87dd983b None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:17:03.775783 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-b8f4cd37-f707-4f37-a359-234d87dd983b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:03.900196 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 669/1333] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:17:03.939359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbfc4f-a389-4860-9464-cd9cda8c5c26 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:17:03.941125 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-7cdbfc4f-a389-4860-9464-cd9cda8c5c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:04.068911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbfc4f-a389-4860-9464-cd9cda8c5c26 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:17:04.155683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aaaac6-0c1e-42e5-8693-26c2817b9b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:17:04.156279 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaaac6-0c1e-42e5-8693-26c2817b9b3d service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:04.156558 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaaac6-0c1e-42e5-8693-26c2817b9b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:04.156825 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaaac6-0c1e-42e5-8693-26c2817b9b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:04.158675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-78aaaac6-0c1e-42e5-8693-26c2817b9b3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:04.318382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aaaac6-0c1e-42e5-8693-26c2817b9b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:17:04.319847 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aaaac6-0c1e-42e5-8693-26c2817b9b3d service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:17:04.341494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 665/1334] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:17:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:17:06.948584 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dcda8-e047-475f-92ea-bd2c69bd8849 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:06.949436 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dcda8-e047-475f-92ea-bd2c69bd8849 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:06.949436 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dcda8-e047-475f-92ea-bd2c69bd8849 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:06.950645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 670/1335] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:17:06.956807 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52c8fc-30eb-435d-baa0-eada5191a30f None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:06.957342 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52c8fc-30eb-435d-baa0-eada5191a30f None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:06.957342 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52c8fc-30eb-435d-baa0-eada5191a30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:07.040643 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-aa52c8fc-30eb-435d-baa0-eada5191a30f None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:17:07.042928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-aa52c8fc-30eb-435d-baa0-eada5191a30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:07.155162 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 666/1336] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:17:07.197985 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dcda8-e047-475f-92ea-bd2c69bd8849 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:17:07.199665 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-fb4dcda8-e047-475f-92ea-bd2c69bd8849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:07.308913 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dcda8-e047-475f-92ea-bd2c69bd8849 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:17:07.383267 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93770f67-d1a3-4b58-8c1d-06d5e9e895b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:17:07.383918 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93770f67-d1a3-4b58-8c1d-06d5e9e895b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:07.384231 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93770f67-d1a3-4b58-8c1d-06d5e9e895b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:07.384512 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93770f67-d1a3-4b58-8c1d-06d5e9e895b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:07.386518 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-93770f67-d1a3-4b58-8c1d-06d5e9e895b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:07.505713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93770f67-d1a3-4b58-8c1d-06d5e9e895b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:17:07.507070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93770f67-d1a3-4b58-8c1d-06d5e9e895b1 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:17:07.527736 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 671/1337] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:17:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:17:10.321165 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c91baa-fe67-40ac-b6f9-db7eaaa9936d None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:10.321986 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c91baa-fe67-40ac-b6f9-db7eaaa9936d None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:10.322156 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c91baa-fe67-40ac-b6f9-db7eaaa9936d None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:10.324770 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 667/1338] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:17:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:17:10.330480 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4b214-1f7e-4d9e-97a4-60f3920591d3 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:10.330983 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4b214-1f7e-4d9e-97a4-60f3920591d3 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:10.331102 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4b214-1f7e-4d9e-97a4-60f3920591d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:10.410947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-adf4b214-1f7e-4d9e-97a4-60f3920591d3 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:17:10.412207 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-adf4b214-1f7e-4d9e-97a4-60f3920591d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:10.536409 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 672/1339] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:17:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:17:10.575666 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c91baa-fe67-40ac-b6f9-db7eaaa9936d None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:17:10.577889 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f1c91baa-fe67-40ac-b6f9-db7eaaa9936d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:10.683414 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c91baa-fe67-40ac-b6f9-db7eaaa9936d None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:17:10.687028 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f000ba-424a-4216-a4ef-d27b3880591f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:17:10.687668 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f000ba-424a-4216-a4ef-d27b3880591f service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:10.687948 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f000ba-424a-4216-a4ef-d27b3880591f service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:10.688251 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f000ba-424a-4216-a4ef-d27b3880591f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:10.698456 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f000ba-424a-4216-a4ef-d27b3880591f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:17:10.699909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f000ba-424a-4216-a4ef-d27b3880591f service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:17:10.710009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 668/1340] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:17:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:17:15.191525 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16e746-bc08-4d48-b7a4-fb4f6c4365b6 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:15.192496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16e746-bc08-4d48-b7a4-fb4f6c4365b6 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:15.192931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16e746-bc08-4d48-b7a4-fb4f6c4365b6 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:15.194742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 673/1341] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:17:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:17:15.201073 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fa22c-9df2-43ec-9f27-e72abc649ab0 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:15.201553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fa22c-9df2-43ec-9f27-e72abc649ab0 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:15.201793 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fa22c-9df2-43ec-9f27-e72abc649ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:15.248246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-778fa22c-9df2-43ec-9f27-e72abc649ab0 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:17:15.250121 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-778fa22c-9df2-43ec-9f27-e72abc649ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:15.338001 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 669/1342] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:17:15.380531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16e746-bc08-4d48-b7a4-fb4f6c4365b6 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:17:15.382890 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-7f16e746-bc08-4d48-b7a4-fb4f6c4365b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:15.396951 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16e746-bc08-4d48-b7a4-fb4f6c4365b6 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:17:15.401154 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0b712-9f01-433f-8ec8-0bfa4a280e92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:17:15.401812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0b712-9f01-433f-8ec8-0bfa4a280e92 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:15.402089 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0b712-9f01-433f-8ec8-0bfa4a280e92 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:15.402362 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0b712-9f01-433f-8ec8-0bfa4a280e92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:15.412337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0b712-9f01-433f-8ec8-0bfa4a280e92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:17:15.413909 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0b712-9f01-433f-8ec8-0bfa4a280e92 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:17:15.424926 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 674/1343] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:17:18.687120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fd694-3d59-4974-a3c3-f81b50bc1bda None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:18.687698 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fd694-3d59-4974-a3c3-f81b50bc1bda None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:18.688221 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fd694-3d59-4974-a3c3-f81b50bc1bda None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:18.690643 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 670/1344] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:17:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:17:18.700225 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac4890-c35b-4033-846b-dae880e492f7 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:18.700760 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac4890-c35b-4033-846b-dae880e492f7 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:18.701129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac4890-c35b-4033-846b-dae880e492f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:18.719085 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-f2ac4890-c35b-4033-846b-dae880e492f7 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:17:18.720413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f2ac4890-c35b-4033-846b-dae880e492f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:18.728929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 675/1345] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:17:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:17:18.775321 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fd694-3d59-4974-a3c3-f81b50bc1bda None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:17:18.779754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fd694-3d59-4974-a3c3-f81b50bc1bda None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:17:18.783468 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cd6d9-f468-47e7-b005-18b4abb8d7ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:17:18.784886 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cd6d9-f468-47e7-b005-18b4abb8d7ea service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:18.784886 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cd6d9-f468-47e7-b005-18b4abb8d7ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:18.784886 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cd6d9-f468-47e7-b005-18b4abb8d7ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:18.795367 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664cd6d9-f468-47e7-b005-18b4abb8d7ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:17:18.796861 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664cd6d9-f468-47e7-b005-18b4abb8d7ea service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:17:18.808488 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 671/1346] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:17:18 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:17:23.508693 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b15ba-3ffc-4f98-a003-236f7a689cda None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:23.509218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b15ba-3ffc-4f98-a003-236f7a689cda None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:23.509218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b15ba-3ffc-4f98-a003-236f7a689cda None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:23.510675 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 676/1347] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:17:23.516234 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f622823-47f6-4b0e-9501-a7537363edd0 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:23.516731 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f622823-47f6-4b0e-9501-a7537363edd0 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:23.516841 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f622823-47f6-4b0e-9501-a7537363edd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:23.534921 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-6f622823-47f6-4b0e-9501-a7537363edd0 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:17:23.536087 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-6f622823-47f6-4b0e-9501-a7537363edd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:23.544724 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 672/1348] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:17:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:17:23.582074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b15ba-3ffc-4f98-a003-236f7a689cda None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:17:23.593330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b15ba-3ffc-4f98-a003-236f7a689cda None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:17:23.596957 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e73595-3cb8-4e79-9645-50fe92dcb086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:17:23.597677 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e73595-3cb8-4e79-9645-50fe92dcb086 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:23.598015 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e73595-3cb8-4e79-9645-50fe92dcb086 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:23.598354 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e73595-3cb8-4e79-9645-50fe92dcb086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:23.608342 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e73595-3cb8-4e79-9645-50fe92dcb086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:17:23.609827 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e73595-3cb8-4e79-9645-50fe92dcb086 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:17:23.619840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 677/1349] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:17:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:17:29.221377 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781c579-35ec-40a3-ac93-f62653407a9a None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:29.222239 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781c579-35ec-40a3-ac93-f62653407a9a None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:29.222700 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781c579-35ec-40a3-ac93-f62653407a9a None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:29.225332 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 673/1350] 10.222.0.71 () {54 vars in 921 bytes} [Mon May 16 20:17:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:17:29.231431 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5727267-19a9-4443-8a30-4cfbcd1515d3 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:29.234912 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5727267-19a9-4443-8a30-4cfbcd1515d3 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:29.235567 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5727267-19a9-4443-8a30-4cfbcd1515d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:29.324943 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-d5727267-19a9-4443-8a30-4cfbcd1515d3 None None] MFA Rules not processed for user `72e2c8b4ff2349919750aa0f3f7309bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:17:29.326763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-d5727267-19a9-4443-8a30-4cfbcd1515d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:29.431219 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 678/1351] 10.222.0.71 () {58 vars in 1018 bytes} [Mon May 16 20:17:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:17:33.721368 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85476998-41c5-4ef1-a671-a555f72067e0 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:33.722358 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85476998-41c5-4ef1-a671-a555f72067e0 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:33.722358 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85476998-41c5-4ef1-a671-a555f72067e0 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:33.723537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 674/1352] 10.222.0.71 () {54 vars in 921 bytes} [Mon May 16 20:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:17:33.729284 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4ed28-39d0-4ccc-9fa1-907abd0372d9 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:33.730050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4ed28-39d0-4ccc-9fa1-907abd0372d9 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:33.730050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4ed28-39d0-4ccc-9fa1-907abd0372d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:33.749500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-10e4ed28-39d0-4ccc-9fa1-907abd0372d9 None None] MFA Rules not processed for user `72e2c8b4ff2349919750aa0f3f7309bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:17:33.750704 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-10e4ed28-39d0-4ccc-9fa1-907abd0372d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:33.761425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 679/1353] 10.222.0.71 () {58 vars in 1018 bytes} [Mon May 16 20:17:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:17:35.488839 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59b2c1-beb6-4dc8-b4cc-9deffd1ea57a None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:35.489349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59b2c1-beb6-4dc8-b4cc-9deffd1ea57a None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:35.489349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59b2c1-beb6-4dc8-b4cc-9deffd1ea57a None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:35.490685 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 675/1354] 10.222.0.71 () {54 vars in 921 bytes} [Mon May 16 20:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:17:35.496208 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91afdf-68e7-4809-b2ed-97cb29d3b4f2 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:35.496688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91afdf-68e7-4809-b2ed-97cb29d3b4f2 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:35.496767 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91afdf-68e7-4809-b2ed-97cb29d3b4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:35.516644 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-3b91afdf-68e7-4809-b2ed-97cb29d3b4f2 None None] MFA Rules not processed for user `72e2c8b4ff2349919750aa0f3f7309bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:17:35.518081 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-3b91afdf-68e7-4809-b2ed-97cb29d3b4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:35.528745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 680/1355] 10.222.0.71 () {58 vars in 1018 bytes} [Mon May 16 20:17:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:17:39.733691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5f16a-861a-4dc6-af9b-0f95ed0f2561 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:39.734227 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5f16a-861a-4dc6-af9b-0f95ed0f2561 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:39.734227 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5f16a-861a-4dc6-af9b-0f95ed0f2561 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:39.735599 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 676/1356] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:17:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:17:39.742353 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4efe9-7426-4258-bbfe-6a9e5ba19e5d None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:39.742894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4efe9-7426-4258-bbfe-6a9e5ba19e5d None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:39.742894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4efe9-7426-4258-bbfe-6a9e5ba19e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:39.769110 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-4ac4efe9-7426-4258-bbfe-6a9e5ba19e5d None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:17:39.770549 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-4ac4efe9-7426-4258-bbfe-6a9e5ba19e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:39.781208 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 681/1357] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:17:39.837633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0c495-5253-4b9b-af8a-45dd6c3c7081 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:39.838141 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0c495-5253-4b9b-af8a-45dd6c3c7081 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:39.844271 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0c495-5253-4b9b-af8a-45dd6c3c7081 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:39.844271 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 677/1358] 10.222.0.71 () {54 vars in 961 bytes} [Mon May 16 20:17:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:17:39.847896 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45195d7-8fd5-4dda-9036-63a9ed6bb9c0 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:39.848592 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45195d7-8fd5-4dda-9036-63a9ed6bb9c0 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:39.849088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45195d7-8fd5-4dda-9036-63a9ed6bb9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:39.932470 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-e45195d7-8fd5-4dda-9036-63a9ed6bb9c0 None None] MFA Rules not processed for user `242d4f9634a74013af05f50981280864`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:17:39.933588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-e45195d7-8fd5-4dda-9036-63a9ed6bb9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:40.037503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 682/1359] 10.222.0.71 () {58 vars in 1058 bytes} [Mon May 16 20:17:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:17:40.046055 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0c495-5253-4b9b-af8a-45dd6c3c7081 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:17:40.062676 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0c495-5253-4b9b-af8a-45dd6c3c7081 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:17:40.070218 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0db431-d5c2-4822-a9d6-50b006abc0ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:17:40.071165 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0db431-d5c2-4822-a9d6-50b006abc0ff service nova] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:40.071639 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0db431-d5c2-4822-a9d6-50b006abc0ff service nova] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:40.072090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0db431-d5c2-4822-a9d6-50b006abc0ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:40.081917 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0db431-d5c2-4822-a9d6-50b006abc0ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:17:40.083828 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0db431-d5c2-4822-a9d6-50b006abc0ff service nova] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:17:40.095039 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 678/1360] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:17:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:17:42.606956 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e406c-3f07-4012-8433-114bcf4bc0a1 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:42.607545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e406c-3f07-4012-8433-114bcf4bc0a1 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:42.607545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e406c-3f07-4012-8433-114bcf4bc0a1 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:42.608879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 683/1361] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:17:42.614261 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c503dc-c3e3-4ca7-ae1b-1cb488503859 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:42.614754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c503dc-c3e3-4ca7-ae1b-1cb488503859 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:42.614848 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c503dc-c3e3-4ca7-ae1b-1cb488503859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:42.634745 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-e1c503dc-c3e3-4ca7-ae1b-1cb488503859 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:17:42.636167 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-e1c503dc-c3e3-4ca7-ae1b-1cb488503859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:42.650501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 679/1362] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:17:42.699572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e406c-3f07-4012-8433-114bcf4bc0a1 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:17:42.715740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e406c-3f07-4012-8433-114bcf4bc0a1 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:17:42.721389 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a133be4-333f-40c3-ada9-a8262b0786d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:17:42.722063 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a133be4-333f-40c3-ada9-a8262b0786d5 service nova] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:42.722350 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a133be4-333f-40c3-ada9-a8262b0786d5 service nova] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:42.722628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a133be4-333f-40c3-ada9-a8262b0786d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:42.732312 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a133be4-333f-40c3-ada9-a8262b0786d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:17:42.733918 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a133be4-333f-40c3-ada9-a8262b0786d5 service nova] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:17:42.744984 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 684/1363] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:17:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:17:45.345333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23943651-3916-44de-96cc-c50e9add08c0 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:45.346024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23943651-3916-44de-96cc-c50e9add08c0 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:45.346024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23943651-3916-44de-96cc-c50e9add08c0 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:45.347361 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 680/1364] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:17:45.352750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff10eb9-b692-4f4e-9957-6fc8e5ed4086 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:45.353721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff10eb9-b692-4f4e-9957-6fc8e5ed4086 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:45.354009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff10eb9-b692-4f4e-9957-6fc8e5ed4086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:45.372463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-dff10eb9-b692-4f4e-9957-6fc8e5ed4086 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:17:45.373652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-dff10eb9-b692-4f4e-9957-6fc8e5ed4086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:45.381403 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 685/1365] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:17:45.428652 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1f5c1-14ac-4560-b03c-87453f144c3b None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:45.429021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1f5c1-14ac-4560-b03c-87453f144c3b None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:45.429369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1f5c1-14ac-4560-b03c-87453f144c3b None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:45.430811 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 681/1366] 10.222.0.71 () {54 vars in 961 bytes} [Mon May 16 20:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:17:45.438270 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97c1c2-3f2b-49f2-9a6b-1e2aafd26c6c None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:45.438270 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97c1c2-3f2b-49f2-9a6b-1e2aafd26c6c None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:45.438950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97c1c2-3f2b-49f2-9a6b-1e2aafd26c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:45.458511 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-3b97c1c2-3f2b-49f2-9a6b-1e2aafd26c6c None None] MFA Rules not processed for user `242d4f9634a74013af05f50981280864`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:17:45.459707 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-3b97c1c2-3f2b-49f2-9a6b-1e2aafd26c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:45.469310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 686/1367] 10.222.0.71 () {58 vars in 1058 bytes} [Mon May 16 20:17:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:17:45.477196 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1f5c1-14ac-4560-b03c-87453f144c3b None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:17:45.494053 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1f5c1-14ac-4560-b03c-87453f144c3b None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:17:45.499778 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e93f2-560e-4403-a9c8-30869ec773d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:17:45.500583 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e93f2-560e-4403-a9c8-30869ec773d6 service nova] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:45.500860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e93f2-560e-4403-a9c8-30869ec773d6 service nova] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:45.501128 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e93f2-560e-4403-a9c8-30869ec773d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:45.510535 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e93f2-560e-4403-a9c8-30869ec773d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:17:45.512126 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e93f2-560e-4403-a9c8-30869ec773d6 service nova] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:17:45.522209 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 682/1368] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:17:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:17:47.887790 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6e2b5-475c-4444-bbfd-affb9616ee32 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:47.888365 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6e2b5-475c-4444-bbfd-affb9616ee32 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:47.888472 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6e2b5-475c-4444-bbfd-affb9616ee32 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:47.889850 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 687/1369] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:17:47.895483 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7c4c6-1d00-4643-8b9d-d13868f19ba8 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:47.895979 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7c4c6-1d00-4643-8b9d-d13868f19ba8 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:47.896074 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7c4c6-1d00-4643-8b9d-d13868f19ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:47.914414 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-19a7c4c6-1d00-4643-8b9d-d13868f19ba8 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:17:47.916903 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-19a7c4c6-1d00-4643-8b9d-d13868f19ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:47.926309 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 683/1370] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:17:47.973088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6e2b5-475c-4444-bbfd-affb9616ee32 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:17:47.990419 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6e2b5-475c-4444-bbfd-affb9616ee32 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:17:47.996810 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d88cc0-99bf-4549-bd8f-615fc18ef9f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:17:47.997463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d88cc0-99bf-4549-bd8f-615fc18ef9f8 service nova] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:47.997743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d88cc0-99bf-4549-bd8f-615fc18ef9f8 service nova] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:47.998014 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d88cc0-99bf-4549-bd8f-615fc18ef9f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:48.006905 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d88cc0-99bf-4549-bd8f-615fc18ef9f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:17:48.008525 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d88cc0-99bf-4549-bd8f-615fc18ef9f8 service nova] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:17:48.019272 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 688/1371] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:17:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:17:48.349136 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577f49b-489b-43af-938c-a4762cee93fd None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:48.350025 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577f49b-489b-43af-938c-a4762cee93fd None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:48.350418 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577f49b-489b-43af-938c-a4762cee93fd None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:48.352648 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 684/1372] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:17:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:17:48.358846 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e81523-a010-4ddc-aa45-1e9b9c711dde None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:48.359656 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e81523-a010-4ddc-aa45-1e9b9c711dde None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:48.359837 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e81523-a010-4ddc-aa45-1e9b9c711dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:48.385863 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-e3e81523-a010-4ddc-aa45-1e9b9c711dde None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:17:48.387976 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-e3e81523-a010-4ddc-aa45-1e9b9c711dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:48.404206 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 689/1373] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:17:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:17:48.730709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483adbd7-8e92-4739-92c6-3b1e575d1377 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:48.731004 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483adbd7-8e92-4739-92c6-3b1e575d1377 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:48.731263 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483adbd7-8e92-4739-92c6-3b1e575d1377 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:48.732800 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 685/1374] 10.222.0.71 () {54 vars in 963 bytes} [Mon May 16 20:17:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:17:48.737829 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698632f-eaec-4c7d-aef6-c0528fac7634 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:48.738128 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698632f-eaec-4c7d-aef6-c0528fac7634 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:48.738409 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698632f-eaec-4c7d-aef6-c0528fac7634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:48.791983 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-1698632f-eaec-4c7d-aef6-c0528fac7634 None None] MFA Rules not processed for user `89f45690463c48ad8e95c167be6fc9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:17:48.793219 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-1698632f-eaec-4c7d-aef6-c0528fac7634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:48.855665 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 690/1375] 10.222.0.71 () {58 vars in 1060 bytes} [Mon May 16 20:17:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:17:48.863872 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483adbd7-8e92-4739-92c6-3b1e575d1377 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:17:48.876211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483adbd7-8e92-4739-92c6-3b1e575d1377 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:17:48.880021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0221136-4f18-481b-8fc9-5bd89b3a8dad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:17:48.880693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0221136-4f18-481b-8fc9-5bd89b3a8dad service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:48.880973 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0221136-4f18-481b-8fc9-5bd89b3a8dad service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:48.881243 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0221136-4f18-481b-8fc9-5bd89b3a8dad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:48.891927 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0221136-4f18-481b-8fc9-5bd89b3a8dad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:17:48.893707 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0221136-4f18-481b-8fc9-5bd89b3a8dad service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:17:48.903949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 686/1376] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:17:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:17:50.374285 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacd4ee-c20d-4f64-ae75-5c687a45bbf0 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:50.374829 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacd4ee-c20d-4f64-ae75-5c687a45bbf0 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:50.374829 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacd4ee-c20d-4f64-ae75-5c687a45bbf0 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:50.376260 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 691/1377] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:17:50.381774 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdd377-1864-4107-bc0b-18886831a5d4 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:50.382199 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdd377-1864-4107-bc0b-18886831a5d4 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:50.382359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdd377-1864-4107-bc0b-18886831a5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:50.401285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-16fdd377-1864-4107-bc0b-18886831a5d4 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:17:50.402454 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-16fdd377-1864-4107-bc0b-18886831a5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:50.410417 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 687/1378] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:17:50.458825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacd4ee-c20d-4f64-ae75-5c687a45bbf0 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:17:50.473969 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacd4ee-c20d-4f64-ae75-5c687a45bbf0 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:17:50.479939 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2369d-9b99-4786-b844-437c6a8434f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:17:50.480636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2369d-9b99-4786-b844-437c6a8434f6 service nova] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:50.480940 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2369d-9b99-4786-b844-437c6a8434f6 service nova] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:50.481199 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2369d-9b99-4786-b844-437c6a8434f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:50.490429 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2369d-9b99-4786-b844-437c6a8434f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:17:50.491963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2369d-9b99-4786-b844-437c6a8434f6 service nova] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:17:50.503351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 692/1379] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:17:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:17:52.808439 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59be83-5c69-467f-a7d5-1c0f1b71ba2b None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:52.808944 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59be83-5c69-467f-a7d5-1c0f1b71ba2b None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:52.808944 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59be83-5c69-467f-a7d5-1c0f1b71ba2b None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:52.810501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 688/1380] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:17:52.815978 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5104e27-452a-45c4-96d4-e661a63cd041 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:52.816449 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5104e27-452a-45c4-96d4-e661a63cd041 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:52.816581 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5104e27-452a-45c4-96d4-e661a63cd041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:52.835404 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-e5104e27-452a-45c4-96d4-e661a63cd041 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:17:52.836619 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-e5104e27-452a-45c4-96d4-e661a63cd041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:52.846771 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 693/1381] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:17:52.891898 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59be83-5c69-467f-a7d5-1c0f1b71ba2b None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:17:52.907312 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59be83-5c69-467f-a7d5-1c0f1b71ba2b None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:17:52.912797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9421172-8817-440d-a902-08bab49c46a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:17:52.913369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9421172-8817-440d-a902-08bab49c46a4 service nova] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:52.913651 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9421172-8817-440d-a902-08bab49c46a4 service nova] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:52.913924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9421172-8817-440d-a902-08bab49c46a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:52.923308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9421172-8817-440d-a902-08bab49c46a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:17:52.924927 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9421172-8817-440d-a902-08bab49c46a4 service nova] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:17:52.934468 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 689/1382] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:17:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:17:55.260991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d8c6d-499c-46d5-8386-d9e745a9cf74 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:55.261522 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d8c6d-499c-46d5-8386-d9e745a9cf74 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:55.261522 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d8c6d-499c-46d5-8386-d9e745a9cf74 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:55.263025 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 694/1383] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:17:55.268923 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a56d7a-b48c-436a-9327-ee63c0d72580 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:55.269394 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a56d7a-b48c-436a-9327-ee63c0d72580 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:55.269503 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a56d7a-b48c-436a-9327-ee63c0d72580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:55.287750 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-d4a56d7a-b48c-436a-9327-ee63c0d72580 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:17:55.288970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-d4a56d7a-b48c-436a-9327-ee63c0d72580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:55.297897 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 690/1384] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:17:55.339965 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d8c6d-499c-46d5-8386-d9e745a9cf74 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:17:55.359111 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d8c6d-499c-46d5-8386-d9e745a9cf74 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:17:55.366251 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422556e3-e424-4351-a026-655b10484877 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:17:55.367163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422556e3-e424-4351-a026-655b10484877 service nova] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:55.367342 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422556e3-e424-4351-a026-655b10484877 service nova] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:55.367565 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422556e3-e424-4351-a026-655b10484877 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:55.378889 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422556e3-e424-4351-a026-655b10484877 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:17:55.380667 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422556e3-e424-4351-a026-655b10484877 service nova] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:17:55.390628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 695/1385] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:17:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:17:57.721954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe288d-c5bb-4db6-920e-faaed0be1e45 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:57.722523 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe288d-c5bb-4db6-920e-faaed0be1e45 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:57.722523 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe288d-c5bb-4db6-920e-faaed0be1e45 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:57.723941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 691/1386] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:17:57.732217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a8555-5f32-48ce-aa84-9a5c690564a4 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:57.732662 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a8555-5f32-48ce-aa84-9a5c690564a4 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:57.733044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a8555-5f32-48ce-aa84-9a5c690564a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:57.756958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-391a8555-5f32-48ce-aa84-9a5c690564a4 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:17:57.758670 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-391a8555-5f32-48ce-aa84-9a5c690564a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:17:57.770192 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 696/1387] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:17:57.820224 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe288d-c5bb-4db6-920e-faaed0be1e45 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:17:57.841443 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe288d-c5bb-4db6-920e-faaed0be1e45 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:17:57.847714 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de01cc6-3281-42ea-a48b-f6dac9b07f65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:17:57.848438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de01cc6-3281-42ea-a48b-f6dac9b07f65 service nova] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:17:57.848723 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de01cc6-3281-42ea-a48b-f6dac9b07f65 service nova] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:17:57.849024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de01cc6-3281-42ea-a48b-f6dac9b07f65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:17:57.858905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de01cc6-3281-42ea-a48b-f6dac9b07f65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:17:57.860610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de01cc6-3281-42ea-a48b-f6dac9b07f65 service nova] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:17:57.871736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 692/1388] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:17:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:18:00.933344 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dde92-78e0-4c7c-98b6-cef5b646310f None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:00.933902 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dde92-78e0-4c7c-98b6-cef5b646310f None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:00.934048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dde92-78e0-4c7c-98b6-cef5b646310f None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:00.936054 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 697/1389] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:18:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:18:00.942733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de140886-6b9b-4a97-89fb-54ca94bc39af None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:00.943588 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de140886-6b9b-4a97-89fb-54ca94bc39af None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:00.943863 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de140886-6b9b-4a97-89fb-54ca94bc39af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:00.964507 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-de140886-6b9b-4a97-89fb-54ca94bc39af None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:00.965719 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-de140886-6b9b-4a97-89fb-54ca94bc39af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:00.974856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 693/1390] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:18:01.021964 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3dde92-78e0-4c7c-98b6-cef5b646310f None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:18:01.036921 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3dde92-78e0-4c7c-98b6-cef5b646310f None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:18:01.042885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce05a7-597d-4221-8ff2-15ddb55c921f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:18:01.043532 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce05a7-597d-4221-8ff2-15ddb55c921f service nova] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:01.043814 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce05a7-597d-4221-8ff2-15ddb55c921f service nova] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:01.044090 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce05a7-597d-4221-8ff2-15ddb55c921f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:01.052597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce05a7-597d-4221-8ff2-15ddb55c921f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:18:01.054183 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce05a7-597d-4221-8ff2-15ddb55c921f service nova] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:18:01.064776 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 698/1391] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:18:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:18:03.732114 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eebc9f-4c93-406b-b0e5-ed55f53eb5b8 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:03.732797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eebc9f-4c93-406b-b0e5-ed55f53eb5b8 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:03.732797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eebc9f-4c93-406b-b0e5-ed55f53eb5b8 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:03.734118 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 694/1392] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:18:03.739872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd3be9-bb86-4994-95ae-f6366a0c0dab None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:03.740414 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd3be9-bb86-4994-95ae-f6366a0c0dab None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:03.740526 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd3be9-bb86-4994-95ae-f6366a0c0dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:03.758370 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-efdd3be9-bb86-4994-95ae-f6366a0c0dab None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:03.760382 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-efdd3be9-bb86-4994-95ae-f6366a0c0dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:03.768464 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 699/1393] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:18:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:18:03.813356 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eebc9f-4c93-406b-b0e5-ed55f53eb5b8 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:18:03.828929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eebc9f-4c93-406b-b0e5-ed55f53eb5b8 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:18:03.834539 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59677c0-7786-4064-b452-5a999e10f311 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:18:03.835174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59677c0-7786-4064-b452-5a999e10f311 service nova] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:03.835453 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59677c0-7786-4064-b452-5a999e10f311 service nova] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:03.835731 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59677c0-7786-4064-b452-5a999e10f311 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:03.845826 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59677c0-7786-4064-b452-5a999e10f311 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:18:03.847339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59677c0-7786-4064-b452-5a999e10f311 service nova] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:18:03.857575 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 695/1394] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:18:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:18:05.146117 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6298b-8b98-43a3-919c-b0fc77e4d864 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:05.146700 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6298b-8b98-43a3-919c-b0fc77e4d864 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:05.146700 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6298b-8b98-43a3-919c-b0fc77e4d864 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:05.148042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 700/1395] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:18:05.153501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7ae1b-d86e-4459-8c13-998e03ba1609 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:05.153966 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7ae1b-d86e-4459-8c13-998e03ba1609 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:05.154074 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7ae1b-d86e-4459-8c13-998e03ba1609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:05.172544 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-1aa7ae1b-d86e-4459-8c13-998e03ba1609 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:05.173768 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-1aa7ae1b-d86e-4459-8c13-998e03ba1609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:05.182421 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 696/1396] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:18:05.239439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22955e8f-8dc5-4b9e-8afb-14098317aee9 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:05.239802 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22955e8f-8dc5-4b9e-8afb-14098317aee9 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:05.240188 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22955e8f-8dc5-4b9e-8afb-14098317aee9 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:05.241645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 701/1397] 10.222.0.71 () {54 vars in 962 bytes} [Mon May 16 20:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:18:05.248007 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816470cf-f164-4a3e-af62-28dcd2002db2 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:05.248420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816470cf-f164-4a3e-af62-28dcd2002db2 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:05.248760 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816470cf-f164-4a3e-af62-28dcd2002db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:05.295831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-816470cf-f164-4a3e-af62-28dcd2002db2 None None] MFA Rules not processed for user `3c62c3f9351a4181a4fc2930570171b5`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:05.297026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-816470cf-f164-4a3e-af62-28dcd2002db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:05.354966 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 697/1398] 10.222.0.71 () {58 vars in 1059 bytes} [Mon May 16 20:18:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:18:05.362529 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22955e8f-8dc5-4b9e-8afb-14098317aee9 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:18:05.373634 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22955e8f-8dc5-4b9e-8afb-14098317aee9 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:18:05.377280 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0f553-8391-4555-856f-a3106af87d11 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62c3f9351a4181a4fc2930570171b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:18:05.377980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0f553-8391-4555-856f-a3106af87d11 service glance] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:05.378333 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0f553-8391-4555-856f-a3106af87d11 service glance] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:05.378789 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0f553-8391-4555-856f-a3106af87d11 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:05.388388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0f553-8391-4555-856f-a3106af87d11 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:18:05.389879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0f553-8391-4555-856f-a3106af87d11 service glance] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:18:05.399550 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 702/1399] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:18:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:18:05.819610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c6cb3-493a-47f1-a75e-a6b693e7b77e None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:05.819900 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c6cb3-493a-47f1-a75e-a6b693e7b77e None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:05.820203 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c6cb3-493a-47f1-a75e-a6b693e7b77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:05.871575 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-cd7c6cb3-493a-47f1-a75e-a6b693e7b77e None None] MFA Rules not processed for user `38a56f3572874938ad4642fa34751a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:05.872808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-cd7c6cb3-493a-47f1-a75e-a6b693e7b77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:05.940831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 698/1400] 10.222.0.71 () {58 vars in 1009 bytes} [Mon May 16 20:18:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:18:05.989476 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bd5ed-23b6-4a46-8e4f-5ebb5d2a6074 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:05.990137 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bd5ed-23b6-4a46-8e4f-5ebb5d2a6074 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:05.990643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bd5ed-23b6-4a46-8e4f-5ebb5d2a6074 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:05.992562 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 703/1401] 10.222.0.71 () {54 vars in 942 bytes} [Mon May 16 20:18:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:18:05.998817 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666f0e0-de38-4dad-8a40-a666efa9e51a None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:05.999399 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666f0e0-de38-4dad-8a40-a666efa9e51a None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:05.999886 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666f0e0-de38-4dad-8a40-a666efa9e51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:06.058924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-6666f0e0-de38-4dad-8a40-a666efa9e51a None None] MFA Rules not processed for user `7e701cf55d13410aa259ec72578ed27a`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:06.060414 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-6666f0e0-de38-4dad-8a40-a666efa9e51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:06.140643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f03a5-42f1-4fd0-9612-1e6cc26a3e82 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:06.140933 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f03a5-42f1-4fd0-9612-1e6cc26a3e82 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:06.141216 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f03a5-42f1-4fd0-9612-1e6cc26a3e82 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:06.142583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 704/1402] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:18:06.146036 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 699/1403] 10.222.0.71 () {58 vars in 1039 bytes} [Mon May 16 20:18:05 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:18:06.148724 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555adbd-e8f7-410f-8eb9-f2145c815233 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:06.149192 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555adbd-e8f7-410f-8eb9-f2145c815233 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:06.149332 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555adbd-e8f7-410f-8eb9-f2145c815233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:06.156009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666f0e0-de38-4dad-8a40-a666efa9e51a None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:18:06.166619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666f0e0-de38-4dad-8a40-a666efa9e51a None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:18:06.170113 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-5555adbd-e8f7-410f-8eb9-f2145c815233 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:06.171338 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-5555adbd-e8f7-410f-8eb9-f2145c815233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:06.171470 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b42df-5803-460e-8b57-e6f284e28dad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e701cf55d13410aa259ec72578ed27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:18:06.172124 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b42df-5803-460e-8b57-e6f284e28dad service swift] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:06.172450 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b42df-5803-460e-8b57-e6f284e28dad service swift] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:06.172705 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b42df-5803-460e-8b57-e6f284e28dad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:06.179578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 705/1404] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:18:06.186509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b42df-5803-460e-8b57-e6f284e28dad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:18:06.188144 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b42df-5803-460e-8b57-e6f284e28dad service swift] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:18:06.197633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 700/1405] 10.222.0.71 () {60 vars in 1384 bytes} [Mon May 16 20:18:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 20:18:06.226664 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555adbd-e8f7-410f-8eb9-f2145c815233 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:18:06.240298 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555adbd-e8f7-410f-8eb9-f2145c815233 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:18:06.248251 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb7540-bfda-41c4-b3d5-4b88422ebce0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:18:06.249050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb7540-bfda-41c4-b3d5-4b88422ebce0 service nova] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:06.249334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb7540-bfda-41c4-b3d5-4b88422ebce0 service nova] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:06.249605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb7540-bfda-41c4-b3d5-4b88422ebce0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:06.260040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb7540-bfda-41c4-b3d5-4b88422ebce0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:18:06.260312 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb7540-bfda-41c4-b3d5-4b88422ebce0 service nova] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:18:06.271237 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 706/1406] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:18:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:18:08.704166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0243cb-8e58-4745-84f0-0c7b2b66802b None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:08.704621 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0243cb-8e58-4745-84f0-0c7b2b66802b None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:08.704723 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0243cb-8e58-4745-84f0-0c7b2b66802b None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:08.706296 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 701/1407] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:18:08.713065 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64de39-dc83-4fd6-b3dc-d19c7821e7e7 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:08.713571 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64de39-dc83-4fd6-b3dc-d19c7821e7e7 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:08.713675 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64de39-dc83-4fd6-b3dc-d19c7821e7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:08.734546 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-6a64de39-dc83-4fd6-b3dc-d19c7821e7e7 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:08.736007 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-6a64de39-dc83-4fd6-b3dc-d19c7821e7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:08.760182 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 707/1408] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:18:08.792816 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0243cb-8e58-4745-84f0-0c7b2b66802b None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:18:08.812220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0243cb-8e58-4745-84f0-0c7b2b66802b None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:18:08.819051 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8ca1d-37fe-4607-98f4-f8e2cf15cfb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:18:08.819694 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8ca1d-37fe-4607-98f4-f8e2cf15cfb6 service nova] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:08.819974 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8ca1d-37fe-4607-98f4-f8e2cf15cfb6 service nova] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:08.820277 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8ca1d-37fe-4607-98f4-f8e2cf15cfb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:08.829452 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8ca1d-37fe-4607-98f4-f8e2cf15cfb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:18:08.831065 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8ca1d-37fe-4607-98f4-f8e2cf15cfb6 service nova] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:18:08.841151 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 702/1409] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:18:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:18:29.739485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8d2e4-8db8-4736-92b1-e4d306668f38 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:29.740142 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8d2e4-8db8-4736-92b1-e4d306668f38 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:29.740142 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8d2e4-8db8-4736-92b1-e4d306668f38 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:29.741440 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 708/1410] 10.222.0.71 () {54 vars in 918 bytes} [Mon May 16 20:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:18:29.746885 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afef226-1c93-4561-a553-aab5d3db5ab5 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:29.747328 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afef226-1c93-4561-a553-aab5d3db5ab5 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:29.747448 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afef226-1c93-4561-a553-aab5d3db5ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:29.766826 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-2afef226-1c93-4561-a553-aab5d3db5ab5 None None] MFA Rules not processed for user `72e2c8b4ff2349919750aa0f3f7309bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:29.768323 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-2afef226-1c93-4561-a553-aab5d3db5ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:29.778065 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 703/1411] 10.222.0.71 () {58 vars in 1015 bytes} [Mon May 16 20:18:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:18:29.792976 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d068ec0-382f-47e6-87ea-9013b1279695 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:29.793261 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d068ec0-382f-47e6-87ea-9013b1279695 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:29.793542 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d068ec0-382f-47e6-87ea-9013b1279695 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:29.794934 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 709/1412] 10.222.0.71 () {54 vars in 918 bytes} [Mon May 16 20:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:18:29.799631 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0dcd4-7015-489f-96fa-4b882ea2cdb7 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:29.799914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0dcd4-7015-489f-96fa-4b882ea2cdb7 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:29.800241 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0dcd4-7015-489f-96fa-4b882ea2cdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:29.817713 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-8fe0dcd4-7015-489f-96fa-4b882ea2cdb7 None None] MFA Rules not processed for user `242d4f9634a74013af05f50981280864`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:29.818902 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8fe0dcd4-7015-489f-96fa-4b882ea2cdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:29.828527 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 704/1413] 10.222.0.71 () {58 vars in 1015 bytes} [Mon May 16 20:18:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:18:32.574884 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b7b83-e95c-43e0-af95-81ebdaa5e5cd None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:32.575500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b7b83-e95c-43e0-af95-81ebdaa5e5cd None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:32.575500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b7b83-e95c-43e0-af95-81ebdaa5e5cd None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:32.576844 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:18:32.582266 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021175e-dec5-4643-a70c-67576a6885dc None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:32.582708 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021175e-dec5-4643-a70c-67576a6885dc None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:32.582820 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021175e-dec5-4643-a70c-67576a6885dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:32.600964 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-9021175e-dec5-4643-a70c-67576a6885dc None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:32.602977 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-9021175e-dec5-4643-a70c-67576a6885dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:32.610986 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:18:32.652572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b7b83-e95c-43e0-af95-81ebdaa5e5cd None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:18:32.667091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b7b83-e95c-43e0-af95-81ebdaa5e5cd None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:18:32.672506 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c41ef-09c2-4906-acbd-68ea7d8ab4a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:18:32.673141 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c41ef-09c2-4906-acbd-68ea7d8ab4a1 service nova] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:32.673432 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c41ef-09c2-4906-acbd-68ea7d8ab4a1 service nova] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:32.673698 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c41ef-09c2-4906-acbd-68ea7d8ab4a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:32.681841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c41ef-09c2-4906-acbd-68ea7d8ab4a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:18:32.683399 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c41ef-09c2-4906-acbd-68ea7d8ab4a1 service nova] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:18:32.692557 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 711/1416] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:18:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:18:33.703718 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfff9dc-2506-4a5d-859f-4931d4d4402f None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:33.704306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfff9dc-2506-4a5d-859f-4931d4d4402f None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:33.704306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfff9dc-2506-4a5d-859f-4931d4d4402f None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:33.705660 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 20:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:18:33.710747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71caa1-f0f4-4632-9b63-742e80f7c287 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:33.711302 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71caa1-f0f4-4632-9b63-742e80f7c287 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:33.711302 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71caa1-f0f4-4632-9b63-742e80f7c287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:33.730996 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-7d71caa1-f0f4-4632-9b63-742e80f7c287 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:33.732240 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-7d71caa1-f0f4-4632-9b63-742e80f7c287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:33.740538 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 20:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:18:33.898302 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfff9dc-2506-4a5d-859f-4931d4d4402f None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:18:33.912233 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfff9dc-2506-4a5d-859f-4931d4d4402f None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:18:33.917778 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a075ca-2cd5-44e5-b5b7-b5d02f17281a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:18:33.918422 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a075ca-2cd5-44e5-b5b7-b5d02f17281a service nova] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:33.918699 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a075ca-2cd5-44e5-b5b7-b5d02f17281a service nova] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:33.918971 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a075ca-2cd5-44e5-b5b7-b5d02f17281a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:33.927508 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a075ca-2cd5-44e5-b5b7-b5d02f17281a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:18:33.929111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a075ca-2cd5-44e5-b5b7-b5d02f17281a service nova] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:18:33.938715 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 707/1419] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:18:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:18:34.911953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85046f39-b2cc-4a84-a3af-12b45b206c61 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:34.912560 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85046f39-b2cc-4a84-a3af-12b45b206c61 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:34.912560 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85046f39-b2cc-4a84-a3af-12b45b206c61 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:34.913913 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 20:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:18:34.920042 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164742df-7670-4d48-a679-c88b28a66ed7 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:34.920608 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164742df-7670-4d48-a679-c88b28a66ed7 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:34.920608 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164742df-7670-4d48-a679-c88b28a66ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:34.938437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-164742df-7670-4d48-a679-c88b28a66ed7 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:34.939629 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-164742df-7670-4d48-a679-c88b28a66ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:34.949272 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 20:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:18:35.111032 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85046f39-b2cc-4a84-a3af-12b45b206c61 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:18:35.125685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85046f39-b2cc-4a84-a3af-12b45b206c61 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:18:35.131127 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9f0bf-31e0-40d0-8ff4-8faf7fc34886 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:18:35.131763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9f0bf-31e0-40d0-8ff4-8faf7fc34886 service nova] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:35.132047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9f0bf-31e0-40d0-8ff4-8faf7fc34886 service nova] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:35.132355 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9f0bf-31e0-40d0-8ff4-8faf7fc34886 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:35.141205 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9f0bf-31e0-40d0-8ff4-8faf7fc34886 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:18:35.142778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9f0bf-31e0-40d0-8ff4-8faf7fc34886 service nova] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:18:35.153423 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 714/1422] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:18:36.092354 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83280a-afff-4b24-aa51-bb33c153d394 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:36.092944 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83280a-afff-4b24-aa51-bb33c153d394 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:36.092944 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83280a-afff-4b24-aa51-bb33c153d394 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:36.094280 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 20:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:18:36.099145 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0264e-78ab-4e8d-bb44-d0d9318146c4 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:36.099585 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0264e-78ab-4e8d-bb44-d0d9318146c4 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:36.099699 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0264e-78ab-4e8d-bb44-d0d9318146c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:36.117880 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-ccf0264e-78ab-4e8d-bb44-d0d9318146c4 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:36.119103 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-ccf0264e-78ab-4e8d-bb44-d0d9318146c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:36.126898 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 20:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:18:36.276018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83280a-afff-4b24-aa51-bb33c153d394 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:18:36.290517 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83280a-afff-4b24-aa51-bb33c153d394 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:18:36.295916 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6797319-bf1d-4d4f-b7d3-c4dc79184007 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:18:36.296572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6797319-bf1d-4d4f-b7d3-c4dc79184007 service nova] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:36.296854 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6797319-bf1d-4d4f-b7d3-c4dc79184007 service nova] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:36.297128 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6797319-bf1d-4d4f-b7d3-c4dc79184007 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:36.305909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6797319-bf1d-4d4f-b7d3-c4dc79184007 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:18:36.307532 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6797319-bf1d-4d4f-b7d3-c4dc79184007 service nova] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:18:36.316939 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 710/1425] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:18:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:18:37.244138 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39683e21-4c4f-4523-858e-95c894495bba None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:37.244640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39683e21-4c4f-4523-858e-95c894495bba None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:37.244759 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39683e21-4c4f-4523-858e-95c894495bba None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:37.246078 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 20:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:18:37.250986 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3d078-3ebb-4ba6-b9c6-588d0db86f07 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:37.251373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3d078-3ebb-4ba6-b9c6-588d0db86f07 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:37.251538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3d078-3ebb-4ba6-b9c6-588d0db86f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:37.269834 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-03a3d078-3ebb-4ba6-b9c6-588d0db86f07 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:37.271009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-03a3d078-3ebb-4ba6-b9c6-588d0db86f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:37.279417 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 20:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:18:37.438025 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39683e21-4c4f-4523-858e-95c894495bba None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:18:37.453132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39683e21-4c4f-4523-858e-95c894495bba None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:18:37.458531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6396044-9816-4615-9b44-9a7a12a6a72b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:18:37.459161 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6396044-9816-4615-9b44-9a7a12a6a72b service nova] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:37.459447 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6396044-9816-4615-9b44-9a7a12a6a72b service nova] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:37.459725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6396044-9816-4615-9b44-9a7a12a6a72b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:37.468706 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6396044-9816-4615-9b44-9a7a12a6a72b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:18:37.470275 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6396044-9816-4615-9b44-9a7a12a6a72b service nova] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:18:37.479954 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 717/1428] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:18:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:18:38.366781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cf0f1-4d52-40e9-904e-4757b3befd25 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:38.367880 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cf0f1-4d52-40e9-904e-4757b3befd25 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:38.367880 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cf0f1-4d52-40e9-904e-4757b3befd25 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:38.369451 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 20:18:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:18:38.374399 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846b421-f1f5-4dcc-817e-35aeba329ed7 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:38.374803 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846b421-f1f5-4dcc-817e-35aeba329ed7 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:38.374949 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846b421-f1f5-4dcc-817e-35aeba329ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:38.393471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-8846b421-f1f5-4dcc-817e-35aeba329ed7 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:38.394672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-8846b421-f1f5-4dcc-817e-35aeba329ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:38.402443 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 20:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:18:38.551812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cf0f1-4d52-40e9-904e-4757b3befd25 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:18:38.566248 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cf0f1-4d52-40e9-904e-4757b3befd25 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:18:38.572305 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c839ef1-0681-46ed-a9c1-6314f600d89b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:18:38.572933 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c839ef1-0681-46ed-a9c1-6314f600d89b service nova] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:38.573211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c839ef1-0681-46ed-a9c1-6314f600d89b service nova] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:38.573481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c839ef1-0681-46ed-a9c1-6314f600d89b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:38.581406 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c839ef1-0681-46ed-a9c1-6314f600d89b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:18:38.582972 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c839ef1-0681-46ed-a9c1-6314f600d89b service nova] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:18:38.592221 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 713/1431] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:18:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:18:39.514174 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa51f7-d1d2-4c3b-9726-79bcb89eb506 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:39.514697 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa51f7-d1d2-4c3b-9726-79bcb89eb506 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:39.514697 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa51f7-d1d2-4c3b-9726-79bcb89eb506 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:39.516022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 20:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:18:39.521491 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c926e7-4edc-4707-a809-136a56061d3c None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:39.521917 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c926e7-4edc-4707-a809-136a56061d3c None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:39.522033 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c926e7-4edc-4707-a809-136a56061d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:39.541189 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-e9c926e7-4edc-4707-a809-136a56061d3c None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:39.542380 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-e9c926e7-4edc-4707-a809-136a56061d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:39.550862 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 20:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:18:39.702366 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa51f7-d1d2-4c3b-9726-79bcb89eb506 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:18:39.716231 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa51f7-d1d2-4c3b-9726-79bcb89eb506 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:18:39.721449 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6839dd8-f1c1-4f5f-94fd-42dc450fe7cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:18:39.722078 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6839dd8-f1c1-4f5f-94fd-42dc450fe7cf service nova] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:39.722357 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6839dd8-f1c1-4f5f-94fd-42dc450fe7cf service nova] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:39.722629 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6839dd8-f1c1-4f5f-94fd-42dc450fe7cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:39.731101 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6839dd8-f1c1-4f5f-94fd-42dc450fe7cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:18:39.732766 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6839dd8-f1c1-4f5f-94fd-42dc450fe7cf service nova] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:18:39.741811 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 720/1434] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:18:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:18:40.759432 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9357613-0aa6-4564-8db7-40281f601ad3 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:40.759966 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9357613-0aa6-4564-8db7-40281f601ad3 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:40.760061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9357613-0aa6-4564-8db7-40281f601ad3 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:40.761511 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 20:18:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:18:40.766811 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b3bd0-3f79-4641-bc34-531c099b072b None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:40.767260 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b3bd0-3f79-4641-bc34-531c099b072b None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:40.767410 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b3bd0-3f79-4641-bc34-531c099b072b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:40.787363 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-7d0b3bd0-3f79-4641-bc34-531c099b072b None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:40.788609 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-7d0b3bd0-3f79-4641-bc34-531c099b072b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:40.797038 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 20:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:18:40.954983 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9357613-0aa6-4564-8db7-40281f601ad3 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:18:40.971449 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9357613-0aa6-4564-8db7-40281f601ad3 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:18:40.977545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802915c0-d09e-450c-8dab-63e1b81b55b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:18:40.978171 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802915c0-d09e-450c-8dab-63e1b81b55b8 service nova] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:40.978449 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802915c0-d09e-450c-8dab-63e1b81b55b8 service nova] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:40.978728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802915c0-d09e-450c-8dab-63e1b81b55b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:40.987927 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802915c0-d09e-450c-8dab-63e1b81b55b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:18:40.989537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802915c0-d09e-450c-8dab-63e1b81b55b8 service nova] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:18:41.003930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 716/1437] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:18:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:18:41.910193 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7fd0d-a96b-4b7b-8ea7-ee54e6ba3ed3 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:41.910746 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7fd0d-a96b-4b7b-8ea7-ee54e6ba3ed3 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:41.910746 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7fd0d-a96b-4b7b-8ea7-ee54e6ba3ed3 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:41.912112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 20:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:18:41.917825 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036422ca-3278-442d-97a1-7342bf5ad0a7 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:41.918315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036422ca-3278-442d-97a1-7342bf5ad0a7 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:41.918421 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036422ca-3278-442d-97a1-7342bf5ad0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:41.936615 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-036422ca-3278-442d-97a1-7342bf5ad0a7 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:41.937806 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-036422ca-3278-442d-97a1-7342bf5ad0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:41.945634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 20:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:18:42.096959 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7fd0d-a96b-4b7b-8ea7-ee54e6ba3ed3 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:18:42.111536 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7fd0d-a96b-4b7b-8ea7-ee54e6ba3ed3 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:18:42.116797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ec8a6-c426-4335-8c8e-65b0482a0b93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:18:42.117456 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ec8a6-c426-4335-8c8e-65b0482a0b93 service nova] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:42.117746 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ec8a6-c426-4335-8c8e-65b0482a0b93 service nova] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:42.118196 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ec8a6-c426-4335-8c8e-65b0482a0b93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:42.126095 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ec8a6-c426-4335-8c8e-65b0482a0b93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:18:42.127657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ec8a6-c426-4335-8c8e-65b0482a0b93 service nova] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:18:42.136871 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 723/1440] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:18:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:18:44.300889 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a256a86-8549-4d85-af3f-875bd061dc87 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:44.301450 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a256a86-8549-4d85-af3f-875bd061dc87 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:44.301450 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a256a86-8549-4d85-af3f-875bd061dc87 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:44.302820 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:18:44.308691 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20143e6-0980-4b6e-adad-5327e7b30bbf None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:44.309117 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20143e6-0980-4b6e-adad-5327e7b30bbf None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:44.309237 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20143e6-0980-4b6e-adad-5327e7b30bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:44.327078 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-f20143e6-0980-4b6e-adad-5327e7b30bbf None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:44.328283 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f20143e6-0980-4b6e-adad-5327e7b30bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:44.335928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:18:44.377402 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a256a86-8549-4d85-af3f-875bd061dc87 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:18:44.388494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a256a86-8549-4d85-af3f-875bd061dc87 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:18:44.391943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e3866-4586-4b1e-9222-f48296fbfba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:18:44.392613 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e3866-4586-4b1e-9222-f48296fbfba3 service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:44.392896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e3866-4586-4b1e-9222-f48296fbfba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:44.393416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e3866-4586-4b1e-9222-f48296fbfba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:44.402147 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e3866-4586-4b1e-9222-f48296fbfba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:18:44.403585 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e3866-4586-4b1e-9222-f48296fbfba3 service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:18:44.412784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 719/1443] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:18:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:18:46.864292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2e1b5-ae70-477c-b50d-1062da7f5612 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:46.864877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2e1b5-ae70-477c-b50d-1062da7f5612 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:46.864877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2e1b5-ae70-477c-b50d-1062da7f5612 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:46.866262 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:18:46.873601 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a9505-d138-4121-9cdd-3cb3e6504fe4 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:46.874093 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a9505-d138-4121-9cdd-3cb3e6504fe4 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:46.874220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a9505-d138-4121-9cdd-3cb3e6504fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:46.892188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-d07a9505-d138-4121-9cdd-3cb3e6504fe4 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:46.893626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-d07a9505-d138-4121-9cdd-3cb3e6504fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:46.901317 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:18:46.939085 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2e1b5-ae70-477c-b50d-1062da7f5612 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:18:46.950234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2e1b5-ae70-477c-b50d-1062da7f5612 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:18:46.953739 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aea01f-f697-49e7-8101-ea049966047d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:18:46.954367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aea01f-f697-49e7-8101-ea049966047d service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:46.954649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aea01f-f697-49e7-8101-ea049966047d service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:46.954956 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aea01f-f697-49e7-8101-ea049966047d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:46.963829 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aea01f-f697-49e7-8101-ea049966047d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:18:46.965307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aea01f-f697-49e7-8101-ea049966047d service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:18:46.974536 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 726/1446] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:18:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:18:49.650111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8a77e-8010-44eb-bf35-1bcdaf1eaa8a None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:49.650755 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8a77e-8010-44eb-bf35-1bcdaf1eaa8a None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:49.650755 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8a77e-8010-44eb-bf35-1bcdaf1eaa8a None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:49.652029 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:18:49.657333 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738e7f2-7834-4f1f-bcbc-a4188152dfec None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:49.657754 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738e7f2-7834-4f1f-bcbc-a4188152dfec None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:49.657899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738e7f2-7834-4f1f-bcbc-a4188152dfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:49.675549 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-e738e7f2-7834-4f1f-bcbc-a4188152dfec None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:49.676765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-e738e7f2-7834-4f1f-bcbc-a4188152dfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:49.685363 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:18:49.725401 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8a77e-8010-44eb-bf35-1bcdaf1eaa8a None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:18:49.736330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8a77e-8010-44eb-bf35-1bcdaf1eaa8a None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:18:49.739864 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a018c-0c31-46ae-b6ee-e01b11f2de97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:18:49.740539 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a018c-0c31-46ae-b6ee-e01b11f2de97 service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:49.740818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a018c-0c31-46ae-b6ee-e01b11f2de97 service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:49.741111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a018c-0c31-46ae-b6ee-e01b11f2de97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:49.750944 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a018c-0c31-46ae-b6ee-e01b11f2de97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:18:49.752399 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a018c-0c31-46ae-b6ee-e01b11f2de97 service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:18:49.762293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 722/1449] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:18:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:18:52.159917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b1612-25cd-401a-bf80-2ca14aebfdb5 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:52.160533 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b1612-25cd-401a-bf80-2ca14aebfdb5 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:52.160533 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b1612-25cd-401a-bf80-2ca14aebfdb5 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:52.161876 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:18:52.168397 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9037fc-9cd8-499b-b281-fc66a8ca8dbf None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:52.168863 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9037fc-9cd8-499b-b281-fc66a8ca8dbf None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:52.168963 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9037fc-9cd8-499b-b281-fc66a8ca8dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:52.186768 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-ff9037fc-9cd8-499b-b281-fc66a8ca8dbf None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:52.187948 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-ff9037fc-9cd8-499b-b281-fc66a8ca8dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:52.196520 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:18:52.234670 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b1612-25cd-401a-bf80-2ca14aebfdb5 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:18:52.245775 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b1612-25cd-401a-bf80-2ca14aebfdb5 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:18:52.249343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab48b81-6056-4cad-a897-1deb055de61b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:18:52.249981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab48b81-6056-4cad-a897-1deb055de61b service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:52.250263 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab48b81-6056-4cad-a897-1deb055de61b service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:52.250540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab48b81-6056-4cad-a897-1deb055de61b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:52.261008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab48b81-6056-4cad-a897-1deb055de61b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:18:52.262475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab48b81-6056-4cad-a897-1deb055de61b service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:18:52.273044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 729/1452] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:18:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:18:54.625070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c6cfd-efad-41ef-af59-6b53195d8a09 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:54.625643 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c6cfd-efad-41ef-af59-6b53195d8a09 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:54.625643 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c6cfd-efad-41ef-af59-6b53195d8a09 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:54.626983 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:18:54.632302 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d9359-2207-4ebf-941a-60fad7d07470 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:54.634246 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d9359-2207-4ebf-941a-60fad7d07470 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:54.634246 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d9359-2207-4ebf-941a-60fad7d07470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:54.651388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-bf0d9359-2207-4ebf-941a-60fad7d07470 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:54.652616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-bf0d9359-2207-4ebf-941a-60fad7d07470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:54.660266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:18:54.697564 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c6cfd-efad-41ef-af59-6b53195d8a09 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:18:54.708140 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c6cfd-efad-41ef-af59-6b53195d8a09 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:18:54.712589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05165a8a-dadf-4987-a21c-f1fd2dbe0d0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:18:54.713221 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05165a8a-dadf-4987-a21c-f1fd2dbe0d0b service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:54.713500 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05165a8a-dadf-4987-a21c-f1fd2dbe0d0b service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:54.713771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05165a8a-dadf-4987-a21c-f1fd2dbe0d0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:54.722596 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05165a8a-dadf-4987-a21c-f1fd2dbe0d0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:18:54.724027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05165a8a-dadf-4987-a21c-f1fd2dbe0d0b service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:18:54.734439 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 725/1455] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:18:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:18:57.041162 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96967fe9-98bc-408c-8315-107e77065545 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:57.041700 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96967fe9-98bc-408c-8315-107e77065545 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:57.041700 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96967fe9-98bc-408c-8315-107e77065545 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:57.042999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:18:57.048598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b20ed-9ad5-4c82-8b48-ec46a8a05aeb None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:57.049122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b20ed-9ad5-4c82-8b48-ec46a8a05aeb None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:57.049229 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b20ed-9ad5-4c82-8b48-ec46a8a05aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:57.067935 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-727b20ed-9ad5-4c82-8b48-ec46a8a05aeb None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:57.069176 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-727b20ed-9ad5-4c82-8b48-ec46a8a05aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:57.078647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:18:57.115942 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96967fe9-98bc-408c-8315-107e77065545 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:18:57.127467 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96967fe9-98bc-408c-8315-107e77065545 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:18:57.130917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571856bb-d238-4017-880f-aea83ba859d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:18:57.131550 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571856bb-d238-4017-880f-aea83ba859d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:57.131831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571856bb-d238-4017-880f-aea83ba859d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:57.132105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571856bb-d238-4017-880f-aea83ba859d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:57.141322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571856bb-d238-4017-880f-aea83ba859d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:18:57.142733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571856bb-d238-4017-880f-aea83ba859d6 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:18:57.152104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 732/1458] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:18:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:18:59.532163 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d3e75-a79a-4f6b-81bb-c83643f69ed8 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:59.532742 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d3e75-a79a-4f6b-81bb-c83643f69ed8 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:59.532742 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d3e75-a79a-4f6b-81bb-c83643f69ed8 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:59.533997 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:18:59.540047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0a534-c02e-4d01-adb5-1ee315c86223 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:59.540554 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0a534-c02e-4d01-adb5-1ee315c86223 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:59.540661 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0a534-c02e-4d01-adb5-1ee315c86223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:59.558539 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-70c0a534-c02e-4d01-adb5-1ee315c86223 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:18:59.559710 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-70c0a534-c02e-4d01-adb5-1ee315c86223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:18:59.567530 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:18:59.605109 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d3e75-a79a-4f6b-81bb-c83643f69ed8 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:18:59.615730 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d3e75-a79a-4f6b-81bb-c83643f69ed8 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:18:59.620408 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc158f28-b176-4007-8f91-0d1c6549da7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:18:59.621050 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc158f28-b176-4007-8f91-0d1c6549da7a service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:18:59.621326 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc158f28-b176-4007-8f91-0d1c6549da7a service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:18:59.621600 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc158f28-b176-4007-8f91-0d1c6549da7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:18:59.631720 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc158f28-b176-4007-8f91-0d1c6549da7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:18:59.633525 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc158f28-b176-4007-8f91-0d1c6549da7a service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:18:59.643863 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 728/1461] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:18:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:19:01.995304 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2aeab-379f-4d77-bf28-8249eed39002 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:01.996093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2aeab-379f-4d77-bf28-8249eed39002 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:01.996093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2aeab-379f-4d77-bf28-8249eed39002 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:01.997304 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:19:02.005147 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268394d-548f-42ad-834f-9523df8033e1 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:02.005742 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268394d-548f-42ad-834f-9523df8033e1 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:02.005742 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268394d-548f-42ad-834f-9523df8033e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:02.025319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-b268394d-548f-42ad-834f-9523df8033e1 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:19:02.026574 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-b268394d-548f-42ad-834f-9523df8033e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:19:02.034655 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:19:02.075405 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2aeab-379f-4d77-bf28-8249eed39002 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:19:02.087727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2aeab-379f-4d77-bf28-8249eed39002 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:19:02.091447 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876140ed-dece-4f01-98f2-b01663e6bf36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:19:02.092097 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876140ed-dece-4f01-98f2-b01663e6bf36 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:02.092411 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876140ed-dece-4f01-98f2-b01663e6bf36 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:02.092686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876140ed-dece-4f01-98f2-b01663e6bf36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:02.104203 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876140ed-dece-4f01-98f2-b01663e6bf36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:19:02.106166 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876140ed-dece-4f01-98f2-b01663e6bf36 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:19:02.118128 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 735/1464] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:19:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:19:04.496686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fc50e-b59f-4f2f-bf37-f3048761c0a2 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:04.497241 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fc50e-b59f-4f2f-bf37-f3048761c0a2 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:04.497241 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fc50e-b59f-4f2f-bf37-f3048761c0a2 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:04.498522 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:19:04.504103 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557d832-6567-4897-894d-1b294cf8bd5e None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:04.504635 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557d832-6567-4897-894d-1b294cf8bd5e None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:04.504745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557d832-6567-4897-894d-1b294cf8bd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:04.523601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-7557d832-6567-4897-894d-1b294cf8bd5e None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:19:04.524959 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-7557d832-6567-4897-894d-1b294cf8bd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:19:04.533026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:19:04.571262 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fc50e-b59f-4f2f-bf37-f3048761c0a2 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:19:04.582721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fc50e-b59f-4f2f-bf37-f3048761c0a2 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:19:04.587069 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeeb6ab-fff1-4228-bc2b-79b8179bdebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:19:04.587710 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeb6ab-fff1-4228-bc2b-79b8179bdebd service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:04.587990 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeb6ab-fff1-4228-bc2b-79b8179bdebd service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:04.588295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeb6ab-fff1-4228-bc2b-79b8179bdebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:04.597978 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeeb6ab-fff1-4228-bc2b-79b8179bdebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:19:04.599429 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeeb6ab-fff1-4228-bc2b-79b8179bdebd service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:19:04.610389 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 731/1467] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:19:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:19:06.965555 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993831eb-12a4-4086-a852-3b71b0ea133c None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:06.966135 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993831eb-12a4-4086-a852-3b71b0ea133c None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:06.966135 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993831eb-12a4-4086-a852-3b71b0ea133c None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:06.967513 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:19:06.973769 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d60d7f-5018-471e-970f-3e068cb3400b None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:06.974324 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d60d7f-5018-471e-970f-3e068cb3400b None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:06.974324 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d60d7f-5018-471e-970f-3e068cb3400b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:06.996657 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-c2d60d7f-5018-471e-970f-3e068cb3400b None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:19:06.997800 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c2d60d7f-5018-471e-970f-3e068cb3400b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:19:07.005999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:19:07.046197 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993831eb-12a4-4086-a852-3b71b0ea133c None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:19:07.057083 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993831eb-12a4-4086-a852-3b71b0ea133c None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:19:07.060627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc22ba-688c-42e1-be56-48299e5535e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:19:07.061273 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc22ba-688c-42e1-be56-48299e5535e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:07.061554 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc22ba-688c-42e1-be56-48299e5535e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:07.061825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc22ba-688c-42e1-be56-48299e5535e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:07.072145 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc22ba-688c-42e1-be56-48299e5535e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:19:07.073616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc22ba-688c-42e1-be56-48299e5535e4 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:19:07.083534 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 738/1470] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:19:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:19:40.489614 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5ef9e-e135-4900-a74a-0312d0874ebf None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:40.490183 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5ef9e-e135-4900-a74a-0312d0874ebf None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:40.490183 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5ef9e-e135-4900-a74a-0312d0874ebf None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:40.492049 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 733/1471] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:19:40.497295 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c531e-245d-419c-b3ed-4788c76416f6 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:40.497794 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c531e-245d-419c-b3ed-4788c76416f6 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:40.497904 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c531e-245d-419c-b3ed-4788c76416f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:40.515052 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-7f0c531e-245d-419c-b3ed-4788c76416f6 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:19:40.516270 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-7f0c531e-245d-419c-b3ed-4788c76416f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:19:40.524478 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 739/1472] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:19:40.571465 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83d8be-43af-4087-b245-ba82c8433f79 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:40.571753 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83d8be-43af-4087-b245-ba82c8433f79 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:40.572028 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83d8be-43af-4087-b245-ba82c8433f79 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:40.573417 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 734/1473] 10.222.0.71 () {54 vars in 962 bytes} [Mon May 16 20:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:19:40.578048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b527e7-0e31-4c08-b05a-4c41beee38ce None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:40.578341 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b527e7-0e31-4c08-b05a-4c41beee38ce None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:40.578623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b527e7-0e31-4c08-b05a-4c41beee38ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:40.596711 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-b3b527e7-0e31-4c08-b05a-4c41beee38ce None None] MFA Rules not processed for user `3c62c3f9351a4181a4fc2930570171b5`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:19:40.597889 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-b3b527e7-0e31-4c08-b05a-4c41beee38ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:19:40.605055 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 740/1474] 10.222.0.71 () {58 vars in 1059 bytes} [Mon May 16 20:19:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:19:40.612176 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83d8be-43af-4087-b245-ba82c8433f79 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:19:40.623164 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83d8be-43af-4087-b245-ba82c8433f79 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:19:40.626670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2453f54-bff1-4ca6-bd23-aebb82172213 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62c3f9351a4181a4fc2930570171b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:19:40.627287 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2453f54-bff1-4ca6-bd23-aebb82172213 service glance] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:40.627563 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2453f54-bff1-4ca6-bd23-aebb82172213 service glance] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:40.627832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2453f54-bff1-4ca6-bd23-aebb82172213 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:40.636636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2453f54-bff1-4ca6-bd23-aebb82172213 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:19:40.638045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2453f54-bff1-4ca6-bd23-aebb82172213 service glance] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:19:40.647425 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 735/1475] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:19:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:19:43.030087 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cd805-dad0-4d28-8b33-44e99bf3c559 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:43.030635 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cd805-dad0-4d28-8b33-44e99bf3c559 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:43.030635 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cd805-dad0-4d28-8b33-44e99bf3c559 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:43.031925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 741/1476] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:19:43.037094 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f995872-852e-4f48-8e67-81276674073b None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:43.037507 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f995872-852e-4f48-8e67-81276674073b None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:43.037627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f995872-852e-4f48-8e67-81276674073b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:43.055217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-1f995872-852e-4f48-8e67-81276674073b None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:19:43.056436 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-1f995872-852e-4f48-8e67-81276674073b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:19:43.064109 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 736/1477] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:19:43.087705 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cd805-dad0-4d28-8b33-44e99bf3c559 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:19:43.099973 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cd805-dad0-4d28-8b33-44e99bf3c559 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:19:43.104935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0af62-cb51-400f-b9a7-e9f3c42c382a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:19:43.105582 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0af62-cb51-400f-b9a7-e9f3c42c382a admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:43.105866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0af62-cb51-400f-b9a7-e9f3c42c382a admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:43.106141 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0af62-cb51-400f-b9a7-e9f3c42c382a admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:43.106871 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0af62-cb51-400f-b9a7-e9f3c42c382a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:19:43.108676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: WARNING py.warnings [None req-e8e0af62-cb51-400f-b9a7-e9f3c42c382a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 20:19:43.108676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: warnings.warn(msg) May 16 20:19:43.108676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: May 16 20:19:43.109829 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0af62-cb51-400f-b9a7-e9f3c42c382a admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:19:43.129608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 742/1478] 10.222.0.71 () {56 vars in 1108 bytes} [Mon May 16 20:19:43 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:19:45.400935 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2734b5-5dd6-4844-8b2d-40daa042a038 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:45.401501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2734b5-5dd6-4844-8b2d-40daa042a038 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:45.401501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2734b5-5dd6-4844-8b2d-40daa042a038 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:45.402850 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 737/1479] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:19:45.408112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26c77c-0183-49fc-b73d-8aef3c828e4b None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:45.408572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26c77c-0183-49fc-b73d-8aef3c828e4b None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:45.408705 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26c77c-0183-49fc-b73d-8aef3c828e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:45.426779 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-8f26c77c-0183-49fc-b73d-8aef3c828e4b None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:19:45.427965 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-8f26c77c-0183-49fc-b73d-8aef3c828e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:19:45.435759 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 743/1480] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:19:45.479321 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2734b5-5dd6-4844-8b2d-40daa042a038 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:19:45.493393 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2734b5-5dd6-4844-8b2d-40daa042a038 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:19:45.498920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf1810-81a1-4fce-844a-ea293c72d39e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:19:45.499766 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf1810-81a1-4fce-844a-ea293c72d39e service nova] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:45.500049 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf1810-81a1-4fce-844a-ea293c72d39e service nova] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:45.500407 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf1810-81a1-4fce-844a-ea293c72d39e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:45.509966 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf1810-81a1-4fce-844a-ea293c72d39e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:19:45.511555 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf1810-81a1-4fce-844a-ea293c72d39e service nova] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:19:45.521062 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 738/1481] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:19:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:19:47.947428 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dc093-550a-4459-ad3d-b249f3f3a61b None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:47.947981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dc093-550a-4459-ad3d-b249f3f3a61b None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:47.947981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dc093-550a-4459-ad3d-b249f3f3a61b None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:47.949378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 744/1482] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:19:47.954710 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c486996-ade3-4d41-8ddc-a5645ad543a5 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:47.955151 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c486996-ade3-4d41-8ddc-a5645ad543a5 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:47.955247 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c486996-ade3-4d41-8ddc-a5645ad543a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:47.973066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-6c486996-ade3-4d41-8ddc-a5645ad543a5 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:19:47.974244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-6c486996-ade3-4d41-8ddc-a5645ad543a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:19:47.982207 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 739/1483] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:19:48.018719 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79dc093-550a-4459-ad3d-b249f3f3a61b None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:19:48.030377 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79dc093-550a-4459-ad3d-b249f3f3a61b None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:19:48.034213 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea75f01-f71f-441a-a5ab-e5e2604e23a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:19:48.034843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea75f01-f71f-441a-a5ab-e5e2604e23a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:48.035119 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea75f01-f71f-441a-a5ab-e5e2604e23a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:48.035390 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea75f01-f71f-441a-a5ab-e5e2604e23a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:48.044500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea75f01-f71f-441a-a5ab-e5e2604e23a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:19:48.045898 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea75f01-f71f-441a-a5ab-e5e2604e23a9 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:19:48.055031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 745/1484] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:19:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:19:50.358122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c5231-3111-4040-846d-8b54b0179224 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:50.358709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c5231-3111-4040-846d-8b54b0179224 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:50.358709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c5231-3111-4040-846d-8b54b0179224 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:50.360059 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 740/1485] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:19:50.365323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd26399-dca0-41c7-8093-318451b5c30e None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:50.365899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd26399-dca0-41c7-8093-318451b5c30e None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:50.366589 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd26399-dca0-41c7-8093-318451b5c30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:50.384724 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-cfd26399-dca0-41c7-8093-318451b5c30e None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:19:50.385916 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-cfd26399-dca0-41c7-8093-318451b5c30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:19:50.393867 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 746/1486] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:19:50.431915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c5231-3111-4040-846d-8b54b0179224 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:19:50.442341 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c5231-3111-4040-846d-8b54b0179224 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:19:50.445836 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581a78a-e5ce-44af-8f5b-3d3cac39b99c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:19:50.446457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581a78a-e5ce-44af-8f5b-3d3cac39b99c service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:50.446735 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581a78a-e5ce-44af-8f5b-3d3cac39b99c service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:50.447004 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581a78a-e5ce-44af-8f5b-3d3cac39b99c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:50.455639 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581a78a-e5ce-44af-8f5b-3d3cac39b99c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:19:50.457088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581a78a-e5ce-44af-8f5b-3d3cac39b99c service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:19:50.466363 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 741/1487] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:19:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:19:52.957855 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc2af3-bac2-49ef-a235-821f9d014337 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:52.958467 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc2af3-bac2-49ef-a235-821f9d014337 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:52.958467 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc2af3-bac2-49ef-a235-821f9d014337 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:52.960492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 747/1488] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:19:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:19:52.965867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe91b20-cf31-4b90-a426-90a49b65dc3c None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:52.966310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe91b20-cf31-4b90-a426-90a49b65dc3c None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:52.966503 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe91b20-cf31-4b90-a426-90a49b65dc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:52.984573 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-afe91b20-cf31-4b90-a426-90a49b65dc3c None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:19:52.985757 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-afe91b20-cf31-4b90-a426-90a49b65dc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:19:52.993762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 742/1489] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:19:53.040215 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc2af3-bac2-49ef-a235-821f9d014337 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:19:53.050674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc2af3-bac2-49ef-a235-821f9d014337 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:19:53.054620 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b869049-bd0d-41a1-befc-bb08ccb8d2a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:19:53.055252 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b869049-bd0d-41a1-befc-bb08ccb8d2a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:53.055538 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b869049-bd0d-41a1-befc-bb08ccb8d2a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:53.055845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b869049-bd0d-41a1-befc-bb08ccb8d2a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:53.064585 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b869049-bd0d-41a1-befc-bb08ccb8d2a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:19:53.066009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b869049-bd0d-41a1-befc-bb08ccb8d2a3 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:19:53.075962 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 748/1490] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:19:55.493937 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddaae5a-bd42-4800-ba21-8696e09cb892 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:55.494488 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddaae5a-bd42-4800-ba21-8696e09cb892 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:55.494488 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddaae5a-bd42-4800-ba21-8696e09cb892 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:55.495743 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 743/1491] 10.222.0.71 () {54 vars in 926 bytes} [Mon May 16 20:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:19:55.500954 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c0780-70b2-4c32-b49d-4a6935284a04 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:55.501390 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c0780-70b2-4c32-b49d-4a6935284a04 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:55.501507 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c0780-70b2-4c32-b49d-4a6935284a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:55.520002 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-491c0780-70b2-4c32-b49d-4a6935284a04 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:19:55.521253 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-491c0780-70b2-4c32-b49d-4a6935284a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:19:55.530051 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 749/1492] 10.222.0.71 () {58 vars in 1023 bytes} [Mon May 16 20:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:19:55.570012 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddaae5a-bd42-4800-ba21-8696e09cb892 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:19:55.581368 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddaae5a-bd42-4800-ba21-8696e09cb892 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:19:55.585485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e011d-9579-4a20-90c0-4ffa26db2d69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:19:55.586111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e011d-9579-4a20-90c0-4ffa26db2d69 service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:19:55.586386 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e011d-9579-4a20-90c0-4ffa26db2d69 service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:19:55.586652 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e011d-9579-4a20-90c0-4ffa26db2d69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:19:55.595165 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e011d-9579-4a20-90c0-4ffa26db2d69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:19:55.596615 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e011d-9579-4a20-90c0-4ffa26db2d69 service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:19:55.605605 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 744/1493] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:19:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:21:24.345607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc50a6-8189-4914-aca1-97d5974d24fc None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:21:24.346198 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc50a6-8189-4914-aca1-97d5974d24fc None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:21:24.346198 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc50a6-8189-4914-aca1-97d5974d24fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:21:24.366332 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-22fc50a6-8189-4914-aca1-97d5974d24fc None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:21:24.367500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-22fc50a6-8189-4914-aca1-97d5974d24fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:21:24.375182 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 750/1494] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:21:24.384556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ec3d7-fa93-4bcc-a8b7-e277172f8602 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:21:24.385097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ec3d7-fa93-4bcc-a8b7-e277172f8602 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:21:24.385209 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ec3d7-fa93-4bcc-a8b7-e277172f8602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:21:24.402991 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-350ec3d7-fa93-4bcc-a8b7-e277172f8602 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:21:24.404202 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-350ec3d7-fa93-4bcc-a8b7-e277172f8602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:21:24.412430 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 745/1495] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:21:24.416925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc50a6-8189-4914-aca1-97d5974d24fc None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:21:24.426910 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc50a6-8189-4914-aca1-97d5974d24fc None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:21:24.431250 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a12c9f-fadb-4b3a-a4db-e52ac83bb748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:21:24.431893 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a12c9f-fadb-4b3a-a4db-e52ac83bb748 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:21:24.432205 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a12c9f-fadb-4b3a-a4db-e52ac83bb748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:21:24.432473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a12c9f-fadb-4b3a-a4db-e52ac83bb748 admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:21:24.433181 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a12c9f-fadb-4b3a-a4db-e52ac83bb748 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:21:24.433477 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a12c9f-fadb-4b3a-a4db-e52ac83bb748 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:21:24.434472 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: WARNING py.warnings [None req-78a12c9f-fadb-4b3a-a4db-e52ac83bb748 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 20:21:24.434472 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: warnings.warn(msg) May 16 20:21:24.434472 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: May 16 20:21:24.435334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a12c9f-fadb-4b3a-a4db-e52ac83bb748 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:21:24.446677 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 751/1496] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:21:24.454709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ec3d7-fa93-4bcc-a8b7-e277172f8602 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:21:24.463864 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ec3d7-fa93-4bcc-a8b7-e277172f8602 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:21:24.468432 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f85f9-bea5-4f6e-8697-10d6af5da794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:21:24.469075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f85f9-bea5-4f6e-8697-10d6af5da794 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:21:24.469359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f85f9-bea5-4f6e-8697-10d6af5da794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:21:24.469631 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f85f9-bea5-4f6e-8697-10d6af5da794 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:21:24.470304 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f85f9-bea5-4f6e-8697-10d6af5da794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:21:24.472083 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: WARNING py.warnings [None req-a02f85f9-bea5-4f6e-8697-10d6af5da794 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 20:21:24.472083 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: warnings.warn(msg) May 16 20:21:24.472083 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: May 16 20:21:24.473974 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f85f9-bea5-4f6e-8697-10d6af5da794 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:21:24.509147 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 746/1497] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:21:24 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:21:24.513404 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a12c9f-fadb-4b3a-a4db-e52ac83bb748 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:21:24.523588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a12c9f-fadb-4b3a-a4db-e52ac83bb748 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:21:24.577111 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fee7d-ac42-4cc8-b76f-681a05c055f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:21:24.577775 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fee7d-ac42-4cc8-b76f-681a05c055f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:21:24.578058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fee7d-ac42-4cc8-b76f-681a05c055f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:21:24.578333 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fee7d-ac42-4cc8-b76f-681a05c055f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:21:24.579039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fee7d-ac42-4cc8-b76f-681a05c055f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:21:24.580058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: WARNING py.warnings [None req-e10fee7d-ac42-4cc8-b76f-681a05c055f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 20:21:24.580058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: warnings.warn(msg) May 16 20:21:24.580058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: May 16 20:21:24.581307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fee7d-ac42-4cc8-b76f-681a05c055f0 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:21:24.601892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 752/1498] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:21:24 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:21:24.606236 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f85f9-bea5-4f6e-8697-10d6af5da794 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:21:24.616976 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f85f9-bea5-4f6e-8697-10d6af5da794 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:21:24.621419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24f095-ddeb-490a-ad84-66084cca858e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:21:24.622067 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24f095-ddeb-490a-ad84-66084cca858e admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:21:24.622347 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24f095-ddeb-490a-ad84-66084cca858e admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:21:24.622620 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24f095-ddeb-490a-ad84-66084cca858e admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:21:24.623335 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24f095-ddeb-490a-ad84-66084cca858e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:21:24.624376 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: WARNING py.warnings [None req-2c24f095-ddeb-490a-ad84-66084cca858e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 20:21:24.624376 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: warnings.warn(msg) May 16 20:21:24.624376 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: May 16 20:21:24.625254 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24f095-ddeb-490a-ad84-66084cca858e admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:21:24.638112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 747/1499] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:21:24.642364 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fee7d-ac42-4cc8-b76f-681a05c055f0 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:21:24.653244 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fee7d-ac42-4cc8-b76f-681a05c055f0 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:21:24.657848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750720b-6d2b-4b91-b673-befe8affa199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:21:24.658496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750720b-6d2b-4b91-b673-befe8affa199 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:21:24.658781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750720b-6d2b-4b91-b673-befe8affa199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:21:24.659070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750720b-6d2b-4b91-b673-befe8affa199 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:21:24.659789 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750720b-6d2b-4b91-b673-befe8affa199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:21:24.661588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: WARNING py.warnings [None req-c750720b-6d2b-4b91-b673-befe8affa199 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 20:21:24.661588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: warnings.warn(msg) May 16 20:21:24.661588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: May 16 20:21:24.662477 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750720b-6d2b-4b91-b673-befe8affa199 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:21:24.675435 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 753/1500] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:21:24.680182 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24f095-ddeb-490a-ad84-66084cca858e admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:21:24.690170 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24f095-ddeb-490a-ad84-66084cca858e admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:21:24.694955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434356f-7b58-4ab8-a0cd-2beda5e9496a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:21:24.695832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434356f-7b58-4ab8-a0cd-2beda5e9496a admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:21:24.696113 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434356f-7b58-4ab8-a0cd-2beda5e9496a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:21:24.696418 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434356f-7b58-4ab8-a0cd-2beda5e9496a admin admin] PATH_INFO: `/v3/projects/5cc692be59a14d578fbdf8928aa6fce8/users/9263987fefeb4f4f8c9e7827b8003743/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:21:24.711571 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434356f-7b58-4ab8-a0cd-2beda5e9496a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc692be59a14d578fbdf8928aa6fce8, user_id=9263987fefeb4f4f8c9e7827b8003743, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:21:24.712658 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: WARNING py.warnings [None req-7434356f-7b58-4ab8-a0cd-2beda5e9496a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 20:21:24.712658 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: warnings.warn(msg) May 16 20:21:24.712658 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: May 16 20:21:24.714593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434356f-7b58-4ab8-a0cd-2beda5e9496a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:21:24.727921 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 748/1501] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:21:24 2022] PUT /identity/v3/projects/5cc692be59a14d578fbdf8928aa6fce8/users/9263987fefeb4f4f8c9e7827b8003743/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:21:24.739092 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37319b8a-db8d-4917-8127-c36988336f2f None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:21:24.739384 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37319b8a-db8d-4917-8127-c36988336f2f None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:21:24.739664 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37319b8a-db8d-4917-8127-c36988336f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:21:24.765154 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-37319b8a-db8d-4917-8127-c36988336f2f None None] MFA Rules not processed for user `9263987fefeb4f4f8c9e7827b8003743`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:21:24.766364 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-37319b8a-db8d-4917-8127-c36988336f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:21:24.827745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 754/1502] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:21:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:21:24.841781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0391fe6-3221-4a4b-833f-2351994f1bcf None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:21:24.842075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0391fe6-3221-4a4b-833f-2351994f1bcf None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:21:24.842359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0391fe6-3221-4a4b-833f-2351994f1bcf None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:21:24.843727 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 749/1503] 10.222.0.71 () {54 vars in 963 bytes} [Mon May 16 20:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:21:24.849390 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7d159-98dd-4d03-b872-5f300f0e0950 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:21:24.849804 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7d159-98dd-4d03-b872-5f300f0e0950 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:21:24.850177 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7d159-98dd-4d03-b872-5f300f0e0950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:21:24.868378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-18f7d159-98dd-4d03-b872-5f300f0e0950 None None] MFA Rules not processed for user `89f45690463c48ad8e95c167be6fc9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:21:24.869490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-18f7d159-98dd-4d03-b872-5f300f0e0950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:21:24.918434 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 755/1504] 10.222.0.71 () {58 vars in 1060 bytes} [Mon May 16 20:21:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:21:24.926250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0391fe6-3221-4a4b-833f-2351994f1bcf None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:21:24.937166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0391fe6-3221-4a4b-833f-2351994f1bcf None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:21:24.940794 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc5fff-2e4d-422a-bee6-22794422926c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:21:24.941477 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc5fff-2e4d-422a-bee6-22794422926c service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:21:24.942067 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc5fff-2e4d-422a-bee6-22794422926c service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:21:24.942067 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc5fff-2e4d-422a-bee6-22794422926c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:21:24.950232 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc5fff-2e4d-422a-bee6-22794422926c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:21:24.951662 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc5fff-2e4d-422a-bee6-22794422926c service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:21:24.962641 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 750/1505] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:21:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:21:25.006555 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae2baf-d6ef-4f66-8556-57bb6c729b78 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:21:25.006845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae2baf-d6ef-4f66-8556-57bb6c729b78 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:21:25.007146 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae2baf-d6ef-4f66-8556-57bb6c729b78 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:21:25.008540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 756/1506] 10.222.0.71 () {52 vars in 829 bytes} [Mon May 16 20:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:21:25.012204 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc5fff-2e4d-422a-bee6-22794422926c service cinder] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:21:25.072853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc5fff-2e4d-422a-bee6-22794422926c service cinder] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:21:25.077284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a24717-24b6-446f-8ef6-6a8d8ee875b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:21:25.078133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a24717-24b6-446f-8ef6-6a8d8ee875b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:21:25.078409 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a24717-24b6-446f-8ef6-6a8d8ee875b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:21:25.078675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a24717-24b6-446f-8ef6-6a8d8ee875b0 admin admin] PATH_INFO: `/v3/users/9263987fefeb4f4f8c9e7827b8003743` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:21:25.079919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a24717-24b6-446f-8ef6-6a8d8ee875b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9263987fefeb4f4f8c9e7827b8003743)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:21:25.080961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: WARNING py.warnings [None req-31a24717-24b6-446f-8ef6-6a8d8ee875b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 20:21:25.080961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: warnings.warn(msg) May 16 20:21:25.080961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: May 16 20:21:25.082774 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a24717-24b6-446f-8ef6-6a8d8ee875b0 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:21:25.147779 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-31a24717-24b6-446f-8ef6-6a8d8ee875b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9263987fefeb4f4f8c9e7827b8003743'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:21:25.148463 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-31a24717-24b6-446f-8ef6-6a8d8ee875b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9263987fefeb4f4f8c9e7827b8003743'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:21:25.161694 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-31a24717-24b6-446f-8ef6-6a8d8ee875b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9263987fefeb4f4f8c9e7827b8003743'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:21:25.171233 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-31a24717-24b6-446f-8ef6-6a8d8ee875b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9263987fefeb4f4f8c9e7827b8003743'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:21:25.190362 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-31a24717-24b6-446f-8ef6-6a8d8ee875b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9263987fefeb4f4f8c9e7827b8003743'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:21:25.204263 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 751/1507] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:21:25 2022] DELETE /identity/v3/users/9263987fefeb4f4f8c9e7827b8003743 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:21:25.209387 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dc4a8-e366-426e-99a5-809aa3999e16 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:21:25.209786 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dc4a8-e366-426e-99a5-809aa3999e16 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:21:25.210081 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dc4a8-e366-426e-99a5-809aa3999e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:21:25.230574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-876dc4a8-e366-426e-99a5-809aa3999e16 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:21:25.231792 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-876dc4a8-e366-426e-99a5-809aa3999e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:21:25.288213 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 757/1508] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:21:25.297895 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a24717-24b6-446f-8ef6-6a8d8ee875b0 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:21:25.299293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-31a24717-24b6-446f-8ef6-6a8d8ee875b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:21:25.354936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a24717-24b6-446f-8ef6-6a8d8ee875b0 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:21:25.358590 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d6c05-3dd3-487b-8a93-07b2231c9224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:21:25.359230 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d6c05-3dd3-487b-8a93-07b2231c9224 service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:21:25.359510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d6c05-3dd3-487b-8a93-07b2231c9224 service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:21:25.359784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d6c05-3dd3-487b-8a93-07b2231c9224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:21:25.369874 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d6c05-3dd3-487b-8a93-07b2231c9224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:21:25.371325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d6c05-3dd3-487b-8a93-07b2231c9224 service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:21:25.381360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 752/1509] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:21:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:21:25.708293 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dc4a8-e366-426e-99a5-809aa3999e16 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:21:25.709807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-876dc4a8-e366-426e-99a5-809aa3999e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:21:25.721976 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dc4a8-e366-426e-99a5-809aa3999e16 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:21:25.727461 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd507b5d-58ec-4bbb-a7b9-ceca410b711b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:21:25.728396 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd507b5d-58ec-4bbb-a7b9-ceca410b711b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:21:25.728659 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd507b5d-58ec-4bbb-a7b9-ceca410b711b admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:21:25.728937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd507b5d-58ec-4bbb-a7b9-ceca410b711b admin admin] PATH_INFO: `/v3/projects/5cc692be59a14d578fbdf8928aa6fce8` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:21:25.730325 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd507b5d-58ec-4bbb-a7b9-ceca410b711b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cc692be59a14d578fbdf8928aa6fce8)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:21:25.731375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: WARNING py.warnings [None req-cd507b5d-58ec-4bbb-a7b9-ceca410b711b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 20:21:25.731375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: warnings.warn(msg) May 16 20:21:25.731375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: May 16 20:21:25.732623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd507b5d-58ec-4bbb-a7b9-ceca410b711b admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:21:25.793913 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-cd507b5d-58ec-4bbb-a7b9-ceca410b711b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cc692be59a14d578fbdf8928aa6fce8', 'request_id': 'req-cd507b5d-58ec-4bbb-a7b9-ceca410b711b'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:21:25.799531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-cd507b5d-58ec-4bbb-a7b9-ceca410b711b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cc692be59a14d578fbdf8928aa6fce8', 'request_id': 'req-cd507b5d-58ec-4bbb-a7b9-ceca410b711b'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:21:25.809379 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-cd507b5d-58ec-4bbb-a7b9-ceca410b711b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cc692be59a14d578fbdf8928aa6fce8', 'request_id': 'req-cd507b5d-58ec-4bbb-a7b9-ceca410b711b'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:21:25.828341 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-cd507b5d-58ec-4bbb-a7b9-ceca410b711b admin admin] The token cache is being invalidate because project 5cc692be59a14d578fbdf8928aa6fce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:21:25.828635 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-cd507b5d-58ec-4bbb-a7b9-ceca410b711b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:21:25.829300 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-cd507b5d-58ec-4bbb-a7b9-ceca410b711b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:21:25.830965 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 758/1510] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:21:25 2022] DELETE /identity/v3/projects/5cc692be59a14d578fbdf8928aa6fce8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:23:04.789959 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d7ed3-271a-4bc9-96c9-e01c63a49331 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:04.790570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d7ed3-271a-4bc9-96c9-e01c63a49331 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:04.790570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d7ed3-271a-4bc9-96c9-e01c63a49331 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:04.791924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 20:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:04.796880 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b79148-0ff3-4839-abe3-2dc3b8e3581a None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:04.797335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b79148-0ff3-4839-abe3-2dc3b8e3581a None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:04.797439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b79148-0ff3-4839-abe3-2dc3b8e3581a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:04.816240 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-b0b79148-0ff3-4839-abe3-2dc3b8e3581a None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:04.817708 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-b0b79148-0ff3-4839-abe3-2dc3b8e3581a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:04.875203 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 20:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:23:05.043122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d7ed3-271a-4bc9-96c9-e01c63a49331 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:05.044771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-103d7ed3-271a-4bc9-96c9-e01c63a49331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:05.124835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d7ed3-271a-4bc9-96c9-e01c63a49331 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:05.130526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41ce66-7342-465f-a8da-20ba28958f80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:05.131171 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41ce66-7342-465f-a8da-20ba28958f80 service nova] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:05.131454 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41ce66-7342-465f-a8da-20ba28958f80 service nova] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:05.131728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41ce66-7342-465f-a8da-20ba28958f80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:05.139886 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41ce66-7342-465f-a8da-20ba28958f80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:05.141508 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41ce66-7342-465f-a8da-20ba28958f80 service nova] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:05.151825 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 754/1513] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:23:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:23:06.074317 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95698d-a1e1-44c6-bd39-78fe1e5b3fac None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:06.075258 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95698d-a1e1-44c6-bd39-78fe1e5b3fac None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:06.075625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95698d-a1e1-44c6-bd39-78fe1e5b3fac None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:06.077072 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 20:23:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:06.084939 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe46d13-c991-4545-a837-fdccf86819ed None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:06.085465 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe46d13-c991-4545-a837-fdccf86819ed None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:06.085561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe46d13-c991-4545-a837-fdccf86819ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:06.108572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-cbe46d13-c991-4545-a837-fdccf86819ed None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:06.109775 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-cbe46d13-c991-4545-a837-fdccf86819ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:06.118591 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 20:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:23:06.119219 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322c346-d4d7-40fc-a7f0-76628fe6b275 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:06.119510 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322c346-d4d7-40fc-a7f0-76628fe6b275 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:06.119813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322c346-d4d7-40fc-a7f0-76628fe6b275 None None] PATH_INFO: `/v3` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:06.121166 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 761/1516] 10.222.0.81 () {54 vars in 925 bytes} [Mon May 16 20:23:06 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:23:06.127206 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955b7d6-f1de-406b-bd01-78297b9fdd76 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:06.127492 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955b7d6-f1de-406b-bd01-78297b9fdd76 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:06.127766 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955b7d6-f1de-406b-bd01-78297b9fdd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:06.145994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-3955b7d6-f1de-406b-bd01-78297b9fdd76 None None] MFA Rules not processed for user `72e2c8b4ff2349919750aa0f3f7309bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:06.147141 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-3955b7d6-f1de-406b-bd01-78297b9fdd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:06.209457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 756/1517] 10.222.0.81 () {58 vars in 1015 bytes} [Mon May 16 20:23:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:23:06.273768 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322c346-d4d7-40fc-a7f0-76628fe6b275 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:06.287687 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322c346-d4d7-40fc-a7f0-76628fe6b275 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:06.293038 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5ea55-9deb-4d65-8d54-9d7f861e5235 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:06.293659 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5ea55-9deb-4d65-8d54-9d7f861e5235 service nova] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:06.293941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5ea55-9deb-4d65-8d54-9d7f861e5235 service nova] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:06.294218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5ea55-9deb-4d65-8d54-9d7f861e5235 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:06.302312 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5ea55-9deb-4d65-8d54-9d7f861e5235 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:06.303914 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5ea55-9deb-4d65-8d54-9d7f861e5235 service nova] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:06.313200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 762/1518] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:23:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:23:10.037833 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba171f-2073-466e-8143-9686c3d2bf58 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:10.038376 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba171f-2073-466e-8143-9686c3d2bf58 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:10.038376 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba171f-2073-466e-8143-9686c3d2bf58 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:10.039680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 757/1519] 10.222.0.71 () {54 vars in 960 bytes} [Mon May 16 20:23:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:10.044920 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d13fd-8930-40fe-96e6-9b0793a4d031 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:10.045438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d13fd-8930-40fe-96e6-9b0793a4d031 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:10.045548 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d13fd-8930-40fe-96e6-9b0793a4d031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:10.064341 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-053d13fd-8930-40fe-96e6-9b0793a4d031 None None] MFA Rules not processed for user `72e2c8b4ff2349919750aa0f3f7309bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:10.065569 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-053d13fd-8930-40fe-96e6-9b0793a4d031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:10.075516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 763/1520] 10.222.0.71 () {58 vars in 1057 bytes} [Mon May 16 20:23:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:23:10.083616 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba171f-2073-466e-8143-9686c3d2bf58 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:10.096710 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba171f-2073-466e-8143-9686c3d2bf58 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:10.103776 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44889be-f1f4-45d1-84c0-3296682d2498 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e2c8b4ff2349919750aa0f3f7309bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:10.104432 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44889be-f1f4-45d1-84c0-3296682d2498 service placement] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:10.104714 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44889be-f1f4-45d1-84c0-3296682d2498 service placement] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:10.104988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44889be-f1f4-45d1-84c0-3296682d2498 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:10.113889 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44889be-f1f4-45d1-84c0-3296682d2498 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:10.115996 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44889be-f1f4-45d1-84c0-3296682d2498 service placement] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:10.125570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 758/1521] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:23:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:23:17.638914 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d45e7-1452-4949-9729-2552f0690f3f None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:17.639492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d45e7-1452-4949-9729-2552f0690f3f None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:17.639492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d45e7-1452-4949-9729-2552f0690f3f None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:17.640871 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 20:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:17.646589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c833381-726e-47b2-92d6-7406279f0188 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:17.647029 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c833381-726e-47b2-92d6-7406279f0188 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:17.647133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c833381-726e-47b2-92d6-7406279f0188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:17.665127 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-9c833381-726e-47b2-92d6-7406279f0188 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:17.666314 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-9c833381-726e-47b2-92d6-7406279f0188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:17.674074 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 20:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:23:17.824969 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d45e7-1452-4949-9729-2552f0690f3f None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:17.839133 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d45e7-1452-4949-9729-2552f0690f3f None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:17.844633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e174f22-1b00-468a-8c9d-36f98d16f883 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:17.845246 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e174f22-1b00-468a-8c9d-36f98d16f883 service nova] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:17.845531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e174f22-1b00-468a-8c9d-36f98d16f883 service nova] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:17.845807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e174f22-1b00-468a-8c9d-36f98d16f883 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:17.858253 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e174f22-1b00-468a-8c9d-36f98d16f883 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:17.859867 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e174f22-1b00-468a-8c9d-36f98d16f883 service nova] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:17.870311 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 765/1524] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:23:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:23:18.767640 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46de117-5d35-465a-995f-54b80116c6d3 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:18.768241 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46de117-5d35-465a-995f-54b80116c6d3 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:18.768241 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46de117-5d35-465a-995f-54b80116c6d3 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:18.769852 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 20:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:23:18.775266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27171a0e-613e-42f2-9e71-5dfe871ce5c8 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:18.775695 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27171a0e-613e-42f2-9e71-5dfe871ce5c8 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:18.775821 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27171a0e-613e-42f2-9e71-5dfe871ce5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:18.793804 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-27171a0e-613e-42f2-9e71-5dfe871ce5c8 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:18.794974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-27171a0e-613e-42f2-9e71-5dfe871ce5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:18.802938 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 20:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:23:18.956163 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46de117-5d35-465a-995f-54b80116c6d3 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:18.971066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46de117-5d35-465a-995f-54b80116c6d3 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:18.977072 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44ec4d-cdc1-43d0-b04e-d1fc76a0bf9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:18.977704 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44ec4d-cdc1-43d0-b04e-d1fc76a0bf9d service nova] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:18.977987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44ec4d-cdc1-43d0-b04e-d1fc76a0bf9d service nova] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:18.978263 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44ec4d-cdc1-43d0-b04e-d1fc76a0bf9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:18.986225 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44ec4d-cdc1-43d0-b04e-d1fc76a0bf9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:18.987810 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44ec4d-cdc1-43d0-b04e-d1fc76a0bf9d service nova] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:18.997376 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 761/1527] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:23:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:23:22.953018 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa93d25-fbeb-4578-bee7-8779a6928ed5 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:22.953558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa93d25-fbeb-4578-bee7-8779a6928ed5 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:22.953558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa93d25-fbeb-4578-bee7-8779a6928ed5 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:22.954920 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:22.961218 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0665fc1-9acc-4b88-baab-258ce263223c None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:22.961662 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0665fc1-9acc-4b88-baab-258ce263223c None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:22.961806 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0665fc1-9acc-4b88-baab-258ce263223c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:22.979599 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-e0665fc1-9acc-4b88-baab-258ce263223c None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:22.980844 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-e0665fc1-9acc-4b88-baab-258ce263223c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:22.988638 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:23:23.025886 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa93d25-fbeb-4578-bee7-8779a6928ed5 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:23.027622 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-5fa93d25-fbeb-4578-bee7-8779a6928ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:23.084143 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa93d25-fbeb-4578-bee7-8779a6928ed5 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:23.087661 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d1f27-ed48-4e8b-930d-1b87fd833c01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:23.088341 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d1f27-ed48-4e8b-930d-1b87fd833c01 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:23.088626 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d1f27-ed48-4e8b-930d-1b87fd833c01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:23.088903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d1f27-ed48-4e8b-930d-1b87fd833c01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:23.097611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d1f27-ed48-4e8b-930d-1b87fd833c01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:23.099060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d1f27-ed48-4e8b-930d-1b87fd833c01 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:23.108641 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 768/1530] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:23:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:23:25.336722 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e0520-48b1-4a26-9c8b-c54f2bd1d58e None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:25.337297 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e0520-48b1-4a26-9c8b-c54f2bd1d58e None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:25.337297 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e0520-48b1-4a26-9c8b-c54f2bd1d58e None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:25.338646 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:25.343999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9eb6ef-8ca8-485b-afd5-9122a034b46c None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:25.344448 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9eb6ef-8ca8-485b-afd5-9122a034b46c None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:25.344627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9eb6ef-8ca8-485b-afd5-9122a034b46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:25.363326 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-ac9eb6ef-8ca8-485b-afd5-9122a034b46c None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:25.364569 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-ac9eb6ef-8ca8-485b-afd5-9122a034b46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:25.372951 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:23:25.408300 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e0520-48b1-4a26-9c8b-c54f2bd1d58e None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:25.419455 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e0520-48b1-4a26-9c8b-c54f2bd1d58e None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:25.422904 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d60bdf-11fa-4884-a985-3b3af7835a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:25.423526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d60bdf-11fa-4884-a985-3b3af7835a6c service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:25.423802 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d60bdf-11fa-4884-a985-3b3af7835a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:25.424074 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d60bdf-11fa-4884-a985-3b3af7835a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:25.432872 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d60bdf-11fa-4884-a985-3b3af7835a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:25.434283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d60bdf-11fa-4884-a985-3b3af7835a6c service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:25.443443 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 764/1533] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:23:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:23:29.286772 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114ef4c-a0f0-48ec-82df-450935842761 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:29.287542 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114ef4c-a0f0-48ec-82df-450935842761 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:29.287542 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114ef4c-a0f0-48ec-82df-450935842761 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:29.288738 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:23:29.294074 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9f3fc-824c-4653-a5a4-742bf939277f None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:29.294537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9f3fc-824c-4653-a5a4-742bf939277f None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:29.294642 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9f3fc-824c-4653-a5a4-742bf939277f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:29.313352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-e0a9f3fc-824c-4653-a5a4-742bf939277f None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:29.314543 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-e0a9f3fc-824c-4653-a5a4-742bf939277f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:29.323355 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:23:29.597611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114ef4c-a0f0-48ec-82df-450935842761 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:29.599298 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-6114ef4c-a0f0-48ec-82df-450935842761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:29.654316 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114ef4c-a0f0-48ec-82df-450935842761 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:29.657837 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcc4ee-b17e-4924-87c7-8c4adacf9740 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:29.658473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcc4ee-b17e-4924-87c7-8c4adacf9740 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:29.658752 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcc4ee-b17e-4924-87c7-8c4adacf9740 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:29.659022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcc4ee-b17e-4924-87c7-8c4adacf9740 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:29.667930 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcc4ee-b17e-4924-87c7-8c4adacf9740 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:29.669361 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcc4ee-b17e-4924-87c7-8c4adacf9740 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:29.678487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 771/1536] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:23:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:23:31.983651 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae46b5-b7f8-4da0-b90e-ff2b0c4f49b6 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:31.984274 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae46b5-b7f8-4da0-b90e-ff2b0c4f49b6 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:31.984274 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae46b5-b7f8-4da0-b90e-ff2b0c4f49b6 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:31.985633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 20:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 20:23:31.991049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13debc-1ded-44b2-949e-cdcccc4b43f9 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:31.991465 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13debc-1ded-44b2-949e-cdcccc4b43f9 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:31.991607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13debc-1ded-44b2-949e-cdcccc4b43f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:32.011352 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-6e13debc-1ded-44b2-949e-cdcccc4b43f9 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:23:32.012602 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-6e13debc-1ded-44b2-949e-cdcccc4b43f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:32.020632 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 20:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:23:32.298029 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae46b5-b7f8-4da0-b90e-ff2b0c4f49b6 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:23:32.299794 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-5cae46b5-b7f8-4da0-b90e-ff2b0c4f49b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:23:32.314830 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae46b5-b7f8-4da0-b90e-ff2b0c4f49b6 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:23:32.319064 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6cb1a9-cd60-4626-a2f4-a1805605705a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:23:32.319688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cb1a9-cd60-4626-a2f4-a1805605705a service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:23:32.319965 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cb1a9-cd60-4626-a2f4-a1805605705a service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:23:32.320274 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cb1a9-cd60-4626-a2f4-a1805605705a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:23:32.328958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6cb1a9-cd60-4626-a2f4-a1805605705a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:23:32.330374 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6cb1a9-cd60-4626-a2f4-a1805605705a service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:23:32.339436 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 767/1539] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:23:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:01.878195 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17330033-ee6f-442b-bccb-d471d3eaa7fc None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:01.878874 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17330033-ee6f-442b-bccb-d471d3eaa7fc None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:01.878874 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17330033-ee6f-442b-bccb-d471d3eaa7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:01.899555 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90796e4b-3a6a-4771-8c41-9a3aa418d370 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:01.900224 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90796e4b-3a6a-4771-8c41-9a3aa418d370 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:01.900224 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90796e4b-3a6a-4771-8c41-9a3aa418d370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:01.928030 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-90796e4b-3a6a-4771-8c41-9a3aa418d370 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:01.930394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-17330033-ee6f-442b-bccb-d471d3eaa7fc None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:01.931650 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-17330033-ee6f-442b-bccb-d471d3eaa7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:01.932777 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-90796e4b-3a6a-4771-8c41-9a3aa418d370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:01.942484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 773/1540] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:25:01.947028 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 768/1541] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:01.954515 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2781fb-fd53-4238-97f8-b21d2cae586a None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:01.954869 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2781fb-fd53-4238-97f8-b21d2cae586a None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:01.955139 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2781fb-fd53-4238-97f8-b21d2cae586a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:01.957290 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba188dc5-8670-48eb-8b6b-4da05d06f727 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:01.957591 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba188dc5-8670-48eb-8b6b-4da05d06f727 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:01.957869 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba188dc5-8670-48eb-8b6b-4da05d06f727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:01.981685 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-ba188dc5-8670-48eb-8b6b-4da05d06f727 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:01.983004 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-ba188dc5-8670-48eb-8b6b-4da05d06f727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:01.987082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-6b2781fb-fd53-4238-97f8-b21d2cae586a None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:01.988378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-6b2781fb-fd53-4238-97f8-b21d2cae586a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:01.994915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 769/1542] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:25:01.996851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e8071-4498-493d-bde6-ebf0dc18f289 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:01.997137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e8071-4498-493d-bde6-ebf0dc18f289 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:01.997414 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e8071-4498-493d-bde6-ebf0dc18f289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.000995 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 774/1543] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:02.001881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2781fb-fd53-4238-97f8-b21d2cae586a None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:02.019944 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-e72e8071-4498-493d-bde6-ebf0dc18f289 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:02.021480 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-e72e8071-4498-493d-bde6-ebf0dc18f289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:02.021702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2781fb-fd53-4238-97f8-b21d2cae586a None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:02.032580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cc633-f200-4d8c-a81c-e08d9b126e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:02.033280 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cc633-f200-4d8c-a81c-e08d9b126e7e admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.033568 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cc633-f200-4d8c-a81c-e08d9b126e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.033848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cc633-f200-4d8c-a81c-e08d9b126e7e admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.034607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4cc633-f200-4d8c-a81c-e08d9b126e7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:02.034915 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4cc633-f200-4d8c-a81c-e08d9b126e7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:02.036672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4cc633-f200-4d8c-a81c-e08d9b126e7e admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:02.040209 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 770/1544] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:02.041606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3f0cb-9bd0-4eee-8a46-9572d04a9985 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.041894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3f0cb-9bd0-4eee-8a46-9572d04a9985 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.042149 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3f0cb-9bd0-4eee-8a46-9572d04a9985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.062605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 775/1545] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:02.063662 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cc633-f200-4d8c-a81c-e08d9b126e7e admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:02.072775 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-2ba3f0cb-9bd0-4eee-8a46-9572d04a9985 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:02.074308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-2ba3f0cb-9bd0-4eee-8a46-9572d04a9985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:02.075806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cc633-f200-4d8c-a81c-e08d9b126e7e admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:02.083024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 771/1546] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:02.085846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f0ff0-9ad0-4b3a-9499-96e3877bcb12 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.086211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f0ff0-9ad0-4b3a-9499-96e3877bcb12 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.086458 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f0ff0-9ad0-4b3a-9499-96e3877bcb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.096944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274763c7-c48f-45b9-a7de-0307640ef500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:02.097624 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274763c7-c48f-45b9-a7de-0307640ef500 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.097914 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274763c7-c48f-45b9-a7de-0307640ef500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.098194 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274763c7-c48f-45b9-a7de-0307640ef500 admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.098939 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274763c7-c48f-45b9-a7de-0307640ef500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:02.099373 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274763c7-c48f-45b9-a7de-0307640ef500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:02.102149 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274763c7-c48f-45b9-a7de-0307640ef500 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:02.108654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-017f0ff0-9ad0-4b3a-9499-96e3877bcb12 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:02.110011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-017f0ff0-9ad0-4b3a-9499-96e3877bcb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:02.118998 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 772/1547] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:02.120389 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f0ff0-9ad0-4b3a-9499-96e3877bcb12 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:02.123658 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 776/1548] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:02.130407 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b32a7-d876-4fd4-98b2-32040be7abf5 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.130407 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b32a7-d876-4fd4-98b2-32040be7abf5 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.130407 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b32a7-d876-4fd4-98b2-32040be7abf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.145301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f0ff0-9ad0-4b3a-9499-96e3877bcb12 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:02.149607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-a89b32a7-d876-4fd4-98b2-32040be7abf5 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:02.150967 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-a89b32a7-d876-4fd4-98b2-32040be7abf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:02.156167 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719d7af-6ade-4b4d-8237-54d79f794d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:02.157397 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719d7af-6ade-4b4d-8237-54d79f794d61 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.157861 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719d7af-6ade-4b4d-8237-54d79f794d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.158301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719d7af-6ade-4b4d-8237-54d79f794d61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.159436 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719d7af-6ade-4b4d-8237-54d79f794d61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:02.160183 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 777/1549] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:02.161637 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0d35c-7cd2-44a6-b813-80a17a29a944 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.162004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0d35c-7cd2-44a6-b813-80a17a29a944 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.162396 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0d35c-7cd2-44a6-b813-80a17a29a944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.168015 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719d7af-6ade-4b4d-8237-54d79f794d61 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:02.182969 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-7df0d35c-7cd2-44a6-b813-80a17a29a944 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:02.184604 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-7df0d35c-7cd2-44a6-b813-80a17a29a944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:02.200569 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 778/1550] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:02.202317 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99943e7-7843-4735-8dad-6a1aa8784f7e None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.202688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99943e7-7843-4735-8dad-6a1aa8784f7e None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.203046 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99943e7-7843-4735-8dad-6a1aa8784f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.226844 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 773/1551] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:02 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:02.227442 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719d7af-6ade-4b4d-8237-54d79f794d61 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:02.227773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-a99943e7-7843-4735-8dad-6a1aa8784f7e None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:02.228752 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-a99943e7-7843-4735-8dad-6a1aa8784f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:02.296722 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719d7af-6ade-4b4d-8237-54d79f794d61 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:02.296979 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 779/1552] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:02.297728 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99943e7-7843-4735-8dad-6a1aa8784f7e None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:02.301619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e52f98-9ed5-4596-9d30-32efaf56d688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:02.302297 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e52f98-9ed5-4596-9d30-32efaf56d688 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.302568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e52f98-9ed5-4596-9d30-32efaf56d688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.302844 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e52f98-9ed5-4596-9d30-32efaf56d688 admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.304179 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e52f98-9ed5-4596-9d30-32efaf56d688 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:02.304579 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e52f98-9ed5-4596-9d30-32efaf56d688 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:02.305600 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: WARNING py.warnings [None req-92e52f98-9ed5-4596-9d30-32efaf56d688 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 20:25:02.305600 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: warnings.warn(msg) May 16 20:25:02.305600 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: May 16 20:25:02.306489 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e52f98-9ed5-4596-9d30-32efaf56d688 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:02.311910 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99943e7-7843-4735-8dad-6a1aa8784f7e None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:02.316786 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15dbc5-4996-47ca-be74-451cbfb20f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:02.317468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15dbc5-4996-47ca-be74-451cbfb20f55 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.317747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15dbc5-4996-47ca-be74-451cbfb20f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.318022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15dbc5-4996-47ca-be74-451cbfb20f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.318168 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 774/1553] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:02.318712 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15dbc5-4996-47ca-be74-451cbfb20f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:02.319337 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23b060-e8d1-4e20-8570-d960fd448686 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.319632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23b060-e8d1-4e20-8570-d960fd448686 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.319805 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: WARNING py.warnings [None req-7f15dbc5-4996-47ca-be74-451cbfb20f55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 20:25:02.319805 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: warnings.warn(msg) May 16 20:25:02.319805 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: May 16 20:25:02.320233 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23b060-e8d1-4e20-8570-d960fd448686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.321056 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15dbc5-4996-47ca-be74-451cbfb20f55 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:02.345287 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-ab23b060-e8d1-4e20-8570-d960fd448686 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:02.346787 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-ab23b060-e8d1-4e20-8570-d960fd448686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:02.354035 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 780/1554] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:02 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:02.354892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15dbc5-4996-47ca-be74-451cbfb20f55 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:02.356850 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 775/1555] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:02.358604 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f446804-39eb-4e40-9a43-a2a2385d6908 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.358884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f446804-39eb-4e40-9a43-a2a2385d6908 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.359158 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f446804-39eb-4e40-9a43-a2a2385d6908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.376721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-5f446804-39eb-4e40-9a43-a2a2385d6908 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:02.377970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-5f446804-39eb-4e40-9a43-a2a2385d6908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:02.419475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15dbc5-4996-47ca-be74-451cbfb20f55 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:02.424089 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d66b42-51ae-4bf6-aab7-30f1b33434ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:02.424821 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d66b42-51ae-4bf6-aab7-30f1b33434ee admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.425109 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d66b42-51ae-4bf6-aab7-30f1b33434ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.425540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d66b42-51ae-4bf6-aab7-30f1b33434ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.426276 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d66b42-51ae-4bf6-aab7-30f1b33434ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:02.426585 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d66b42-51ae-4bf6-aab7-30f1b33434ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:02.428250 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d66b42-51ae-4bf6-aab7-30f1b33434ee admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:02.438358 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 776/1556] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:02.439580 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93411270-dcb2-4b92-9877-2af6647fb373 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.439873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93411270-dcb2-4b92-9877-2af6647fb373 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.446531 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93411270-dcb2-4b92-9877-2af6647fb373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.446713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 781/1557] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:02.446713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d66b42-51ae-4bf6-aab7-30f1b33434ee admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:02.451280 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d66b42-51ae-4bf6-aab7-30f1b33434ee admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:02.455752 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea91330-9f99-4793-999e-f93618bd009e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:02.456468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea91330-9f99-4793-999e-f93618bd009e admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.456751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea91330-9f99-4793-999e-f93618bd009e admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.457023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea91330-9f99-4793-999e-f93618bd009e admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.457708 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea91330-9f99-4793-999e-f93618bd009e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:02.459626 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea91330-9f99-4793-999e-f93618bd009e admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:02.464327 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-93411270-dcb2-4b92-9877-2af6647fb373 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:02.465505 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-93411270-dcb2-4b92-9877-2af6647fb373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:02.473611 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 777/1558] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:02.474651 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069a984-c78a-4333-9f88-9218727eac45 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.474932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069a984-c78a-4333-9f88-9218727eac45 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.475202 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069a984-c78a-4333-9f88-9218727eac45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.486606 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 782/1559] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:02 2022] POST /identity/v3/users => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:02.487539 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea91330-9f99-4793-999e-f93618bd009e admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:02.495648 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-a069a984-c78a-4333-9f88-9218727eac45 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:02.496878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-a069a984-c78a-4333-9f88-9218727eac45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:02.497482 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea91330-9f99-4793-999e-f93618bd009e admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:02.502012 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ed1ad-6cad-4064-a1f5-9d7d54d6ce19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:02.502660 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ed1ad-6cad-4064-a1f5-9d7d54d6ce19 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.502946 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ed1ad-6cad-4064-a1f5-9d7d54d6ce19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.503221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ed1ad-6cad-4064-a1f5-9d7d54d6ce19 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.503901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ed1ad-6cad-4064-a1f5-9d7d54d6ce19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:02.504895 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 778/1560] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:02.505399 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069a984-c78a-4333-9f88-9218727eac45 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:02.505832 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ed1ad-6cad-4064-a1f5-9d7d54d6ce19 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:02.514349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069a984-c78a-4333-9f88-9218727eac45 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:02.519149 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fd108-c255-477a-87ea-a60da9b34531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:02.519675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fd108-c255-477a-87ea-a60da9b34531 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.519957 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fd108-c255-477a-87ea-a60da9b34531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.520255 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fd108-c255-477a-87ea-a60da9b34531 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.520956 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fd108-c255-477a-87ea-a60da9b34531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:02.521933 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: WARNING py.warnings [None req-247fd108-c255-477a-87ea-a60da9b34531 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 20:25:02.521933 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: warnings.warn(msg) May 16 20:25:02.521933 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: May 16 20:25:02.523657 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fd108-c255-477a-87ea-a60da9b34531 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:02.532450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 783/1561] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:02 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:02.533278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ed1ad-6cad-4064-a1f5-9d7d54d6ce19 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:02.546215 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 779/1562] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:02 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:02.548096 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e178e-facf-4079-a5dd-47c554686856 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.548497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e178e-facf-4079-a5dd-47c554686856 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.548842 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e178e-facf-4079-a5dd-47c554686856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.565979 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-9b1e178e-facf-4079-a5dd-47c554686856 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:02.567169 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-9b1e178e-facf-4079-a5dd-47c554686856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:02.598715 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ed1ad-6cad-4064-a1f5-9d7d54d6ce19 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:02.604171 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2898d8-aa82-4982-8a4e-f2f8fed2e3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:02.604843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2898d8-aa82-4982-8a4e-f2f8fed2e3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.605123 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2898d8-aa82-4982-8a4e-f2f8fed2e3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.605394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2898d8-aa82-4982-8a4e-f2f8fed2e3e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.606133 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2898d8-aa82-4982-8a4e-f2f8fed2e3e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:02.606439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2898d8-aa82-4982-8a4e-f2f8fed2e3e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:02.608072 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2898d8-aa82-4982-8a4e-f2f8fed2e3e1 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:02.619357 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 784/1563] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:02.620184 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2898d8-aa82-4982-8a4e-f2f8fed2e3e1 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:02.631434 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 780/1564] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:02.631434 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32172fd5-0fb9-48a3-88ee-08c82093a63c None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.631434 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32172fd5-0fb9-48a3-88ee-08c82093a63c None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.631434 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32172fd5-0fb9-48a3-88ee-08c82093a63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.636587 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2898d8-aa82-4982-8a4e-f2f8fed2e3e1 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:02.641199 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda5e13-6a92-48ac-bde5-5ff89f31c09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:02.641881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda5e13-6a92-48ac-bde5-5ff89f31c09d admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.642319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda5e13-6a92-48ac-bde5-5ff89f31c09d admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.642597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda5e13-6a92-48ac-bde5-5ff89f31c09d admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.643385 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda5e13-6a92-48ac-bde5-5ff89f31c09d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:02.645887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda5e13-6a92-48ac-bde5-5ff89f31c09d admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:02.653930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-32172fd5-0fb9-48a3-88ee-08c82093a63c None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:02.655153 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-32172fd5-0fb9-48a3-88ee-08c82093a63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:02.665410 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 781/1565] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:02.666377 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32172fd5-0fb9-48a3-88ee-08c82093a63c None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:02.676101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32172fd5-0fb9-48a3-88ee-08c82093a63c None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:02.681071 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 785/1566] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:02 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:02.681071 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda5e13-6a92-48ac-bde5-5ff89f31c09d admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:02.739951 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9ebf2-48cd-41b6-875a-3af20fade2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:02.740645 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9ebf2-48cd-41b6-875a-3af20fade2cc admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.740931 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9ebf2-48cd-41b6-875a-3af20fade2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.741088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda5e13-6a92-48ac-bde5-5ff89f31c09d admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:02.741743 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9ebf2-48cd-41b6-875a-3af20fade2cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.742633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9ebf2-48cd-41b6-875a-3af20fade2cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:02.744279 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9ebf2-48cd-41b6-875a-3af20fade2cc admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:02.745754 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b18a3-4a31-4500-8914-9c80da015ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:02.746412 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b18a3-4a31-4500-8914-9c80da015ced admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.746694 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b18a3-4a31-4500-8914-9c80da015ced admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.746970 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b18a3-4a31-4500-8914-9c80da015ced admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.747684 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b18a3-4a31-4500-8914-9c80da015ced admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:02.747991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b18a3-4a31-4500-8914-9c80da015ced admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:02.749610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b18a3-4a31-4500-8914-9c80da015ced admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:02.757325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 782/1567] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:02.757325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9ebf2-48cd-41b6-875a-3af20fade2cc admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:02.762585 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 786/1568] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:02.763431 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b18a3-4a31-4500-8914-9c80da015ced admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:02.764960 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9ebf2-48cd-41b6-875a-3af20fade2cc admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:02.769831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6896a-7b26-4fc8-91d3-b936ceccb6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:02.770567 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6896a-7b26-4fc8-91d3-b936ceccb6d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.770847 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6896a-7b26-4fc8-91d3-b936ceccb6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.771119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6896a-7b26-4fc8-91d3-b936ceccb6d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.771797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6896a-7b26-4fc8-91d3-b936ceccb6d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:02.774400 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6896a-7b26-4fc8-91d3-b936ceccb6d2 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:02.774621 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b18a3-4a31-4500-8914-9c80da015ced admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:02.779190 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a44f4a-a3ee-4932-bebe-95ba9af301c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:02.786881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a44f4a-a3ee-4932-bebe-95ba9af301c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.787175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a44f4a-a3ee-4932-bebe-95ba9af301c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.787467 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a44f4a-a3ee-4932-bebe-95ba9af301c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.788245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a44f4a-a3ee-4932-bebe-95ba9af301c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:02.790827 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a44f4a-a3ee-4932-bebe-95ba9af301c5 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:02.796523 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 783/1569] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:02 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:02.797758 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6896a-7b26-4fc8-91d3-b936ceccb6d2 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:02.805016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 787/1570] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:02.805016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a44f4a-a3ee-4932-bebe-95ba9af301c5 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:02.807708 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6896a-7b26-4fc8-91d3-b936ceccb6d2 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:02.815392 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2f27c-1667-4ea7-a612-e7eea436099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:02.815392 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2f27c-1667-4ea7-a612-e7eea436099a admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.815392 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2f27c-1667-4ea7-a612-e7eea436099a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.815392 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2f27c-1667-4ea7-a612-e7eea436099a admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.815930 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a44f4a-a3ee-4932-bebe-95ba9af301c5 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:02.816030 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2f27c-1667-4ea7-a612-e7eea436099a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:02.817051 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2f27c-1667-4ea7-a612-e7eea436099a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:02.820984 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699e030-8dee-4b25-9149-6fe0f0446540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:02.821642 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699e030-8dee-4b25-9149-6fe0f0446540 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.821925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699e030-8dee-4b25-9149-6fe0f0446540 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.822205 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699e030-8dee-4b25-9149-6fe0f0446540 admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.822928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699e030-8dee-4b25-9149-6fe0f0446540 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:02.823235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699e030-8dee-4b25-9149-6fe0f0446540 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:02.824871 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699e030-8dee-4b25-9149-6fe0f0446540 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:02.838022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 788/1571] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:02.838860 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699e030-8dee-4b25-9149-6fe0f0446540 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:02.845367 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 784/1572] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:02 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:02.846186 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2f27c-1667-4ea7-a612-e7eea436099a admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:02.848963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699e030-8dee-4b25-9149-6fe0f0446540 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:02.906062 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25132211-2768-4444-aceb-f6e9dc7c1338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:02.906786 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25132211-2768-4444-aceb-f6e9dc7c1338 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.907048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25132211-2768-4444-aceb-f6e9dc7c1338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.907267 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25132211-2768-4444-aceb-f6e9dc7c1338 admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.907998 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25132211-2768-4444-aceb-f6e9dc7c1338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:02.908333 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25132211-2768-4444-aceb-f6e9dc7c1338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:02.908452 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2f27c-1667-4ea7-a612-e7eea436099a admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:02.909938 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25132211-2768-4444-aceb-f6e9dc7c1338 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:02.913713 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629edb8e-214a-41bd-a167-6581c1f9753a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:02.914403 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629edb8e-214a-41bd-a167-6581c1f9753a admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.914682 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629edb8e-214a-41bd-a167-6581c1f9753a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.914958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629edb8e-214a-41bd-a167-6581c1f9753a admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.915668 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629edb8e-214a-41bd-a167-6581c1f9753a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:02.917652 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629edb8e-214a-41bd-a167-6581c1f9753a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:02.922398 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 789/1573] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:02.923252 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25132211-2768-4444-aceb-f6e9dc7c1338 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:02.934504 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25132211-2768-4444-aceb-f6e9dc7c1338 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:02.939260 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383454e-14b8-4246-847a-2ea265353b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:02.940684 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383454e-14b8-4246-847a-2ea265353b33 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.940778 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 785/1574] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:02 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:02.940904 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383454e-14b8-4246-847a-2ea265353b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.940904 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383454e-14b8-4246-847a-2ea265353b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.941077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629edb8e-214a-41bd-a167-6581c1f9753a admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:02.941640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383454e-14b8-4246-847a-2ea265353b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:02.943129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383454e-14b8-4246-847a-2ea265353b33 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:02.953736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629edb8e-214a-41bd-a167-6581c1f9753a admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:02.954649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 790/1575] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:02.955767 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383454e-14b8-4246-847a-2ea265353b33 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:02.961025 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ff42e-77c6-461f-b4f3-b3b4139c4bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:02.961695 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ff42e-77c6-461f-b4f3-b3b4139c4bcb admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.961973 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ff42e-77c6-461f-b4f3-b3b4139c4bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.962244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ff42e-77c6-461f-b4f3-b3b4139c4bcb admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.962929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ff42e-77c6-461f-b4f3-b3b4139c4bcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:02.964857 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ff42e-77c6-461f-b4f3-b3b4139c4bcb admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:02.966076 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383454e-14b8-4246-847a-2ea265353b33 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:02.970747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d906af2-37bd-41f3-adfb-051f0918f427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:02.971400 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d906af2-37bd-41f3-adfb-051f0918f427 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:02.971681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d906af2-37bd-41f3-adfb-051f0918f427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:02.971953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d906af2-37bd-41f3-adfb-051f0918f427 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:02.972727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d906af2-37bd-41f3-adfb-051f0918f427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:02.974293 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d906af2-37bd-41f3-adfb-051f0918f427 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:02.985154 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 791/1576] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:02.985796 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d906af2-37bd-41f3-adfb-051f0918f427 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:02.991931 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 786/1577] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:02 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:02.993177 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ff42e-77c6-461f-b4f3-b3b4139c4bcb admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:02.999117 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d906af2-37bd-41f3-adfb-051f0918f427 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:03.051473 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ff42e-77c6-461f-b4f3-b3b4139c4bcb admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:03.052528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc32193-252c-4b13-aa98-1afb5672ba92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:03.053201 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc32193-252c-4b13-aa98-1afb5672ba92 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.053486 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc32193-252c-4b13-aa98-1afb5672ba92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.054303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc32193-252c-4b13-aa98-1afb5672ba92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.055028 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc32193-252c-4b13-aa98-1afb5672ba92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:03.056659 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc32193-252c-4b13-aa98-1afb5672ba92 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:03.057078 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f08db5-92be-48da-b1ae-1a243ce1443b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:03.057730 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f08db5-92be-48da-b1ae-1a243ce1443b admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.058134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f08db5-92be-48da-b1ae-1a243ce1443b admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.058417 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f08db5-92be-48da-b1ae-1a243ce1443b admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.059137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f08db5-92be-48da-b1ae-1a243ce1443b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:03.061066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f08db5-92be-48da-b1ae-1a243ce1443b admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:03.066950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 792/1578] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:03.067750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc32193-252c-4b13-aa98-1afb5672ba92 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:03.077108 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc32193-252c-4b13-aa98-1afb5672ba92 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:03.082260 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965767ab-2225-4f1b-a866-caefd01cef06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:03.082920 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965767ab-2225-4f1b-a866-caefd01cef06 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.083204 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965767ab-2225-4f1b-a866-caefd01cef06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.083479 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965767ab-2225-4f1b-a866-caefd01cef06 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.084193 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965767ab-2225-4f1b-a866-caefd01cef06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:03.086761 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965767ab-2225-4f1b-a866-caefd01cef06 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:03.087349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 787/1579] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:02 2022] POST /identity/v3/projects => generated 357 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:03.088142 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f08db5-92be-48da-b1ae-1a243ce1443b admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:03.107052 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 793/1580] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:03 2022] POST /identity/v3/users => generated 295 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:03.107683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965767ab-2225-4f1b-a866-caefd01cef06 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:03.119273 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965767ab-2225-4f1b-a866-caefd01cef06 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:03.154257 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f08db5-92be-48da-b1ae-1a243ce1443b admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:03.158968 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414404ed-3fd4-42d7-87e0-d573e476bcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:03.159613 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414404ed-3fd4-42d7-87e0-d573e476bcf9 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.159896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414404ed-3fd4-42d7-87e0-d573e476bcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.160221 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414404ed-3fd4-42d7-87e0-d573e476bcf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.161008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414404ed-3fd4-42d7-87e0-d573e476bcf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:03.163560 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414404ed-3fd4-42d7-87e0-d573e476bcf9 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:03.176113 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282440b-b277-424c-8293-b5e138d8c3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:03.176820 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282440b-b277-424c-8293-b5e138d8c3ae admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.177107 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282440b-b277-424c-8293-b5e138d8c3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.177387 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282440b-b277-424c-8293-b5e138d8c3ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.178112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282440b-b277-424c-8293-b5e138d8c3ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:03.180134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282440b-b277-424c-8293-b5e138d8c3ae admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:03.188987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 788/1581] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:03 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:03.191327 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 794/1582] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:03.193331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282440b-b277-424c-8293-b5e138d8c3ae admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:03.193549 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414404ed-3fd4-42d7-87e0-d573e476bcf9 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:03.203605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282440b-b277-424c-8293-b5e138d8c3ae admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:03.254983 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414404ed-3fd4-42d7-87e0-d573e476bcf9 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:03.259911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a52c9-e00d-416c-86d7-b70070779dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:03.260836 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a52c9-e00d-416c-86d7-b70070779dec admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.261108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a52c9-e00d-416c-86d7-b70070779dec admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.261377 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a52c9-e00d-416c-86d7-b70070779dec admin admin] PATH_INFO: `/v3/projects/d7d461e051b3410b943d22095ecac469/users/b79eb5f38c4b4fb7991e2a49e53f4d94/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.262419 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b76cb-30ff-4abe-88e0-0c35479772f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:03.263133 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b76cb-30ff-4abe-88e0-0c35479772f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.263443 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b76cb-30ff-4abe-88e0-0c35479772f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.263714 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b76cb-30ff-4abe-88e0-0c35479772f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.264460 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b76cb-30ff-4abe-88e0-0c35479772f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:03.266099 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b76cb-30ff-4abe-88e0-0c35479772f7 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:03.277102 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 795/1583] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:03.278660 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b76cb-30ff-4abe-88e0-0c35479772f7 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:03.281641 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a52c9-e00d-416c-86d7-b70070779dec admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7d461e051b3410b943d22095ecac469, user_id=b79eb5f38c4b4fb7991e2a49e53f4d94, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:03.284420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a52c9-e00d-416c-86d7-b70070779dec admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:03.289770 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b76cb-30ff-4abe-88e0-0c35479772f7 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:03.295123 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aff7ca-2376-424f-826d-f7a50f5b6433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:03.295786 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aff7ca-2376-424f-826d-f7a50f5b6433 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.296074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aff7ca-2376-424f-826d-f7a50f5b6433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.296412 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aff7ca-2376-424f-826d-f7a50f5b6433 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.297084 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aff7ca-2376-424f-826d-f7a50f5b6433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:03.298347 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 789/1584] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:03 2022] PUT /identity/v3/projects/d7d461e051b3410b943d22095ecac469/users/b79eb5f38c4b4fb7991e2a49e53f4d94/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:03.298907 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a52c9-e00d-416c-86d7-b70070779dec admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:03.299005 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aff7ca-2376-424f-826d-f7a50f5b6433 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:03.322494 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 796/1585] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:03 2022] POST /identity/v3/users => generated 284 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:03.322494 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aff7ca-2376-424f-826d-f7a50f5b6433 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:03.332085 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aff7ca-2376-424f-826d-f7a50f5b6433 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:03.361559 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a52c9-e00d-416c-86d7-b70070779dec admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:03.366532 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecc98b-cd7a-42fb-8e43-fcba3bd3bf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:03.367426 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecc98b-cd7a-42fb-8e43-fcba3bd3bf1a admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.367706 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecc98b-cd7a-42fb-8e43-fcba3bd3bf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.367982 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecc98b-cd7a-42fb-8e43-fcba3bd3bf1a admin admin] PATH_INFO: `/v3/projects/a455dad2f0964673966eecade99ee629/users/fe38c43a249c4a188945360b7b525e29/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.382292 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecc98b-cd7a-42fb-8e43-fcba3bd3bf1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a455dad2f0964673966eecade99ee629, user_id=fe38c43a249c4a188945360b7b525e29, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:03.384942 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecc98b-cd7a-42fb-8e43-fcba3bd3bf1a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:03.386888 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c8c04-4887-4e03-a5a1-48e2193ad1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:03.387581 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c8c04-4887-4e03-a5a1-48e2193ad1ea admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.387866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c8c04-4887-4e03-a5a1-48e2193ad1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.388135 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c8c04-4887-4e03-a5a1-48e2193ad1ea admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.388839 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c8c04-4887-4e03-a5a1-48e2193ad1ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:03.391454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c8c04-4887-4e03-a5a1-48e2193ad1ea admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:03.399362 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 790/1586] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:03 2022] PUT /identity/v3/projects/a455dad2f0964673966eecade99ee629/users/fe38c43a249c4a188945360b7b525e29/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:03.400306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecc98b-cd7a-42fb-8e43-fcba3bd3bf1a admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:03.415887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 797/1587] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:03 2022] POST /identity/v3/users => generated 279 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:03.416982 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c8c04-4887-4e03-a5a1-48e2193ad1ea admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:03.426315 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c8c04-4887-4e03-a5a1-48e2193ad1ea admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:03.461616 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecc98b-cd7a-42fb-8e43-fcba3bd3bf1a admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:03.466061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56d7b6-6e8e-4bb3-be80-4e079cb6e445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:03.466711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56d7b6-6e8e-4bb3-be80-4e079cb6e445 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.466982 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56d7b6-6e8e-4bb3-be80-4e079cb6e445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.467250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56d7b6-6e8e-4bb3-be80-4e079cb6e445 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.467965 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56d7b6-6e8e-4bb3-be80-4e079cb6e445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:03.469599 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56d7b6-6e8e-4bb3-be80-4e079cb6e445 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:03.479723 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 791/1588] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:03.480572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56d7b6-6e8e-4bb3-be80-4e079cb6e445 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:03.482898 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97432461-a475-4523-8175-aad7b22a8c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:03.483682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97432461-a475-4523-8175-aad7b22a8c99 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.484061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97432461-a475-4523-8175-aad7b22a8c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.484469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97432461-a475-4523-8175-aad7b22a8c99 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.485245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97432461-a475-4523-8175-aad7b22a8c99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:03.487405 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97432461-a475-4523-8175-aad7b22a8c99 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:03.489913 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56d7b6-6e8e-4bb3-be80-4e079cb6e445 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:03.494808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35ea58-8415-4af0-8a24-c94712e5f946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:03.495456 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35ea58-8415-4af0-8a24-c94712e5f946 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.495736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35ea58-8415-4af0-8a24-c94712e5f946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.496007 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35ea58-8415-4af0-8a24-c94712e5f946 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.496787 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35ea58-8415-4af0-8a24-c94712e5f946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:03.498445 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35ea58-8415-4af0-8a24-c94712e5f946 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:03.510368 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 792/1589] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:03.513674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 798/1590] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:03 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:03.513674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7509a-790a-4c65-ba0a-a03b20b5a283 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.513674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7509a-790a-4c65-ba0a-a03b20b5a283 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.513674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7509a-790a-4c65-ba0a-a03b20b5a283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.514056 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35ea58-8415-4af0-8a24-c94712e5f946 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:03.524190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35ea58-8415-4af0-8a24-c94712e5f946 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:03.528903 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e99f8-fa68-4be3-9558-461b016ba620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:03.529776 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e99f8-fa68-4be3-9558-461b016ba620 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.530050 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e99f8-fa68-4be3-9558-461b016ba620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.530321 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e99f8-fa68-4be3-9558-461b016ba620 admin admin] PATH_INFO: `/v3/projects/10f3494602c84c748ead115d649fc9cc/users/4bf4652bf6ac4713ab4931365b943d3f/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.531077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-60c7509a-790a-4c65-ba0a-a03b20b5a283 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:03.532323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-60c7509a-790a-4c65-ba0a-a03b20b5a283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:03.540543 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 799/1591] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:03.541609 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7509a-790a-4c65-ba0a-a03b20b5a283 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:03.545247 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e99f8-fa68-4be3-9558-461b016ba620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f3494602c84c748ead115d649fc9cc, user_id=4bf4652bf6ac4713ab4931365b943d3f, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:03.548875 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e99f8-fa68-4be3-9558-461b016ba620 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:03.551416 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7509a-790a-4c65-ba0a-a03b20b5a283 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:03.556467 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c2566-610a-4e3f-95be-e82057ca1c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:03.557260 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c2566-610a-4e3f-95be-e82057ca1c00 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.557539 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c2566-610a-4e3f-95be-e82057ca1c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.557808 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c2566-610a-4e3f-95be-e82057ca1c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.558530 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c2566-610a-4e3f-95be-e82057ca1c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:03.560140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c2566-610a-4e3f-95be-e82057ca1c00 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:03.562516 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 793/1592] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:03 2022] PUT /identity/v3/projects/10f3494602c84c748ead115d649fc9cc/users/4bf4652bf6ac4713ab4931365b943d3f/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:03.566236 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93a09f-ed75-477f-b619-a969cbba37bb None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.566236 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93a09f-ed75-477f-b619-a969cbba37bb None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.566236 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93a09f-ed75-477f-b619-a969cbba37bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.571210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 800/1593] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:03.571854 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c2566-610a-4e3f-95be-e82057ca1c00 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:03.583434 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c2566-610a-4e3f-95be-e82057ca1c00 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:03.595388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-8a93a09f-ed75-477f-b619-a969cbba37bb None None] MFA Rules not processed for user `fe38c43a249c4a188945360b7b525e29`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:03.596626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8a93a09f-ed75-477f-b619-a969cbba37bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:03.636715 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb0181-e6fb-4602-8373-ed763cc71364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:03.637377 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb0181-e6fb-4602-8373-ed763cc71364 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.637657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb0181-e6fb-4602-8373-ed763cc71364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.637931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb0181-e6fb-4602-8373-ed763cc71364 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.638648 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb0181-e6fb-4602-8373-ed763cc71364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:03.640314 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb0181-e6fb-4602-8373-ed763cc71364 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:03.650727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 801/1594] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:03.651545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb0181-e6fb-4602-8373-ed763cc71364 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:03.661621 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb0181-e6fb-4602-8373-ed763cc71364 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:03.662601 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 794/1595] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:03.663768 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93a09f-ed75-477f-b619-a969cbba37bb None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:03.669885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45177bef-d477-47cf-9b5b-d0d01b6f66d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:03.670566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45177bef-d477-47cf-9b5b-d0d01b6f66d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.670852 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45177bef-d477-47cf-9b5b-d0d01b6f66d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.671124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45177bef-d477-47cf-9b5b-d0d01b6f66d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.671846 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45177bef-d477-47cf-9b5b-d0d01b6f66d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:03.673489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45177bef-d477-47cf-9b5b-d0d01b6f66d6 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:03.676461 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93a09f-ed75-477f-b619-a969cbba37bb None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:03.681390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaccb92-7e07-45a6-8eb6-d7d6e2b63b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:03.682404 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaccb92-7e07-45a6-8eb6-d7d6e2b63b66 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.682748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaccb92-7e07-45a6-8eb6-d7d6e2b63b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.683088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaccb92-7e07-45a6-8eb6-d7d6e2b63b66 admin admin] PATH_INFO: `/v3/projects/c5993f86ca3e459582b0aad65ca76d4d/users/7fb4dfe324594ec6924ded65bf7e613b/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.687892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 802/1596] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:03.687892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45177bef-d477-47cf-9b5b-d0d01b6f66d6 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:03.696675 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45177bef-d477-47cf-9b5b-d0d01b6f66d6 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:03.699886 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaccb92-7e07-45a6-8eb6-d7d6e2b63b66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5993f86ca3e459582b0aad65ca76d4d, user_id=7fb4dfe324594ec6924ded65bf7e613b, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:03.701400 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304d2da-7658-4dbd-baca-2801070f1ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:03.702098 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304d2da-7658-4dbd-baca-2801070f1ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.702382 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304d2da-7658-4dbd-baca-2801070f1ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.702656 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304d2da-7658-4dbd-baca-2801070f1ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.702770 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaccb92-7e07-45a6-8eb6-d7d6e2b63b66 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:03.703375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304d2da-7658-4dbd-baca-2801070f1ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:03.704997 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304d2da-7658-4dbd-baca-2801070f1ec6 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:03.715983 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 803/1597] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:03.716370 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 795/1598] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:03 2022] PUT /identity/v3/projects/c5993f86ca3e459582b0aad65ca76d4d/users/7fb4dfe324594ec6924ded65bf7e613b/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:03.717655 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d56fc-7b3e-43aa-8456-4e261fd67b71 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.717942 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d56fc-7b3e-43aa-8456-4e261fd67b71 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.718213 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d56fc-7b3e-43aa-8456-4e261fd67b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.720226 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304d2da-7658-4dbd-baca-2801070f1ec6 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:03.734733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-636d56fc-7b3e-43aa-8456-4e261fd67b71 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:03.735910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-636d56fc-7b3e-43aa-8456-4e261fd67b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:03.782090 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304d2da-7658-4dbd-baca-2801070f1ec6 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:03.795547 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 796/1599] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:03.796462 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d56fc-7b3e-43aa-8456-4e261fd67b71 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:03.806690 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d56fc-7b3e-43aa-8456-4e261fd67b71 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:03.811684 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c052ce-f39d-43eb-985a-e26017f2c42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:03.812375 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c052ce-f39d-43eb-985a-e26017f2c42c admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.812774 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c052ce-f39d-43eb-985a-e26017f2c42c admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.812920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c052ce-f39d-43eb-985a-e26017f2c42c admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.813644 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c052ce-f39d-43eb-985a-e26017f2c42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:03.815334 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c052ce-f39d-43eb-985a-e26017f2c42c admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:03.826021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 797/1600] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:03.826847 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c052ce-f39d-43eb-985a-e26017f2c42c admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:03.835316 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd889b-1b03-4eae-93e4-5d7b74c8d091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:03.835972 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd889b-1b03-4eae-93e4-5d7b74c8d091 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.836283 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd889b-1b03-4eae-93e4-5d7b74c8d091 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.836560 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd889b-1b03-4eae-93e4-5d7b74c8d091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.836669 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c052ce-f39d-43eb-985a-e26017f2c42c admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:03.841215 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496b5f1-1249-4914-9266-9af103552c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:03.841859 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496b5f1-1249-4914-9266-9af103552c9b admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.842141 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496b5f1-1249-4914-9266-9af103552c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.842418 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496b5f1-1249-4914-9266-9af103552c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.843133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496b5f1-1249-4914-9266-9af103552c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:03.844768 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496b5f1-1249-4914-9266-9af103552c9b admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:03.845871 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd889b-1b03-4eae-93e4-5d7b74c8d091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:03.847279 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd889b-1b03-4eae-93e4-5d7b74c8d091 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:03.854495 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 798/1601] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:03.855284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496b5f1-1249-4914-9266-9af103552c9b admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:03.859425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 804/1602] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:03.860264 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd889b-1b03-4eae-93e4-5d7b74c8d091 service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:03.864675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496b5f1-1249-4914-9266-9af103552c9b admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:03.871167 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd889b-1b03-4eae-93e4-5d7b74c8d091 service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:03.871482 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae599b-f70f-4ce0-90d1-5f652ff1370f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:03.872429 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae599b-f70f-4ce0-90d1-5f652ff1370f admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.872711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae599b-f70f-4ce0-90d1-5f652ff1370f admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.872984 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae599b-f70f-4ce0-90d1-5f652ff1370f admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.873806 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae599b-f70f-4ce0-90d1-5f652ff1370f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:03.875919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae599b-f70f-4ce0-90d1-5f652ff1370f admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:03.876684 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43403253-ee0e-404e-8527-ae7ea64ef169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:03.877607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43403253-ee0e-404e-8527-ae7ea64ef169 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.877909 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43403253-ee0e-404e-8527-ae7ea64ef169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.878191 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43403253-ee0e-404e-8527-ae7ea64ef169 admin admin] PATH_INFO: `/v3/projects/c5e9d68ebf234ca98d0bedb214585f87/users/c330fcea8dda449ab5e125b741d49ef4/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.896025 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43403253-ee0e-404e-8527-ae7ea64ef169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e9d68ebf234ca98d0bedb214585f87, user_id=c330fcea8dda449ab5e125b741d49ef4, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:03.897504 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: WARNING py.warnings [None req-43403253-ee0e-404e-8527-ae7ea64ef169 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 20:25:03.897504 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: warnings.warn(msg) May 16 20:25:03.897504 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: May 16 20:25:03.899433 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43403253-ee0e-404e-8527-ae7ea64ef169 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:03.906087 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 799/1603] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:03 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:03.907048 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae599b-f70f-4ce0-90d1-5f652ff1370f admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:03.915962 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 805/1604] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:03 2022] PUT /identity/v3/projects/c5e9d68ebf234ca98d0bedb214585f87/users/c330fcea8dda449ab5e125b741d49ef4/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:03.917930 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d63495-3dfe-4461-8a5f-d010040e4b53 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:03.918364 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d63495-3dfe-4461-8a5f-d010040e4b53 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:03.918820 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d63495-3dfe-4461-8a5f-d010040e4b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:03.937288 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-70d63495-3dfe-4461-8a5f-d010040e4b53 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:03.938488 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-70d63495-3dfe-4461-8a5f-d010040e4b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:03.981888 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae599b-f70f-4ce0-90d1-5f652ff1370f admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:04.006090 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 806/1605] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:04.007739 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d63495-3dfe-4461-8a5f-d010040e4b53 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:04.047804 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159e3e7-65bf-42bf-abcb-dab3d25bcc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:04.048821 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159e3e7-65bf-42bf-abcb-dab3d25bcc4c admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:04.049493 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159e3e7-65bf-42bf-abcb-dab3d25bcc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:04.049774 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159e3e7-65bf-42bf-abcb-dab3d25bcc4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:04.050680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4159e3e7-65bf-42bf-abcb-dab3d25bcc4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:04.054463 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4159e3e7-65bf-42bf-abcb-dab3d25bcc4c admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:04.065462 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 800/1606] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:04.069662 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159e3e7-65bf-42bf-abcb-dab3d25bcc4c admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:04.078815 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d63495-3dfe-4461-8a5f-d010040e4b53 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:04.079471 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159e3e7-65bf-42bf-abcb-dab3d25bcc4c admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:04.082833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2484b-69df-4038-be8b-add555a09c27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:04.083832 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2484b-69df-4038-be8b-add555a09c27 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:04.083948 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2484b-69df-4038-be8b-add555a09c27 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:04.084205 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2484b-69df-4038-be8b-add555a09c27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:04.084619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9528a7-299d-4d3e-9b60-ac7392b2fe90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:04.086241 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9528a7-299d-4d3e-9b60-ac7392b2fe90 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:04.086798 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9528a7-299d-4d3e-9b60-ac7392b2fe90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:04.086909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9528a7-299d-4d3e-9b60-ac7392b2fe90 admin admin] PATH_INFO: `/v3/projects/968e2cb599d64b0d8115717b1d5365a3/users/34a76317250443fd8d8b1e1b781238fb/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:04.098367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2484b-69df-4038-be8b-add555a09c27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:04.100351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2484b-69df-4038-be8b-add555a09c27 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:04.104793 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9528a7-299d-4d3e-9b60-ac7392b2fe90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=968e2cb599d64b0d8115717b1d5365a3, user_id=34a76317250443fd8d8b1e1b781238fb, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:04.108324 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9528a7-299d-4d3e-9b60-ac7392b2fe90 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:04.111527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 807/1607] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:04.112546 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2484b-69df-4038-be8b-add555a09c27 service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:04.122685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2484b-69df-4038-be8b-add555a09c27 service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:04.123658 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 801/1608] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:04 2022] PUT /identity/v3/projects/968e2cb599d64b0d8115717b1d5365a3/users/34a76317250443fd8d8b1e1b781238fb/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:04.124587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9528a7-299d-4d3e-9b60-ac7392b2fe90 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:04.198450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8820af-2c29-42f7-a234-404c70ee9ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:04.199630 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8820af-2c29-42f7-a234-404c70ee9ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:04.200089 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8820af-2c29-42f7-a234-404c70ee9ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:04.200492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8820af-2c29-42f7-a234-404c70ee9ef4 admin admin] PATH_INFO: `/v3/projects/5d953e249fb841dd95d2e599393a1d97/users/4271e8ab9fed42089b4e9d32dc2b9198/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:04.212119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9528a7-299d-4d3e-9b60-ac7392b2fe90 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:04.218267 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229062d3-f04e-4f0f-be75-a3594553a3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:04.219522 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229062d3-f04e-4f0f-be75-a3594553a3e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:04.220069 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229062d3-f04e-4f0f-be75-a3594553a3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:04.220552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229062d3-f04e-4f0f-be75-a3594553a3e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:04.220849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8820af-2c29-42f7-a234-404c70ee9ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d953e249fb841dd95d2e599393a1d97, user_id=4271e8ab9fed42089b4e9d32dc2b9198, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:04.221631 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229062d3-f04e-4f0f-be75-a3594553a3e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:04.223698 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8820af-2c29-42f7-a234-404c70ee9ef4 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:04.223972 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229062d3-f04e-4f0f-be75-a3594553a3e6 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:04.246353 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 808/1609] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:04 2022] PUT /identity/v3/projects/5d953e249fb841dd95d2e599393a1d97/users/4271e8ab9fed42089b4e9d32dc2b9198/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:04.247955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a7516-6e51-4788-86be-80f4ff284532 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:04.248404 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a7516-6e51-4788-86be-80f4ff284532 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:04.248770 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a7516-6e51-4788-86be-80f4ff284532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:04.252223 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 802/1610] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:04 2022] POST /identity/v3/users => generated 295 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:04.253435 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229062d3-f04e-4f0f-be75-a3594553a3e6 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:04.256266 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-229062d3-f04e-4f0f-be75-a3594553a3e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:04.272285 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-cf8a7516-6e51-4788-86be-80f4ff284532 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:04.274147 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-cf8a7516-6e51-4788-86be-80f4ff284532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:04.327430 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229062d3-f04e-4f0f-be75-a3594553a3e6 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:04.344229 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 809/1611] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:04.344229 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a7516-6e51-4788-86be-80f4ff284532 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:04.366782 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a7516-6e51-4788-86be-80f4ff284532 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:04.384300 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9c937-a91b-467a-9e4b-e43c4abc28f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:04.389337 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c55d9b-2bf2-49bc-8cec-af0595ed5cf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:04.390042 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c55d9b-2bf2-49bc-8cec-af0595ed5cf6 service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:04.390640 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c55d9b-2bf2-49bc-8cec-af0595ed5cf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:04.390920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c55d9b-2bf2-49bc-8cec-af0595ed5cf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:04.393378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9c937-a91b-467a-9e4b-e43c4abc28f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:04.394268 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9c937-a91b-467a-9e4b-e43c4abc28f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:04.395756 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9c937-a91b-467a-9e4b-e43c4abc28f2 admin admin] PATH_INFO: `/v3/projects/1e7533ad2048425282b8735f5dd357d2/users/f8c80a19d6724febaa5ffe0292a485ef/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:04.404396 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c55d9b-2bf2-49bc-8cec-af0595ed5cf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:04.406075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c55d9b-2bf2-49bc-8cec-af0595ed5cf6 service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:04.418006 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 803/1612] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:04.419342 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3b4d6-d7ae-4d23-92bf-07363af3f2df None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:04.419633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3b4d6-d7ae-4d23-92bf-07363af3f2df None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:04.420100 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3b4d6-d7ae-4d23-92bf-07363af3f2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:04.429529 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9c937-a91b-467a-9e4b-e43c4abc28f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e7533ad2048425282b8735f5dd357d2, user_id=f8c80a19d6724febaa5ffe0292a485ef, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:04.435505 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9c937-a91b-467a-9e4b-e43c4abc28f2 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:04.451769 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-a5f3b4d6-d7ae-4d23-92bf-07363af3f2df None None] MFA Rules not processed for user `34a76317250443fd8d8b1e1b781238fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:04.453503 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-a5f3b4d6-d7ae-4d23-92bf-07363af3f2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:04.460337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 810/1613] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:04 2022] PUT /identity/v3/projects/1e7533ad2048425282b8735f5dd357d2/users/f8c80a19d6724febaa5ffe0292a485ef/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:04.462156 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a20d0-3e7f-405a-ba90-173ecb04fd15 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:04.462639 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a20d0-3e7f-405a-ba90-173ecb04fd15 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:04.463056 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a20d0-3e7f-405a-ba90-173ecb04fd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:04.512302 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-782a20d0-3e7f-405a-ba90-173ecb04fd15 None None] MFA Rules not processed for user `4271e8ab9fed42089b4e9d32dc2b9198`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:04.513577 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-782a20d0-3e7f-405a-ba90-173ecb04fd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:04.573035 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 804/1614] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:04.574596 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3b4d6-d7ae-4d23-92bf-07363af3f2df None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:04.627789 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 811/1615] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:04 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:04.627789 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a20d0-3e7f-405a-ba90-173ecb04fd15 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:04.686552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3b4d6-d7ae-4d23-92bf-07363af3f2df None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:04.698379 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba9f09-64c3-4153-bf53-a25d523ab567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:04.699647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba9f09-64c3-4153-bf53-a25d523ab567 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:04.700184 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba9f09-64c3-4153-bf53-a25d523ab567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:04.700556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba9f09-64c3-4153-bf53-a25d523ab567 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:04.701844 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba9f09-64c3-4153-bf53-a25d523ab567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:04.704418 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba9f09-64c3-4153-bf53-a25d523ab567 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:04.711745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a20d0-3e7f-405a-ba90-173ecb04fd15 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:04.716618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74016f89-0bca-48bd-8f3a-fa10a1ff836e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:04.719864 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 805/1616] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:04.720017 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74016f89-0bca-48bd-8f3a-fa10a1ff836e service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:04.720017 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74016f89-0bca-48bd-8f3a-fa10a1ff836e service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:04.720017 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74016f89-0bca-48bd-8f3a-fa10a1ff836e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:04.720320 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa3e30-21c9-42ca-90ac-9b2093cc9f33 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:04.720320 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa3e30-21c9-42ca-90ac-9b2093cc9f33 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:04.720320 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa3e30-21c9-42ca-90ac-9b2093cc9f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:04.733471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74016f89-0bca-48bd-8f3a-fa10a1ff836e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:04.735136 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74016f89-0bca-48bd-8f3a-fa10a1ff836e service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:04.748671 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 812/1617] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:04.749982 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74016f89-0bca-48bd-8f3a-fa10a1ff836e service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:04.765909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-82fa3e30-21c9-42ca-90ac-9b2093cc9f33 None None] MFA Rules not processed for user `f8c80a19d6724febaa5ffe0292a485ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:04.767296 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-82fa3e30-21c9-42ca-90ac-9b2093cc9f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:04.848808 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74016f89-0bca-48bd-8f3a-fa10a1ff836e service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:04.856686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2afc52-754f-4611-b147-39b8522fef25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:04.857440 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2afc52-754f-4611-b147-39b8522fef25 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:04.857718 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2afc52-754f-4611-b147-39b8522fef25 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:04.857992 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2afc52-754f-4611-b147-39b8522fef25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:04.885893 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2afc52-754f-4611-b147-39b8522fef25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:04.887525 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2afc52-754f-4611-b147-39b8522fef25 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:04.918807 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 806/1618] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:04.921540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa3e30-21c9-42ca-90ac-9b2093cc9f33 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:04.936578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 813/1619] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:04.941737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c573520-d56c-4ba3-b58d-c4c8408d02c3 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:04.941882 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c573520-d56c-4ba3-b58d-c4c8408d02c3 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:04.942953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c573520-d56c-4ba3-b58d-c4c8408d02c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:04.947677 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa3e30-21c9-42ca-90ac-9b2093cc9f33 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:04.952714 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e970d-d426-4800-a19a-e9ef5c845993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:04.953512 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e970d-d426-4800-a19a-e9ef5c845993 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:04.953872 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e970d-d426-4800-a19a-e9ef5c845993 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:04.954276 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e970d-d426-4800-a19a-e9ef5c845993 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:04.955062 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e970d-d426-4800-a19a-e9ef5c845993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:04.957129 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e970d-d426-4800-a19a-e9ef5c845993 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:05.010077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 807/1620] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:04 2022] POST /identity/v3/projects => generated 355 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:05.011594 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e970d-d426-4800-a19a-e9ef5c845993 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:05.029092 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-8c573520-d56c-4ba3-b58d-c4c8408d02c3 None None] MFA Rules not processed for user `b79eb5f38c4b4fb7991e2a49e53f4d94`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:05.030309 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-8c573520-d56c-4ba3-b58d-c4c8408d02c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:05.135239 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e970d-d426-4800-a19a-e9ef5c845993 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:05.143493 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2534e5-fc94-4742-930d-8e648ae94c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:05.145398 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2534e5-fc94-4742-930d-8e648ae94c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:05.146229 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2534e5-fc94-4742-930d-8e648ae94c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:05.146653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 814/1621] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:05.148336 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2534e5-fc94-4742-930d-8e648ae94c59 admin admin] PATH_INFO: `/v3/projects/cda98e6bfc5b48de9f50e0c05f2044bf/users/ab9ca21de4f7480ab431d18795a3c164/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:05.150940 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49ddc1-fda4-40d9-ada3-ec51849dd140 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:05.151245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49ddc1-fda4-40d9-ada3-ec51849dd140 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:05.151491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49ddc1-fda4-40d9-ada3-ec51849dd140 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:05.155571 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 815/1622] 10.222.0.71 () {54 vars in 961 bytes} [Mon May 16 20:25:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:25:05.160580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49ddc1-fda4-40d9-ada3-ec51849dd140 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:05.175844 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2534e5-fc94-4742-930d-8e648ae94c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda98e6bfc5b48de9f50e0c05f2044bf, user_id=ab9ca21de4f7480ab431d18795a3c164, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:05.180831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49ddc1-fda4-40d9-ada3-ec51849dd140 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:05.181351 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2534e5-fc94-4742-930d-8e648ae94c59 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:05.189420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0284a64-94b2-4faf-9e40-716a93c5ed66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:05.190150 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0284a64-94b2-4faf-9e40-716a93c5ed66 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:05.190518 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0284a64-94b2-4faf-9e40-716a93c5ed66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:05.190778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0284a64-94b2-4faf-9e40-716a93c5ed66 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:05.191529 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0284a64-94b2-4faf-9e40-716a93c5ed66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:05.193812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0284a64-94b2-4faf-9e40-716a93c5ed66 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:05.206413 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 808/1623] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:05 2022] PUT /identity/v3/projects/cda98e6bfc5b48de9f50e0c05f2044bf/users/ab9ca21de4f7480ab431d18795a3c164/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:05.210579 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b59d66-bd54-4cf1-9940-71ff668f5c56 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:05.211415 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b59d66-bd54-4cf1-9940-71ff668f5c56 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:05.212072 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b59d66-bd54-4cf1-9940-71ff668f5c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:05.229428 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 816/1624] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:05 2022] POST /identity/v3/users => generated 284 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:05.229428 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53436205-25d1-49e0-ae76-054287f41470 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:05.229720 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53436205-25d1-49e0-ae76-054287f41470 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:05.233935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53436205-25d1-49e0-ae76-054287f41470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:05.245805 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-18b59d66-bd54-4cf1-9940-71ff668f5c56 None None] MFA Rules not processed for user `b79eb5f38c4b4fb7991e2a49e53f4d94`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:05.248091 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-18b59d66-bd54-4cf1-9940-71ff668f5c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:05.265795 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-53436205-25d1-49e0-ae76-054287f41470 None None] MFA Rules not processed for user `242d4f9634a74013af05f50981280864`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:05.267004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-53436205-25d1-49e0-ae76-054287f41470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:05.317846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 809/1625] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:05.319418 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b59d66-bd54-4cf1-9940-71ff668f5c56 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:05.378895 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 817/1626] 10.222.0.71 () {58 vars in 1058 bytes} [Mon May 16 20:25:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:05.379853 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53436205-25d1-49e0-ae76-054287f41470 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:05.413235 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b59d66-bd54-4cf1-9940-71ff668f5c56 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:05.421764 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b4064-2f82-4aec-96f2-9f361727cfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:05.422638 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b4064-2f82-4aec-96f2-9f361727cfbc admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:05.423365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b4064-2f82-4aec-96f2-9f361727cfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:05.423365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b4064-2f82-4aec-96f2-9f361727cfbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:05.424492 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b4064-2f82-4aec-96f2-9f361727cfbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:05.426265 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b4064-2f82-4aec-96f2-9f361727cfbc admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:05.439292 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 810/1627] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:05.441283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e8960-c158-4ce9-9bf6-29106d8acb6b None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:05.441679 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e8960-c158-4ce9-9bf6-29106d8acb6b None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:05.442144 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e8960-c158-4ce9-9bf6-29106d8acb6b None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:05.443959 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 811/1628] 10.222.0.71 () {54 vars in 961 bytes} [Mon May 16 20:25:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:25:05.445935 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e8960-c158-4ce9-9bf6-29106d8acb6b None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:05.462303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53436205-25d1-49e0-ae76-054287f41470 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:05.467630 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e8960-c158-4ce9-9bf6-29106d8acb6b None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:05.468535 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73abf7-aa6e-4b1f-a680-dbb259408707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:05.469343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73abf7-aa6e-4b1f-a680-dbb259408707 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:05.469664 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73abf7-aa6e-4b1f-a680-dbb259408707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:05.470114 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73abf7-aa6e-4b1f-a680-dbb259408707 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:05.471773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73abf7-aa6e-4b1f-a680-dbb259408707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:05.474464 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73abf7-aa6e-4b1f-a680-dbb259408707 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:05.474937 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad76e6-eec0-4f79-8a01-ecb682936c09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:05.476740 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad76e6-eec0-4f79-8a01-ecb682936c09 service nova] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:05.477341 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad76e6-eec0-4f79-8a01-ecb682936c09 service nova] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:05.477786 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad76e6-eec0-4f79-8a01-ecb682936c09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:05.486552 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 818/1629] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:05.488140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73abf7-aa6e-4b1f-a680-dbb259408707 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:05.501804 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73abf7-aa6e-4b1f-a680-dbb259408707 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:05.509359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef1cb8-34ac-4099-a26d-07e8a71994f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:05.510573 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef1cb8-34ac-4099-a26d-07e8a71994f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:05.510691 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef1cb8-34ac-4099-a26d-07e8a71994f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:05.510913 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef1cb8-34ac-4099-a26d-07e8a71994f5 admin admin] PATH_INFO: `/v3/projects/cda98e6bfc5b48de9f50e0c05f2044bf/users/ab9ca21de4f7480ab431d18795a3c164/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:05.513107 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef1cb8-34ac-4099-a26d-07e8a71994f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda98e6bfc5b48de9f50e0c05f2044bf, user_id=ab9ca21de4f7480ab431d18795a3c164, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:05.516039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef1cb8-34ac-4099-a26d-07e8a71994f5 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:05.551448 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 819/1630] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:05 2022] PUT /identity/v3/projects/cda98e6bfc5b48de9f50e0c05f2044bf/users/ab9ca21de4f7480ab431d18795a3c164/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:05.553085 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23081857-f66f-454f-9a36-9ca3eb1da676 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:05.553924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23081857-f66f-454f-9a36-9ca3eb1da676 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:05.554189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23081857-f66f-454f-9a36-9ca3eb1da676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:05.598292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-23081857-f66f-454f-9a36-9ca3eb1da676 None None] MFA Rules not processed for user `242d4f9634a74013af05f50981280864`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:05.599571 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-23081857-f66f-454f-9a36-9ca3eb1da676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:05.636119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad76e6-eec0-4f79-8a01-ecb682936c09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:05.638048 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad76e6-eec0-4f79-8a01-ecb682936c09 service nova] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:05.653335 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 812/1631] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:05.654352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad76e6-eec0-4f79-8a01-ecb682936c09 service nova] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:05.689668 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad76e6-eec0-4f79-8a01-ecb682936c09 service nova] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:05.770620 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 820/1632] 10.222.0.71 () {58 vars in 1058 bytes} [Mon May 16 20:25:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:05.774765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd2afa-c418-4b99-9b6f-2b4e4fff1877 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:05.776340 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd2afa-c418-4b99-9b6f-2b4e4fff1877 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:05.776670 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd2afa-c418-4b99-9b6f-2b4e4fff1877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:05.819615 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f80d55-c324-4450-9a59-75b887e3e92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:05.820552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f80d55-c324-4450-9a59-75b887e3e92f admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:05.820826 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f80d55-c324-4450-9a59-75b887e3e92f admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:05.821094 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f80d55-c324-4450-9a59-75b887e3e92f admin admin] PATH_INFO: `/v3/projects/e460e7173d4e4d58b1e9fa28d08085f2/users/694dcca037c64fdcac05e2b46ce3ea70/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:05.832398 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-cedd2afa-c418-4b99-9b6f-2b4e4fff1877 None None] MFA Rules not processed for user `ab9ca21de4f7480ab431d18795a3c164`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:05.833284 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-cedd2afa-c418-4b99-9b6f-2b4e4fff1877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:05.858097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f80d55-c324-4450-9a59-75b887e3e92f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e460e7173d4e4d58b1e9fa28d08085f2, user_id=694dcca037c64fdcac05e2b46ce3ea70, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:05.864260 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f80d55-c324-4450-9a59-75b887e3e92f admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:05.892271 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 813/1633] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:05 2022] PUT /identity/v3/projects/e460e7173d4e4d58b1e9fa28d08085f2/users/694dcca037c64fdcac05e2b46ce3ea70/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:05.894854 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f80d55-c324-4450-9a59-75b887e3e92f admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:06.010886 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 821/1634] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:06.011825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd2afa-c418-4b99-9b6f-2b4e4fff1877 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:06.027555 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f80d55-c324-4450-9a59-75b887e3e92f admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:06.036737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd2afa-c418-4b99-9b6f-2b4e4fff1877 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:06.037017 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb9235-b41c-45da-9250-a92886f5db71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:06.037811 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb9235-b41c-45da-9250-a92886f5db71 service nova] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:06.049436 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb9235-b41c-45da-9250-a92886f5db71 service nova] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:06.049873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb9235-b41c-45da-9250-a92886f5db71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:06.141297 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb9235-b41c-45da-9250-a92886f5db71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:06.146480 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb9235-b41c-45da-9250-a92886f5db71 service nova] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:06.169506 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 814/1635] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:06.170497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb9235-b41c-45da-9250-a92886f5db71 service nova] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:06.180224 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3fd10-020e-477d-86ef-6c80a197b53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:06.181690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3fd10-020e-477d-86ef-6c80a197b53e admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:06.188480 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3fd10-020e-477d-86ef-6c80a197b53e admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:06.188866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3fd10-020e-477d-86ef-6c80a197b53e admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:06.189663 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3fd10-020e-477d-86ef-6c80a197b53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:06.194725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3fd10-020e-477d-86ef-6c80a197b53e admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:06.242841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 822/1636] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:06.250600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3fd10-020e-477d-86ef-6c80a197b53e admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:06.276138 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3fd10-020e-477d-86ef-6c80a197b53e admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:06.303201 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fb397-5389-4926-bb5e-12d0f44b9073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:06.307086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fb397-5389-4926-bb5e-12d0f44b9073 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:06.307572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fb397-5389-4926-bb5e-12d0f44b9073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:06.307950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fb397-5389-4926-bb5e-12d0f44b9073 admin admin] PATH_INFO: `/v3/projects/e460e7173d4e4d58b1e9fa28d08085f2/users/694dcca037c64fdcac05e2b46ce3ea70/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:06.311128 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb9235-b41c-45da-9250-a92886f5db71 service nova] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:06.313104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fb397-5389-4926-bb5e-12d0f44b9073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e460e7173d4e4d58b1e9fa28d08085f2, user_id=694dcca037c64fdcac05e2b46ce3ea70, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:06.318901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fb397-5389-4926-bb5e-12d0f44b9073 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:06.323572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3510c6-67d1-48f4-953c-898f863c05c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:06.327286 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3510c6-67d1-48f4-953c-898f863c05c0 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:06.327596 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3510c6-67d1-48f4-953c-898f863c05c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:06.327926 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3510c6-67d1-48f4-953c-898f863c05c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:06.358595 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 823/1637] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:06 2022] PUT /identity/v3/projects/e460e7173d4e4d58b1e9fa28d08085f2/users/694dcca037c64fdcac05e2b46ce3ea70/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:06.361606 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ea646-d017-4ae0-8ed3-035cbadb39ee None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:06.361893 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ea646-d017-4ae0-8ed3-035cbadb39ee None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:06.362182 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ea646-d017-4ae0-8ed3-035cbadb39ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:06.397686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-e19ea646-d017-4ae0-8ed3-035cbadb39ee None None] MFA Rules not processed for user `694dcca037c64fdcac05e2b46ce3ea70`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:06.399985 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-e19ea646-d017-4ae0-8ed3-035cbadb39ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:06.491564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 824/1638] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:06 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:06.492532 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003b90b-7b97-49c2-ae86-eca00f5a9ed9 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:06.492857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003b90b-7b97-49c2-ae86-eca00f5a9ed9 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:06.493105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003b90b-7b97-49c2-ae86-eca00f5a9ed9 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:06.494104 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3510c6-67d1-48f4-953c-898f863c05c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:06.495571 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3510c6-67d1-48f4-953c-898f863c05c0 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:06.498697 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 825/1639] 10.222.0.71 () {54 vars in 912 bytes} [Mon May 16 20:25:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:25:06.499567 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003b90b-7b97-49c2-ae86-eca00f5a9ed9 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:06.532141 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 815/1640] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:06.534304 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295de8bf-3e12-422b-8a8f-705fb25572fc None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:06.535681 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295de8bf-3e12-422b-8a8f-705fb25572fc None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:06.539556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295de8bf-3e12-422b-8a8f-705fb25572fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:06.574597 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-295de8bf-3e12-422b-8a8f-705fb25572fc None None] MFA Rules not processed for user `242d4f9634a74013af05f50981280864`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:06.576098 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-295de8bf-3e12-422b-8a8f-705fb25572fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:06.583036 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003b90b-7b97-49c2-ae86-eca00f5a9ed9 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:06.596377 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6447bb-f236-4e63-853d-b86f915a29a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:06.597054 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6447bb-f236-4e63-853d-b86f915a29a3 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:06.597343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6447bb-f236-4e63-853d-b86f915a29a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:06.597625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6447bb-f236-4e63-853d-b86f915a29a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:06.618345 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6447bb-f236-4e63-853d-b86f915a29a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:06.619817 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6447bb-f236-4e63-853d-b86f915a29a3 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:06.645471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 826/1641] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:06 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:06.689623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 816/1642] 10.222.0.71 () {58 vars in 1009 bytes} [Mon May 16 20:25:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:06.909421 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c642a-a077-49d0-8198-986da6b708c5 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:06.909796 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c642a-a077-49d0-8198-986da6b708c5 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:06.909996 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c642a-a077-49d0-8198-986da6b708c5 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:06.911380 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 827/1643] 10.222.0.71 () {54 vars in 912 bytes} [Mon May 16 20:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:25:06.924949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547002da-7d77-46ea-9034-d448ffa285bb None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:06.925328 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547002da-7d77-46ea-9034-d448ffa285bb None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:06.925531 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547002da-7d77-46ea-9034-d448ffa285bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:06.987362 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-547002da-7d77-46ea-9034-d448ffa285bb None None] MFA Rules not processed for user `242d4f9634a74013af05f50981280864`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:06.996180 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-547002da-7d77-46ea-9034-d448ffa285bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:07.018257 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c642a-a077-49d0-8198-986da6b708c5 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:07.052881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c642a-a077-49d0-8198-986da6b708c5 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:07.054599 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 817/1644] 10.222.0.71 () {58 vars in 1009 bytes} [Mon May 16 20:25:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:07.060477 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547002da-7d77-46ea-9034-d448ffa285bb None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:07.065396 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-547002da-7d77-46ea-9034-d448ffa285bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:07.067229 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d2cd7-6b2b-42fa-8f2c-22456c30a6e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:07.068384 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d2cd7-6b2b-42fa-8f2c-22456c30a6e0 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:07.070242 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d2cd7-6b2b-42fa-8f2c-22456c30a6e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:07.070981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d2cd7-6b2b-42fa-8f2c-22456c30a6e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:07.090121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d2cd7-6b2b-42fa-8f2c-22456c30a6e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:07.093074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d2cd7-6b2b-42fa-8f2c-22456c30a6e0 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:07.129645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 828/1645] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:07.265238 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547002da-7d77-46ea-9034-d448ffa285bb None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:07.275542 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97217beb-d56c-4e9b-ad7c-ca9011d3ea3b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62c3f9351a4181a4fc2930570171b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:07.278498 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97217beb-d56c-4e9b-ad7c-ca9011d3ea3b service glance] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:07.278752 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97217beb-d56c-4e9b-ad7c-ca9011d3ea3b service glance] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:07.279041 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97217beb-d56c-4e9b-ad7c-ca9011d3ea3b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:07.305710 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97217beb-d56c-4e9b-ad7c-ca9011d3ea3b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:07.309894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97217beb-d56c-4e9b-ad7c-ca9011d3ea3b service glance] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:07.321618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d2cd7-6b2b-42fa-8f2c-22456c30a6e0 service cinder] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:07.333375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d2cd7-6b2b-42fa-8f2c-22456c30a6e0 service cinder] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:07.338864 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 818/1646] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:07.339117 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de28dd-a895-4962-babb-f0b0091a1b83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:07.339953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de28dd-a895-4962-babb-f0b0091a1b83 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:07.340278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de28dd-a895-4962-babb-f0b0091a1b83 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:07.340553 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de28dd-a895-4962-babb-f0b0091a1b83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:07.422950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de28dd-a895-4962-babb-f0b0091a1b83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:07.434915 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de28dd-a895-4962-babb-f0b0091a1b83 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:07.448782 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 829/1647] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:07 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:25:07.906283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97217beb-d56c-4e9b-ad7c-ca9011d3ea3b service glance] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:08.032454 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97217beb-d56c-4e9b-ad7c-ca9011d3ea3b service glance] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:08.048043 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6714bb5-cb02-4373-ab95-899de4e2166c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:08.048972 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6714bb5-cb02-4373-ab95-899de4e2166c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:08.049289 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6714bb5-cb02-4373-ab95-899de4e2166c admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:08.049602 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6714bb5-cb02-4373-ab95-899de4e2166c admin admin] PATH_INFO: `/v3/users/f8c80a19d6724febaa5ffe0292a485ef` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:08.052726 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6714bb5-cb02-4373-ab95-899de4e2166c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c80a19d6724febaa5ffe0292a485ef)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:08.062235 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6714bb5-cb02-4373-ab95-899de4e2166c admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:08.179931 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-d6714bb5-cb02-4373-ab95-899de4e2166c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c80a19d6724febaa5ffe0292a485ef'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:08.180772 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-d6714bb5-cb02-4373-ab95-899de4e2166c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c80a19d6724febaa5ffe0292a485ef'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:08.190001 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-d6714bb5-cb02-4373-ab95-899de4e2166c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c80a19d6724febaa5ffe0292a485ef'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:08.204991 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-d6714bb5-cb02-4373-ab95-899de4e2166c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c80a19d6724febaa5ffe0292a485ef'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:08.221325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-d6714bb5-cb02-4373-ab95-899de4e2166c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c80a19d6724febaa5ffe0292a485ef'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:08.233803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 819/1648] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:25:07 2022] DELETE /identity/v3/users/f8c80a19d6724febaa5ffe0292a485ef => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:08.234973 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115ca09-d203-4a99-943a-e06b807f05f1 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:08.235464 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115ca09-d203-4a99-943a-e06b807f05f1 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:08.235561 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115ca09-d203-4a99-943a-e06b807f05f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:08.286973 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-4115ca09-d203-4a99-943a-e06b807f05f1 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:08.293767 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-4115ca09-d203-4a99-943a-e06b807f05f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:08.456921 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 830/1649] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:08.469615 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6714bb5-cb02-4373-ab95-899de4e2166c admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:08.471279 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-d6714bb5-cb02-4373-ab95-899de4e2166c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:08.556727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0c624-0990-409b-8b47-2f6668c99783 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:08.557018 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0c624-0990-409b-8b47-2f6668c99783 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:08.557488 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0c624-0990-409b-8b47-2f6668c99783 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:08.559099 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 831/1650] 10.222.0.71 () {54 vars in 912 bytes} [Mon May 16 20:25:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:25:08.565144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f8576-07fd-4e78-a654-e1959fee4a42 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:08.565759 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f8576-07fd-4e78-a654-e1959fee4a42 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:08.566230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f8576-07fd-4e78-a654-e1959fee4a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:08.588847 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6714bb5-cb02-4373-ab95-899de4e2166c admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:08.592815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5de65c-510a-4d51-b384-a29ba0a1c603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:08.593477 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5de65c-510a-4d51-b384-a29ba0a1c603 service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:08.593758 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5de65c-510a-4d51-b384-a29ba0a1c603 service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:08.594033 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5de65c-510a-4d51-b384-a29ba0a1c603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:08.604972 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5de65c-510a-4d51-b384-a29ba0a1c603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:08.606457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5de65c-510a-4d51-b384-a29ba0a1c603 service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:08.621326 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 820/1651] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:08.653978 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-ab0f8576-07fd-4e78-a654-e1959fee4a42 None None] MFA Rules not processed for user `eedc173e2cdc48b489ac40f3d9dccb7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:08.655401 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-ab0f8576-07fd-4e78-a654-e1959fee4a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:08.671575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 832/1652] 10.222.0.71 () {58 vars in 1009 bytes} [Mon May 16 20:25:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:08.726390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5de65c-510a-4d51-b384-a29ba0a1c603 service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:08.728241 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-1c5de65c-510a-4d51-b384-a29ba0a1c603 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:08.748865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5de65c-510a-4d51-b384-a29ba0a1c603 service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:08.758145 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b075389-a8ac-4262-9f41-a7472b04473a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:08.758826 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b075389-a8ac-4262-9f41-a7472b04473a service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:08.759106 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b075389-a8ac-4262-9f41-a7472b04473a service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:08.759389 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b075389-a8ac-4262-9f41-a7472b04473a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:08.781697 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b075389-a8ac-4262-9f41-a7472b04473a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:08.788890 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b075389-a8ac-4262-9f41-a7472b04473a service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:08.808749 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 821/1653] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:09.743914 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f8576-07fd-4e78-a654-e1959fee4a42 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:09.745450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-ab0f8576-07fd-4e78-a654-e1959fee4a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:09.776674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f8576-07fd-4e78-a654-e1959fee4a42 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:09.813415 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a2e85-dcf4-4086-ac2d-2d7c519bcb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:09.814310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a2e85-dcf4-4086-ac2d-2d7c519bcb07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:09.814596 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a2e85-dcf4-4086-ac2d-2d7c519bcb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:09.814872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a2e85-dcf4-4086-ac2d-2d7c519bcb07 admin admin] PATH_INFO: `/v3/projects/1e7533ad2048425282b8735f5dd357d2` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:09.816182 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a2e85-dcf4-4086-ac2d-2d7c519bcb07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e7533ad2048425282b8735f5dd357d2)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:09.818353 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a2e85-dcf4-4086-ac2d-2d7c519bcb07 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:09.945206 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-872a2e85-dcf4-4086-ac2d-2d7c519bcb07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e7533ad2048425282b8735f5dd357d2', 'request_id': 'req-872a2e85-dcf4-4086-ac2d-2d7c519bcb07'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:09.973184 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-872a2e85-dcf4-4086-ac2d-2d7c519bcb07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e7533ad2048425282b8735f5dd357d2', 'request_id': 'req-872a2e85-dcf4-4086-ac2d-2d7c519bcb07'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:09.989930 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-872a2e85-dcf4-4086-ac2d-2d7c519bcb07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e7533ad2048425282b8735f5dd357d2', 'request_id': 'req-872a2e85-dcf4-4086-ac2d-2d7c519bcb07'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:10.015501 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-872a2e85-dcf4-4086-ac2d-2d7c519bcb07 admin admin] The token cache is being invalidate because project 1e7533ad2048425282b8735f5dd357d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:25:10.016090 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-872a2e85-dcf4-4086-ac2d-2d7c519bcb07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:10.016952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-872a2e85-dcf4-4086-ac2d-2d7c519bcb07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:10.019241 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 833/1654] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:25:09 2022] DELETE /identity/v3/projects/1e7533ad2048425282b8735f5dd357d2 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:10.026454 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7316b4-551c-4ee3-964b-a3c3d63df466 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:10.026934 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7316b4-551c-4ee3-964b-a3c3d63df466 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:10.027002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7316b4-551c-4ee3-964b-a3c3d63df466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:10.060841 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-0b7316b4-551c-4ee3-964b-a3c3d63df466 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:10.063086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-0b7316b4-551c-4ee3-964b-a3c3d63df466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:10.259962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 822/1655] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:10.267410 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733494bf-4d53-4c13-bb41-fe8a6520a554 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:10.267653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733494bf-4d53-4c13-bb41-fe8a6520a554 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:10.268095 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733494bf-4d53-4c13-bb41-fe8a6520a554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:10.293798 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-733494bf-4d53-4c13-bb41-fe8a6520a554 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:10.295382 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-733494bf-4d53-4c13-bb41-fe8a6520a554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:10.308010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 834/1656] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:10.311924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7316b4-551c-4ee3-964b-a3c3d63df466 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:10.326669 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7316b4-551c-4ee3-964b-a3c3d63df466 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:10.338868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69b1da-5860-4688-8859-b9f0300e97bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:10.339562 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69b1da-5860-4688-8859-b9f0300e97bf admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:10.339846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69b1da-5860-4688-8859-b9f0300e97bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:10.340128 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69b1da-5860-4688-8859-b9f0300e97bf admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:10.341039 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69b1da-5860-4688-8859-b9f0300e97bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:10.341358 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69b1da-5860-4688-8859-b9f0300e97bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:10.343023 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69b1da-5860-4688-8859-b9f0300e97bf admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:10.373661 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 823/1657] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:10.378095 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733494bf-4d53-4c13-bb41-fe8a6520a554 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:10.394491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733494bf-4d53-4c13-bb41-fe8a6520a554 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:10.406350 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d019010-1a8f-4523-80a3-6464fe7af0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:10.407396 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d019010-1a8f-4523-80a3-6464fe7af0d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:10.407880 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d019010-1a8f-4523-80a3-6464fe7af0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:10.408424 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d019010-1a8f-4523-80a3-6464fe7af0d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:10.409376 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d019010-1a8f-4523-80a3-6464fe7af0d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:10.412325 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d019010-1a8f-4523-80a3-6464fe7af0d5 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:10.489394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 835/1658] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:10 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:10.491691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69b1da-5860-4688-8859-b9f0300e97bf admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:10.505963 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69b1da-5860-4688-8859-b9f0300e97bf admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:10.662017 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42833640-cbaf-45cc-8fb3-9850b0dfd1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:10.662838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42833640-cbaf-45cc-8fb3-9850b0dfd1d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:10.663173 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42833640-cbaf-45cc-8fb3-9850b0dfd1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:10.663576 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42833640-cbaf-45cc-8fb3-9850b0dfd1d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:10.664316 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42833640-cbaf-45cc-8fb3-9850b0dfd1d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:10.666277 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42833640-cbaf-45cc-8fb3-9850b0dfd1d4 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:10.704493 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 824/1659] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:10 2022] POST /identity/v3/users => generated 291 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:10.708499 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d019010-1a8f-4523-80a3-6464fe7af0d5 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:10.723176 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d019010-1a8f-4523-80a3-6464fe7af0d5 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:10.736493 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9059d2-b2d4-495b-abde-f9a01c67d571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:10.737590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9059d2-b2d4-495b-abde-f9a01c67d571 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:10.738012 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9059d2-b2d4-495b-abde-f9a01c67d571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:10.738422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9059d2-b2d4-495b-abde-f9a01c67d571 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:10.739311 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9059d2-b2d4-495b-abde-f9a01c67d571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:10.744497 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9059d2-b2d4-495b-abde-f9a01c67d571 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:10.773778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 836/1660] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:10.777775 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42833640-cbaf-45cc-8fb3-9850b0dfd1d4 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:10.817047 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42833640-cbaf-45cc-8fb3-9850b0dfd1d4 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:10.838064 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d3e96-62c9-44d3-b2c4-85448dc4b9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:10.838926 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d3e96-62c9-44d3-b2c4-85448dc4b9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:10.839321 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d3e96-62c9-44d3-b2c4-85448dc4b9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:10.839705 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d3e96-62c9-44d3-b2c4-85448dc4b9a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:10.840700 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d3e96-62c9-44d3-b2c4-85448dc4b9a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:10.842548 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d3e96-62c9-44d3-b2c4-85448dc4b9a4 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:10.880210 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 825/1661] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:25:10.883052 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9059d2-b2d4-495b-abde-f9a01c67d571 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:10.899033 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9059d2-b2d4-495b-abde-f9a01c67d571 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:10.918343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ab376-3ebc-4d7e-a71a-a9782b972af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:10.920877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ab376-3ebc-4d7e-a71a-a9782b972af3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:10.921857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ab376-3ebc-4d7e-a71a-a9782b972af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:10.923461 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ab376-3ebc-4d7e-a71a-a9782b972af3 admin admin] PATH_INFO: `/v3/projects/e23611d29d25409aa484c1190a51fb4f/users/fb9bb27d61364a43af8e0c28e81a1944/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:11.014005 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ab376-3ebc-4d7e-a71a-a9782b972af3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e23611d29d25409aa484c1190a51fb4f, user_id=fb9bb27d61364a43af8e0c28e81a1944, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:11.042631 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ab376-3ebc-4d7e-a71a-a9782b972af3 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:11.064035 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4fa0e-36f3-4b13-98c2-4005fdc8d978 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:11.064549 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4fa0e-36f3-4b13-98c2-4005fdc8d978 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:11.064619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4fa0e-36f3-4b13-98c2-4005fdc8d978 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:11.066209 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 826/1662] 10.222.0.71 () {54 vars in 960 bytes} [Mon May 16 20:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:25:11.076445 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02f090-9323-4333-92a1-93f806ada042 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:11.076738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02f090-9323-4333-92a1-93f806ada042 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:11.077262 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02f090-9323-4333-92a1-93f806ada042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:11.102725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 837/1663] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:10 2022] PUT /identity/v3/projects/e23611d29d25409aa484c1190a51fb4f/users/fb9bb27d61364a43af8e0c28e81a1944/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:25:11.117748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9730a6-e747-40d6-8b8c-6911a5cdcb8a None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:11.118037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9730a6-e747-40d6-8b8c-6911a5cdcb8a None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:11.119490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9730a6-e747-40d6-8b8c-6911a5cdcb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:11.149386 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-4c02f090-9323-4333-92a1-93f806ada042 None None] MFA Rules not processed for user `72e2c8b4ff2349919750aa0f3f7309bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:11.154555 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-4c02f090-9323-4333-92a1-93f806ada042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:11.248582 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-cd9730a6-e747-40d6-8b8c-6911a5cdcb8a None None] MFA Rules not processed for user `fb9bb27d61364a43af8e0c28e81a1944`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:11.249974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-cd9730a6-e747-40d6-8b8c-6911a5cdcb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:11.364836 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 827/1664] 10.222.0.71 () {58 vars in 1057 bytes} [Mon May 16 20:25:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:25:11.376267 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02f090-9323-4333-92a1-93f806ada042 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:11.394175 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02f090-9323-4333-92a1-93f806ada042 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:11.396681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 838/1665] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:11.399748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9730a6-e747-40d6-8b8c-6911a5cdcb8a None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:11.407496 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82771e9-a5e1-4946-a4c0-4477ca9b5742 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e2c8b4ff2349919750aa0f3f7309bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:11.409696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82771e9-a5e1-4946-a4c0-4477ca9b5742 service placement] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:11.410157 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82771e9-a5e1-4946-a4c0-4477ca9b5742 service placement] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:11.414117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82771e9-a5e1-4946-a4c0-4477ca9b5742 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:11.420259 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c82771e9-a5e1-4946-a4c0-4477ca9b5742 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:11.450045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82771e9-a5e1-4946-a4c0-4477ca9b5742 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:11.451820 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82771e9-a5e1-4946-a4c0-4477ca9b5742 service placement] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:11.502713 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 828/1666] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:11.508660 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9730a6-e747-40d6-8b8c-6911a5cdcb8a None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:11.514822 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e267a9-9e87-42fb-a7a5-038f84a1b8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:11.515890 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e267a9-9e87-42fb-a7a5-038f84a1b8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:11.516474 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e267a9-9e87-42fb-a7a5-038f84a1b8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:11.516715 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e267a9-9e87-42fb-a7a5-038f84a1b8e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:11.517547 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e267a9-9e87-42fb-a7a5-038f84a1b8e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:11.520038 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e267a9-9e87-42fb-a7a5-038f84a1b8e1 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:11.575799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 839/1667] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:11 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:11.575988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82771e9-a5e1-4946-a4c0-4477ca9b5742 service placement] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:11.596265 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82771e9-a5e1-4946-a4c0-4477ca9b5742 service placement] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:11.709392 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f557c86-049c-4372-989e-e5a7752dfdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:11.710604 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f557c86-049c-4372-989e-e5a7752dfdce admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:11.710604 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f557c86-049c-4372-989e-e5a7752dfdce admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:11.710754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f557c86-049c-4372-989e-e5a7752dfdce admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:11.711435 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f557c86-049c-4372-989e-e5a7752dfdce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:11.713460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f557c86-049c-4372-989e-e5a7752dfdce admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:11.758842 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e267a9-9e87-42fb-a7a5-038f84a1b8e1 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:11.769220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 829/1668] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:11 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:11.771409 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e267a9-9e87-42fb-a7a5-038f84a1b8e1 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:11.778899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad08a4-dcc1-46e2-b0d4-48e43df4129b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:11.780103 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad08a4-dcc1-46e2-b0d4-48e43df4129b admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:11.780557 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad08a4-dcc1-46e2-b0d4-48e43df4129b admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:11.780999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad08a4-dcc1-46e2-b0d4-48e43df4129b admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:11.782117 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad08a4-dcc1-46e2-b0d4-48e43df4129b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:11.784299 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad08a4-dcc1-46e2-b0d4-48e43df4129b admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:11.802846 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 840/1669] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:25:11.807683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f557c86-049c-4372-989e-e5a7752dfdce admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:11.823049 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f557c86-049c-4372-989e-e5a7752dfdce admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:11.836815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624daac8-966a-427f-aeff-a57165803dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:11.837906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624daac8-966a-427f-aeff-a57165803dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:11.838328 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624daac8-966a-427f-aeff-a57165803dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:11.838774 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624daac8-966a-427f-aeff-a57165803dc2 admin admin] PATH_INFO: `/v3/projects/5d7c6522e5e546a89d4b8f426518ed2f/users/44614be4a24b4120a2547474bf7b1428/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:11.875985 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624daac8-966a-427f-aeff-a57165803dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7c6522e5e546a89d4b8f426518ed2f, user_id=44614be4a24b4120a2547474bf7b1428, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:11.879349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624daac8-966a-427f-aeff-a57165803dc2 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:11.920202 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 830/1670] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:11 2022] PUT /identity/v3/projects/5d7c6522e5e546a89d4b8f426518ed2f/users/44614be4a24b4120a2547474bf7b1428/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:25:11.921804 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad08a4-dcc1-46e2-b0d4-48e43df4129b admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:11.937789 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad08a4-dcc1-46e2-b0d4-48e43df4129b admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:12.080374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b004d6-1155-4b47-ae54-045a84186a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:12.081065 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b004d6-1155-4b47-ae54-045a84186a3b admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:12.081351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b004d6-1155-4b47-ae54-045a84186a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:12.081682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b004d6-1155-4b47-ae54-045a84186a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:12.082416 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b004d6-1155-4b47-ae54-045a84186a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:12.084068 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b004d6-1155-4b47-ae54-045a84186a3b admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:12.112750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 841/1671] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:12.114289 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624daac8-966a-427f-aeff-a57165803dc2 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:12.127492 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624daac8-966a-427f-aeff-a57165803dc2 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:12.168330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0be0ef-146b-40ac-8384-fcc714c675d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:12.171430 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0be0ef-146b-40ac-8384-fcc714c675d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:12.171975 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0be0ef-146b-40ac-8384-fcc714c675d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:12.174067 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0be0ef-146b-40ac-8384-fcc714c675d1 admin admin] PATH_INFO: `/v3/projects/5d7c6522e5e546a89d4b8f426518ed2f/users/44614be4a24b4120a2547474bf7b1428/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:12.180437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0be0ef-146b-40ac-8384-fcc714c675d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7c6522e5e546a89d4b8f426518ed2f, user_id=44614be4a24b4120a2547474bf7b1428, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:12.189567 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0be0ef-146b-40ac-8384-fcc714c675d1 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:12.214296 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b004d6-1155-4b47-ae54-045a84186a3b admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:12.216599 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-c9b004d6-1155-4b47-ae54-045a84186a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:12.226685 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 831/1672] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:12 2022] PUT /identity/v3/projects/5d7c6522e5e546a89d4b8f426518ed2f/users/44614be4a24b4120a2547474bf7b1428/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:12.229390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96183e7e-6ff8-4116-b4c4-703edef42291 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:12.230693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96183e7e-6ff8-4116-b4c4-703edef42291 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:12.230693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96183e7e-6ff8-4116-b4c4-703edef42291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:12.297235 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-96183e7e-6ff8-4116-b4c4-703edef42291 None None] MFA Rules not processed for user `44614be4a24b4120a2547474bf7b1428`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:12.301297 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-96183e7e-6ff8-4116-b4c4-703edef42291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:12.387519 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b004d6-1155-4b47-ae54-045a84186a3b admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:12.522059 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28035112-48b2-4121-9b93-098c9e6bac8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:12.522932 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28035112-48b2-4121-9b93-098c9e6bac8b service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:12.523368 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28035112-48b2-4121-9b93-098c9e6bac8b service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:12.524113 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28035112-48b2-4121-9b93-098c9e6bac8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:12.528997 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-28035112-48b2-4121-9b93-098c9e6bac8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:12.589854 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 832/1673] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:12.610721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96183e7e-6ff8-4116-b4c4-703edef42291 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:12.612602 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-96183e7e-6ff8-4116-b4c4-703edef42291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:12.641204 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96183e7e-6ff8-4116-b4c4-703edef42291 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:12.649710 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b280518-5bcc-4c62-b719-01defa262c8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:12.650750 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b280518-5bcc-4c62-b719-01defa262c8e service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:12.651165 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b280518-5bcc-4c62-b719-01defa262c8e service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:12.651608 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b280518-5bcc-4c62-b719-01defa262c8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:12.672994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b280518-5bcc-4c62-b719-01defa262c8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:12.677764 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b280518-5bcc-4c62-b719-01defa262c8e service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:12.702378 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 833/1674] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:25:12.726754 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28035112-48b2-4121-9b93-098c9e6bac8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:12.728189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28035112-48b2-4121-9b93-098c9e6bac8b service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:12.747916 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 842/1675] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:25:13.872704 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b280518-5bcc-4c62-b719-01defa262c8e service cinder] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:13.903926 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b280518-5bcc-4c62-b719-01defa262c8e service cinder] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:13.930924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8df44-aaec-4ec3-8d8d-a76871b7326e tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44614be4a24b4120a2547474bf7b1428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d7c6522e5e546a89d4b8f426518ed2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:13.931597 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8df44-aaec-4ec3-8d8d-a76871b7326e tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:13.931886 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8df44-aaec-4ec3-8d8d-a76871b7326e tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:13.932195 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8df44-aaec-4ec3-8d8d-a76871b7326e tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:13.953867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8df44-aaec-4ec3-8d8d-a76871b7326e tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:13.956453 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8df44-aaec-4ec3-8d8d-a76871b7326e tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:13.970350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8df44-aaec-4ec3-8d8d-a76871b7326e tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:14.024714 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28035112-48b2-4121-9b93-098c9e6bac8b service cinder] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:14.032650 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 834/1676] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:14.042940 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28035112-48b2-4121-9b93-098c9e6bac8b service cinder] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:14.060788 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab292a9-8ffe-4248-8ce3-e8d70240acd6 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44614be4a24b4120a2547474bf7b1428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d7c6522e5e546a89d4b8f426518ed2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:14.062135 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab292a9-8ffe-4248-8ce3-e8d70240acd6 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:14.062439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab292a9-8ffe-4248-8ce3-e8d70240acd6 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:14.062720 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab292a9-8ffe-4248-8ce3-e8d70240acd6 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:14.063424 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab292a9-8ffe-4248-8ce3-e8d70240acd6 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:14.065435 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab292a9-8ffe-4248-8ce3-e8d70240acd6 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:14.129591 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 843/1677] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:14 2022] POST /identity/v3/projects => generated 353 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:25:14.134667 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8df44-aaec-4ec3-8d8d-a76871b7326e tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:14.148570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8df44-aaec-4ec3-8d8d-a76871b7326e tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:14.321346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06296692-7e7b-4068-9a57-8f3cf5dd69c7 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44614be4a24b4120a2547474bf7b1428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d7c6522e5e546a89d4b8f426518ed2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:14.333521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06296692-7e7b-4068-9a57-8f3cf5dd69c7 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:14.333885 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06296692-7e7b-4068-9a57-8f3cf5dd69c7 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:14.334675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06296692-7e7b-4068-9a57-8f3cf5dd69c7 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:14.335551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06296692-7e7b-4068-9a57-8f3cf5dd69c7 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:14.335875 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06296692-7e7b-4068-9a57-8f3cf5dd69c7 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:14.352572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06296692-7e7b-4068-9a57-8f3cf5dd69c7 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:14.379138 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 835/1678] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:14.521253 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab292a9-8ffe-4248-8ce3-e8d70240acd6 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:14.543979 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab292a9-8ffe-4248-8ce3-e8d70240acd6 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:14.568493 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe011074-bcd2-4b5e-ac93-e02490438847 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44614be4a24b4120a2547474bf7b1428', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d7c6522e5e546a89d4b8f426518ed2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:14.569671 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe011074-bcd2-4b5e-ac93-e02490438847 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:14.570191 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe011074-bcd2-4b5e-ac93-e02490438847 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:14.570670 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe011074-bcd2-4b5e-ac93-e02490438847 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] PATH_INFO: `/v3/projects/21b1938b1f4c4cfd8bba868f222a7e62` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:14.572340 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe011074-bcd2-4b5e-ac93-e02490438847 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] RBAC: Authorizing `identity:delete_project(project_id=21b1938b1f4c4cfd8bba868f222a7e62)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:14.574587 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe011074-bcd2-4b5e-ac93-e02490438847 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:14.644072 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-fe011074-bcd2-4b5e-ac93-e02490438847 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21b1938b1f4c4cfd8bba868f222a7e62', 'request_id': 'req-fe011074-bcd2-4b5e-ac93-e02490438847'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:14.664544 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-fe011074-bcd2-4b5e-ac93-e02490438847 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21b1938b1f4c4cfd8bba868f222a7e62', 'request_id': 'req-fe011074-bcd2-4b5e-ac93-e02490438847'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:14.709197 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-fe011074-bcd2-4b5e-ac93-e02490438847 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21b1938b1f4c4cfd8bba868f222a7e62', 'request_id': 'req-fe011074-bcd2-4b5e-ac93-e02490438847'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:14.773196 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-fe011074-bcd2-4b5e-ac93-e02490438847 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] The token cache is being invalidate because project 21b1938b1f4c4cfd8bba868f222a7e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:25:14.773196 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-fe011074-bcd2-4b5e-ac93-e02490438847 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:14.773935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-fe011074-bcd2-4b5e-ac93-e02490438847 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:14.775558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 844/1679] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:25:14 2022] DELETE /identity/v3/projects/21b1938b1f4c4cfd8bba868f222a7e62 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:15.358047 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06296692-7e7b-4068-9a57-8f3cf5dd69c7 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:15.360818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-06296692-7e7b-4068-9a57-8f3cf5dd69c7 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:15.548470 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06296692-7e7b-4068-9a57-8f3cf5dd69c7 tempest-VolumeQuotaClassesTest-1252101086 tempest-VolumeQuotaClassesTest-1252101086-project-admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:15.728232 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574b719-c5e3-430e-b0f8-2223916738fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:15.729172 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574b719-c5e3-430e-b0f8-2223916738fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:15.729457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574b719-c5e3-430e-b0f8-2223916738fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:15.729735 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574b719-c5e3-430e-b0f8-2223916738fb admin admin] PATH_INFO: `/v3/users/fb9bb27d61364a43af8e0c28e81a1944` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:15.734455 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574b719-c5e3-430e-b0f8-2223916738fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb9bb27d61364a43af8e0c28e81a1944)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:15.738301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574b719-c5e3-430e-b0f8-2223916738fb admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:15.860783 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f574b719-c5e3-430e-b0f8-2223916738fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb9bb27d61364a43af8e0c28e81a1944'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:15.861796 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f574b719-c5e3-430e-b0f8-2223916738fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb9bb27d61364a43af8e0c28e81a1944'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:15.885176 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f574b719-c5e3-430e-b0f8-2223916738fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb9bb27d61364a43af8e0c28e81a1944'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:15.915777 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f574b719-c5e3-430e-b0f8-2223916738fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb9bb27d61364a43af8e0c28e81a1944'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:15.955668 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f574b719-c5e3-430e-b0f8-2223916738fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb9bb27d61364a43af8e0c28e81a1944'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:15.981721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 836/1680] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:25:15 2022] DELETE /identity/v3/users/fb9bb27d61364a43af8e0c28e81a1944 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:16.000847 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f6be8-7180-45d0-a49a-3764bcd3edd0 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:16.001312 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f6be8-7180-45d0-a49a-3764bcd3edd0 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:16.001382 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f6be8-7180-45d0-a49a-3764bcd3edd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:16.049444 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-6e4f6be8-7180-45d0-a49a-3764bcd3edd0 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:16.050677 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-6e4f6be8-7180-45d0-a49a-3764bcd3edd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:16.265554 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 845/1681] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:16.356351 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574b719-c5e3-430e-b0f8-2223916738fb admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:16.357840 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f574b719-c5e3-430e-b0f8-2223916738fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:16.459945 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574b719-c5e3-430e-b0f8-2223916738fb admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:16.465239 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4ddae-dd73-46dc-9797-914844a8928f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:16.466842 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4ddae-dd73-46dc-9797-914844a8928f service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:16.467362 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4ddae-dd73-46dc-9797-914844a8928f service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:16.469149 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4ddae-dd73-46dc-9797-914844a8928f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:16.480856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4ddae-dd73-46dc-9797-914844a8928f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:16.482688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4ddae-dd73-46dc-9797-914844a8928f service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:16.510189 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 837/1682] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:17.101896 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421d80d-df73-4571-b864-45e58bfdefec None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:17.102997 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421d80d-df73-4571-b864-45e58bfdefec None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:17.103566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421d80d-df73-4571-b864-45e58bfdefec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:17.141206 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-3421d80d-df73-4571-b864-45e58bfdefec None None] MFA Rules not processed for user `38a56f3572874938ad4642fa34751a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:17.146194 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-3421d80d-df73-4571-b864-45e58bfdefec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:17.281761 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 846/1683] 10.222.0.71 () {58 vars in 1009 bytes} [Mon May 16 20:25:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:25:17.346990 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c42d3-d2a8-4bea-a7cd-69e4945cc267 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:17.347317 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c42d3-d2a8-4bea-a7cd-69e4945cc267 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:17.347601 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c42d3-d2a8-4bea-a7cd-69e4945cc267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:17.429836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440dd02-4e3c-482e-b57f-f9bc5aa1a681 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:17.430160 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440dd02-4e3c-482e-b57f-f9bc5aa1a681 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:17.430489 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440dd02-4e3c-482e-b57f-f9bc5aa1a681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:17.471401 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-661c42d3-d2a8-4bea-a7cd-69e4945cc267 None None] MFA Rules not processed for user `4bf4652bf6ac4713ab4931365b943d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:17.479366 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-661c42d3-d2a8-4bea-a7cd-69e4945cc267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:17.494493 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-f440dd02-4e3c-482e-b57f-f9bc5aa1a681 None None] MFA Rules not processed for user `7fb4dfe324594ec6924ded65bf7e613b`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:17.496507 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f440dd02-4e3c-482e-b57f-f9bc5aa1a681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:17.610282 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 847/1684] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:17.611244 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440dd02-4e3c-482e-b57f-f9bc5aa1a681 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:17.613520 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f440dd02-4e3c-482e-b57f-f9bc5aa1a681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:17.660626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 838/1685] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:17.663134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b634050-d670-496b-a11f-add56d4ca6fc None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:17.663897 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b634050-d670-496b-a11f-add56d4ca6fc None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:17.664360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b634050-d670-496b-a11f-add56d4ca6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:17.712906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-7b634050-d670-496b-a11f-add56d4ca6fc None None] MFA Rules not processed for user `7fb4dfe324594ec6924ded65bf7e613b`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:17.715346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-7b634050-d670-496b-a11f-add56d4ca6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:17.725792 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 839/1686] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:17.729516 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b634050-d670-496b-a11f-add56d4ca6fc None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:17.734326 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-7b634050-d670-496b-a11f-add56d4ca6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:17.741439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440dd02-4e3c-482e-b57f-f9bc5aa1a681 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:17.757261 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90ef04-f9b1-4de0-8ea8-9c1bf2e7327d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e701cf55d13410aa259ec72578ed27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:17.758188 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90ef04-f9b1-4de0-8ea8-9c1bf2e7327d service swift] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:17.758688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90ef04-f9b1-4de0-8ea8-9c1bf2e7327d service swift] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:17.770804 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90ef04-f9b1-4de0-8ea8-9c1bf2e7327d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:17.829500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90ef04-f9b1-4de0-8ea8-9c1bf2e7327d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:17.834173 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90ef04-f9b1-4de0-8ea8-9c1bf2e7327d service swift] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:17.865747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 848/1687] 10.222.0.71 () {60 vars in 1384 bytes} [Mon May 16 20:25:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:25:17.874294 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90ef04-f9b1-4de0-8ea8-9c1bf2e7327d service swift] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:17.883160 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-9d90ef04-f9b1-4de0-8ea8-9c1bf2e7327d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:18.148766 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b634050-d670-496b-a11f-add56d4ca6fc None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:18.175337 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635dd571-f953-43f9-b614-a943b88c0265 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:18.176011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dd571-f953-43f9-b614-a943b88c0265 service nova] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:18.176351 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dd571-f953-43f9-b614-a943b88c0265 service nova] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:18.176626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dd571-f953-43f9-b614-a943b88c0265 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:18.237524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635dd571-f953-43f9-b614-a943b88c0265 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:18.249102 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635dd571-f953-43f9-b614-a943b88c0265 service nova] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:18.298742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90ef04-f9b1-4de0-8ea8-9c1bf2e7327d service swift] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:18.305881 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 840/1688] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:18.306981 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635dd571-f953-43f9-b614-a943b88c0265 service nova] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:18.321418 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-635dd571-f953-43f9-b614-a943b88c0265 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:18.325941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55431c4a-f06d-4e6d-b0f6-cdf77076d111 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:18.328406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55431c4a-f06d-4e6d-b0f6-cdf77076d111 service nova] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:18.328904 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55431c4a-f06d-4e6d-b0f6-cdf77076d111 service nova] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:18.329963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55431c4a-f06d-4e6d-b0f6-cdf77076d111 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:18.360863 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55431c4a-f06d-4e6d-b0f6-cdf77076d111 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:18.374672 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635dd571-f953-43f9-b614-a943b88c0265 service nova] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:18.376399 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55431c4a-f06d-4e6d-b0f6-cdf77076d111 service nova] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:18.399565 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4868c-6a8c-4468-8751-997fc15c3eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:18.400540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4868c-6a8c-4468-8751-997fc15c3eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:18.400825 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4868c-6a8c-4468-8751-997fc15c3eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:18.401100 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4868c-6a8c-4468-8751-997fc15c3eb8 admin admin] PATH_INFO: `/v3/projects/e23611d29d25409aa484c1190a51fb4f` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:18.417174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4868c-6a8c-4468-8751-997fc15c3eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e23611d29d25409aa484c1190a51fb4f)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:18.418223 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: WARNING py.warnings [None req-e6a4868c-6a8c-4468-8751-997fc15c3eb8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 20:25:18.418223 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: warnings.warn(msg) May 16 20:25:18.418223 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: May 16 20:25:18.423312 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4868c-6a8c-4468-8751-997fc15c3eb8 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:18.438334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 849/1689] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:18.626352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e6a4868c-6a8c-4468-8751-997fc15c3eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e23611d29d25409aa484c1190a51fb4f', 'request_id': 'req-e6a4868c-6a8c-4468-8751-997fc15c3eb8'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:18.646197 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e6a4868c-6a8c-4468-8751-997fc15c3eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e23611d29d25409aa484c1190a51fb4f', 'request_id': 'req-e6a4868c-6a8c-4468-8751-997fc15c3eb8'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:18.673330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e6a4868c-6a8c-4468-8751-997fc15c3eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e23611d29d25409aa484c1190a51fb4f', 'request_id': 'req-e6a4868c-6a8c-4468-8751-997fc15c3eb8'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:18.729780 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e6a4868c-6a8c-4468-8751-997fc15c3eb8 admin admin] The token cache is being invalidate because project e23611d29d25409aa484c1190a51fb4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:25:18.730264 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e6a4868c-6a8c-4468-8751-997fc15c3eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:18.731093 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e6a4868c-6a8c-4468-8751-997fc15c3eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:18.745558 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 841/1690] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:25:18 2022] DELETE /identity/v3/projects/e23611d29d25409aa484c1190a51fb4f => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:18.746705 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55431c4a-f06d-4e6d-b0f6-cdf77076d111 service nova] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:18.787931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55431c4a-f06d-4e6d-b0f6-cdf77076d111 service nova] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:19.056897 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73cb87-e836-48c7-9acc-63bc5917b36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:19.057992 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73cb87-e836-48c7-9acc-63bc5917b36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:19.058495 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73cb87-e836-48c7-9acc-63bc5917b36f admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:19.059177 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73cb87-e836-48c7-9acc-63bc5917b36f admin admin] PATH_INFO: `/v3/users/44614be4a24b4120a2547474bf7b1428` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:19.060704 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73cb87-e836-48c7-9acc-63bc5917b36f admin admin] RBAC: Authorizing `identity:delete_user(user_id=44614be4a24b4120a2547474bf7b1428)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:19.061769 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: WARNING py.warnings [None req-da73cb87-e836-48c7-9acc-63bc5917b36f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 20:25:19.061769 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: warnings.warn(msg) May 16 20:25:19.061769 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: May 16 20:25:19.063083 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73cb87-e836-48c7-9acc-63bc5917b36f admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:19.318317 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-da73cb87-e836-48c7-9acc-63bc5917b36f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44614be4a24b4120a2547474bf7b1428'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:19.380675 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-da73cb87-e836-48c7-9acc-63bc5917b36f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44614be4a24b4120a2547474bf7b1428'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:19.398093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-da73cb87-e836-48c7-9acc-63bc5917b36f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44614be4a24b4120a2547474bf7b1428'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:19.399476 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-da73cb87-e836-48c7-9acc-63bc5917b36f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44614be4a24b4120a2547474bf7b1428'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:19.410043 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-da73cb87-e836-48c7-9acc-63bc5917b36f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44614be4a24b4120a2547474bf7b1428'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:19.450583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 850/1691] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:25:18 2022] DELETE /identity/v3/users/44614be4a24b4120a2547474bf7b1428 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:20.625805 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac784c99-7182-4e29-b7a4-93964cefac43 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:20.627689 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac784c99-7182-4e29-b7a4-93964cefac43 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:20.628340 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac784c99-7182-4e29-b7a4-93964cefac43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:20.669054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-ac784c99-7182-4e29-b7a4-93964cefac43 None None] MFA Rules not processed for user `7fb4dfe324594ec6924ded65bf7e613b`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:20.673791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-ac784c99-7182-4e29-b7a4-93964cefac43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:20.881272 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 842/1692] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:22.603260 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73cb87-e836-48c7-9acc-63bc5917b36f admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:22.605381 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-da73cb87-e836-48c7-9acc-63bc5917b36f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:22.775968 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73cb87-e836-48c7-9acc-63bc5917b36f admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:22.803130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ad5b1-fad0-4c04-9b78-3c62eac4b258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:22.808912 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ad5b1-fad0-4c04-9b78-3c62eac4b258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:22.812035 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ad5b1-fad0-4c04-9b78-3c62eac4b258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:22.813537 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ad5b1-fad0-4c04-9b78-3c62eac4b258 admin admin] PATH_INFO: `/v3/projects/5d7c6522e5e546a89d4b8f426518ed2f` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:22.819432 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ad5b1-fad0-4c04-9b78-3c62eac4b258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d7c6522e5e546a89d4b8f426518ed2f)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:22.837234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ad5b1-fad0-4c04-9b78-3c62eac4b258 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:23.019382 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c80ad5b1-fad0-4c04-9b78-3c62eac4b258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d7c6522e5e546a89d4b8f426518ed2f', 'request_id': 'req-c80ad5b1-fad0-4c04-9b78-3c62eac4b258'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:23.051185 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c80ad5b1-fad0-4c04-9b78-3c62eac4b258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d7c6522e5e546a89d4b8f426518ed2f', 'request_id': 'req-c80ad5b1-fad0-4c04-9b78-3c62eac4b258'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:23.072745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c80ad5b1-fad0-4c04-9b78-3c62eac4b258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d7c6522e5e546a89d4b8f426518ed2f', 'request_id': 'req-c80ad5b1-fad0-4c04-9b78-3c62eac4b258'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:23.106156 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c80ad5b1-fad0-4c04-9b78-3c62eac4b258 admin admin] The token cache is being invalidate because project 5d7c6522e5e546a89d4b8f426518ed2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:25:23.106464 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c80ad5b1-fad0-4c04-9b78-3c62eac4b258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:23.110426 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c80ad5b1-fad0-4c04-9b78-3c62eac4b258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:23.134132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 851/1693] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:25:22 2022] DELETE /identity/v3/projects/5d7c6522e5e546a89d4b8f426518ed2f => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:23.135904 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77c5d6-2c7c-45e3-8c20-764f7d9f4667 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:23.136408 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77c5d6-2c7c-45e3-8c20-764f7d9f4667 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:23.136494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77c5d6-2c7c-45e3-8c20-764f7d9f4667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:23.175335 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-bc77c5d6-2c7c-45e3-8c20-764f7d9f4667 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:23.176615 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-bc77c5d6-2c7c-45e3-8c20-764f7d9f4667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:23.322929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2febb-481c-4a43-8da5-d3151640d8be None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:23.323459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2febb-481c-4a43-8da5-d3151640d8be None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:23.324128 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2febb-481c-4a43-8da5-d3151640d8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:23.415383 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-bad2febb-481c-4a43-8da5-d3151640d8be None None] MFA Rules not processed for user `eedc173e2cdc48b489ac40f3d9dccb7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:23.427211 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-bad2febb-481c-4a43-8da5-d3151640d8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:23.475838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 843/1694] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:23.477171 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77c5d6-2c7c-45e3-8c20-764f7d9f4667 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:23.481190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-bc77c5d6-2c7c-45e3-8c20-764f7d9f4667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:23.538946 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77c5d6-2c7c-45e3-8c20-764f7d9f4667 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:23.557644 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22527760-86e9-4ed6-a81d-62be9415c85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:23.558820 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22527760-86e9-4ed6-a81d-62be9415c85e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:23.559365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22527760-86e9-4ed6-a81d-62be9415c85e admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:23.560754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22527760-86e9-4ed6-a81d-62be9415c85e admin admin] PATH_INFO: `/v3/users/34a76317250443fd8d8b1e1b781238fb` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:23.565635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22527760-86e9-4ed6-a81d-62be9415c85e admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a76317250443fd8d8b1e1b781238fb)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:23.572923 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22527760-86e9-4ed6-a81d-62be9415c85e admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:23.664498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 852/1695] 10.222.0.81 () {58 vars in 1015 bytes} [Mon May 16 20:25:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:25:23.666744 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356ae0d-8115-4a3f-b7d6-babb2b458776 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:23.670242 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356ae0d-8115-4a3f-b7d6-babb2b458776 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:23.671609 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356ae0d-8115-4a3f-b7d6-babb2b458776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:23.696512 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-22527760-86e9-4ed6-a81d-62be9415c85e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a76317250443fd8d8b1e1b781238fb'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:23.697719 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-22527760-86e9-4ed6-a81d-62be9415c85e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a76317250443fd8d8b1e1b781238fb'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:23.732627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-22527760-86e9-4ed6-a81d-62be9415c85e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a76317250443fd8d8b1e1b781238fb'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:23.753010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-d356ae0d-8115-4a3f-b7d6-babb2b458776 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:23.755918 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-d356ae0d-8115-4a3f-b7d6-babb2b458776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:23.765903 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-22527760-86e9-4ed6-a81d-62be9415c85e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a76317250443fd8d8b1e1b781238fb'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:23.786281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 853/1696] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:23.791923 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356ae0d-8115-4a3f-b7d6-babb2b458776 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:23.820228 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356ae0d-8115-4a3f-b7d6-babb2b458776 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:23.839959 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-22527760-86e9-4ed6-a81d-62be9415c85e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a76317250443fd8d8b1e1b781238fb'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:23.840715 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4f038-170e-4b58-b1e0-74969a9673c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:23.842555 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4f038-170e-4b58-b1e0-74969a9673c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:23.844125 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4f038-170e-4b58-b1e0-74969a9673c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:23.844661 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4f038-170e-4b58-b1e0-74969a9673c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:23.847762 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4f038-170e-4b58-b1e0-74969a9673c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:23.848545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4f038-170e-4b58-b1e0-74969a9673c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:23.855810 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4f038-170e-4b58-b1e0-74969a9673c1 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:23.881870 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 844/1697] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:25:23 2022] DELETE /identity/v3/users/34a76317250443fd8d8b1e1b781238fb => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:23.886003 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22527760-86e9-4ed6-a81d-62be9415c85e admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:23.890914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-22527760-86e9-4ed6-a81d-62be9415c85e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:23.892480 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 854/1698] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:23.897581 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d4b8e-5be5-4580-9a20-5ea365d88103 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:23.898279 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d4b8e-5be5-4580-9a20-5ea365d88103 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:23.898839 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d4b8e-5be5-4580-9a20-5ea365d88103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:24.149671 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22527760-86e9-4ed6-a81d-62be9415c85e admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:24.172005 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86ed99-df1c-459f-b499-ff1a673be7db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:24.177284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86ed99-df1c-459f-b499-ff1a673be7db service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:24.178862 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86ed99-df1c-459f-b499-ff1a673be7db service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:24.182534 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86ed99-df1c-459f-b499-ff1a673be7db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:24.192610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-4e86ed99-df1c-459f-b499-ff1a673be7db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:24.277361 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86ed99-df1c-459f-b499-ff1a673be7db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:24.278828 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86ed99-df1c-459f-b499-ff1a673be7db service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:24.342750 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 845/1699] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:24.346676 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86ed99-df1c-459f-b499-ff1a673be7db service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:24.367539 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-4e86ed99-df1c-459f-b499-ff1a673be7db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:24.665482 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86ed99-df1c-459f-b499-ff1a673be7db service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:24.698669 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d42c0-59ad-4f01-85c0-dbecf07bacba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:24.699840 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d42c0-59ad-4f01-85c0-dbecf07bacba admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:24.701855 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d42c0-59ad-4f01-85c0-dbecf07bacba admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:24.702279 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d42c0-59ad-4f01-85c0-dbecf07bacba admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:24.703225 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d42c0-59ad-4f01-85c0-dbecf07bacba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:24.708641 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d42c0-59ad-4f01-85c0-dbecf07bacba admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:24.814259 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-585d4b8e-5be5-4580-9a20-5ea365d88103 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:24.815575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-585d4b8e-5be5-4580-9a20-5ea365d88103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:24.831064 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 846/1700] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:24 2022] POST /identity/v3/projects => generated 381 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:24.838147 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d42c0-59ad-4f01-85c0-dbecf07bacba admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:25.079275 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 855/1701] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 1186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:25.148733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d42c0-59ad-4f01-85c0-dbecf07bacba admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:25.185364 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43106a60-857c-4183-bbfe-f3751d3572db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:25.188661 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d4b8e-5be5-4580-9a20-5ea365d88103 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:25.189261 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43106a60-857c-4183-bbfe-f3751d3572db admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:25.191209 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43106a60-857c-4183-bbfe-f3751d3572db admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:25.192364 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43106a60-857c-4183-bbfe-f3751d3572db admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:25.193293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43106a60-857c-4183-bbfe-f3751d3572db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:25.197527 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43106a60-857c-4183-bbfe-f3751d3572db admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:25.301462 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 847/1702] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:24 2022] POST /identity/v3/users => generated 291 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:25.302409 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43106a60-857c-4183-bbfe-f3751d3572db admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:25.342666 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43106a60-857c-4183-bbfe-f3751d3572db admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:25.373711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4966ba3-9715-47ab-addb-84b7f41f2804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:25.375875 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4966ba3-9715-47ab-addb-84b7f41f2804 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:25.377056 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4966ba3-9715-47ab-addb-84b7f41f2804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:25.378094 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4966ba3-9715-47ab-addb-84b7f41f2804 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:25.379666 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4966ba3-9715-47ab-addb-84b7f41f2804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:25.384116 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4966ba3-9715-47ab-addb-84b7f41f2804 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:25.391463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d4b8e-5be5-4580-9a20-5ea365d88103 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:25.396329 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8123d44-8fac-4d69-9db0-94c58fb9d782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:25.397253 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8123d44-8fac-4d69-9db0-94c58fb9d782 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:25.397656 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8123d44-8fac-4d69-9db0-94c58fb9d782 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:25.397935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8123d44-8fac-4d69-9db0-94c58fb9d782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:25.407134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 848/1703] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:25.411168 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4966ba3-9715-47ab-addb-84b7f41f2804 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:25.425271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8123d44-8fac-4d69-9db0-94c58fb9d782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:25.426912 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8123d44-8fac-4d69-9db0-94c58fb9d782 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:25.432094 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4966ba3-9715-47ab-addb-84b7f41f2804 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:25.454290 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 856/1704] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:25.455676 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd41add-9c4c-48b0-ba98-cf704a0edbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:25.459406 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd41add-9c4c-48b0-ba98-cf704a0edbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:25.459918 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd41add-9c4c-48b0-ba98-cf704a0edbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:25.460388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd41add-9c4c-48b0-ba98-cf704a0edbf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:25.465386 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd41add-9c4c-48b0-ba98-cf704a0edbf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:25.468188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd41add-9c4c-48b0-ba98-cf704a0edbf7 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:25.525815 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8123d44-8fac-4d69-9db0-94c58fb9d782 service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:25.526311 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 849/1705] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:25.552371 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8123d44-8fac-4d69-9db0-94c58fb9d782 service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:25.582477 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26ebf2-bee0-4563-b3b0-a1b6571f4a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:25.583516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26ebf2-bee0-4563-b3b0-a1b6571f4a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:25.583815 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26ebf2-bee0-4563-b3b0-a1b6571f4a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:25.590361 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26ebf2-bee0-4563-b3b0-a1b6571f4a24 admin admin] PATH_INFO: `/v3/projects/37408c457c8641b19f6a29509df2f77a/users/8d8b6349a4d54c0aa538c69ec2220fb6/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:25.679962 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26ebf2-bee0-4563-b3b0-a1b6571f4a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37408c457c8641b19f6a29509df2f77a, user_id=8d8b6349a4d54c0aa538c69ec2220fb6, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:25.682803 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26ebf2-bee0-4563-b3b0-a1b6571f4a24 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:25.744941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 857/1706] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:25 2022] PUT /identity/v3/projects/37408c457c8641b19f6a29509df2f77a/users/8d8b6349a4d54c0aa538c69ec2220fb6/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:25:25.755100 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a450709-e33f-4a39-ba6d-31c4918417cc None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:25.761455 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a450709-e33f-4a39-ba6d-31c4918417cc None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:25.761804 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a450709-e33f-4a39-ba6d-31c4918417cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:25.854375 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-9a450709-e33f-4a39-ba6d-31c4918417cc None None] MFA Rules not processed for user `8d8b6349a4d54c0aa538c69ec2220fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:25.855942 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-9a450709-e33f-4a39-ba6d-31c4918417cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:26.085868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 850/1707] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:26.090427 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26ebf2-bee0-4563-b3b0-a1b6571f4a24 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:26.334696 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26ebf2-bee0-4563-b3b0-a1b6571f4a24 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:26.345650 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830c62a-ccad-46de-9854-39c3c3c3ad5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:26.346348 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830c62a-ccad-46de-9854-39c3c3c3ad5c admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:26.346635 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830c62a-ccad-46de-9854-39c3c3c3ad5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:26.353498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830c62a-ccad-46de-9854-39c3c3c3ad5c admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:26.354507 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830c62a-ccad-46de-9854-39c3c3c3ad5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:26.367563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830c62a-ccad-46de-9854-39c3c3c3ad5c admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:26.505004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 858/1708] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:26 2022] POST /identity/v3/projects => generated 383 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:26.506611 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a450709-e33f-4a39-ba6d-31c4918417cc None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:26.525965 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a450709-e33f-4a39-ba6d-31c4918417cc None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:26.795739 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a55bb-b345-4dce-8a37-157b02624736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:26.803774 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a55bb-b345-4dce-8a37-157b02624736 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:26.803774 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a55bb-b345-4dce-8a37-157b02624736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:26.803774 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a55bb-b345-4dce-8a37-157b02624736 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:26.803774 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a55bb-b345-4dce-8a37-157b02624736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:26.803774 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a55bb-b345-4dce-8a37-157b02624736 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:26.888826 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 851/1709] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:26 2022] POST /identity/v3/users => generated 298 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:26.892770 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830c62a-ccad-46de-9854-39c3c3c3ad5c admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:26.910797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830c62a-ccad-46de-9854-39c3c3c3ad5c admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:26.934941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5238d0d6-0b31-48ae-95de-ee931e5c25c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:26.937165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238d0d6-0b31-48ae-95de-ee931e5c25c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:26.940950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238d0d6-0b31-48ae-95de-ee931e5c25c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:26.949953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238d0d6-0b31-48ae-95de-ee931e5c25c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:26.955779 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5238d0d6-0b31-48ae-95de-ee931e5c25c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:26.958902 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5238d0d6-0b31-48ae-95de-ee931e5c25c7 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:26.999648 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a55bb-b345-4dce-8a37-157b02624736 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:27.001390 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 859/1710] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:27.024871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a55bb-b345-4dce-8a37-157b02624736 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:27.055431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0b1a9-3997-40ef-ac51-c8bb2a336890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:27.057168 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0b1a9-3997-40ef-ac51-c8bb2a336890 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:27.057457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0b1a9-3997-40ef-ac51-c8bb2a336890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:27.057731 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0b1a9-3997-40ef-ac51-c8bb2a336890 admin admin] PATH_INFO: `/v3/projects/7f9eaeeff1c64886aeca81425ceb4b13/users/b027cc232e364fdc9272528eddff1b7a/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:27.110613 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0b1a9-3997-40ef-ac51-c8bb2a336890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9eaeeff1c64886aeca81425ceb4b13, user_id=b027cc232e364fdc9272528eddff1b7a, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:27.113308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0b1a9-3997-40ef-ac51-c8bb2a336890 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:27.149010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1793b0-970b-41a9-91af-25fb3517106c None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:27.152711 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1793b0-970b-41a9-91af-25fb3517106c None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:27.153292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1793b0-970b-41a9-91af-25fb3517106c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:27.158420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 852/1711] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:26 2022] PUT /identity/v3/projects/7f9eaeeff1c64886aeca81425ceb4b13/users/b027cc232e364fdc9272528eddff1b7a/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:27.162845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0b1a9-3997-40ef-ac51-c8bb2a336890 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:27.252337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-be1793b0-970b-41a9-91af-25fb3517106c None None] MFA Rules not processed for user `c330fcea8dda449ab5e125b741d49ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:27.255160 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-be1793b0-970b-41a9-91af-25fb3517106c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:27.435008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0b1a9-3997-40ef-ac51-c8bb2a336890 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:27.450673 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4699d-62f8-48fa-a08d-1e77f705769d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:27.451624 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4699d-62f8-48fa-a08d-1e77f705769d admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:27.452083 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4699d-62f8-48fa-a08d-1e77f705769d admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:27.452589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4699d-62f8-48fa-a08d-1e77f705769d admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:27.453695 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4699d-62f8-48fa-a08d-1e77f705769d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:27.455706 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4699d-62f8-48fa-a08d-1e77f705769d admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:27.474316 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 853/1712] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:25:27.478527 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4699d-62f8-48fa-a08d-1e77f705769d admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:27.495455 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4699d-62f8-48fa-a08d-1e77f705769d admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:27.508081 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56dcf8-1134-4677-9517-633f1afaceed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:27.515615 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56dcf8-1134-4677-9517-633f1afaceed admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:27.516087 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56dcf8-1134-4677-9517-633f1afaceed admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:27.516528 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56dcf8-1134-4677-9517-633f1afaceed admin admin] PATH_INFO: `/v3/projects/7f9eaeeff1c64886aeca81425ceb4b13/users/b027cc232e364fdc9272528eddff1b7a/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:27.520707 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56dcf8-1134-4677-9517-633f1afaceed admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9eaeeff1c64886aeca81425ceb4b13, user_id=b027cc232e364fdc9272528eddff1b7a, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:27.524058 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56dcf8-1134-4677-9517-633f1afaceed admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:27.539013 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 854/1713] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:27 2022] PUT /identity/v3/projects/7f9eaeeff1c64886aeca81425ceb4b13/users/b027cc232e364fdc9272528eddff1b7a/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:27.550744 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cc582-a0e3-4598-83d6-53f51dac165f None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:27.551264 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cc582-a0e3-4598-83d6-53f51dac165f None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:27.551683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cc582-a0e3-4598-83d6-53f51dac165f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:27.567304 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 860/1714] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:27.595866 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-5c6cc582-a0e3-4598-83d6-53f51dac165f None None] MFA Rules not processed for user `b027cc232e364fdc9272528eddff1b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:27.598067 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-5c6cc582-a0e3-4598-83d6-53f51dac165f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:27.699888 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 855/1715] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:27.714495 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1793b0-970b-41a9-91af-25fb3517106c None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:27.716516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-be1793b0-970b-41a9-91af-25fb3517106c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:27.821014 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cc582-a0e3-4598-83d6-53f51dac165f None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:27.822471 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-5c6cc582-a0e3-4598-83d6-53f51dac165f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:27.859835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1793b0-970b-41a9-91af-25fb3517106c None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:27.972813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfa079-cf61-4560-bb8e-10b5963f84cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:27.974349 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfa079-cf61-4560-bb8e-10b5963f84cb service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:27.976510 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfa079-cf61-4560-bb8e-10b5963f84cb service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:27.976982 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfa079-cf61-4560-bb8e-10b5963f84cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:27.993671 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfa079-cf61-4560-bb8e-10b5963f84cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:27.998290 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfa079-cf61-4560-bb8e-10b5963f84cb service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:28.003209 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cc582-a0e3-4598-83d6-53f51dac165f None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:28.014356 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 861/1716] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:28.020250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4370dc-e8c0-4049-a00d-6f150f8217f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:28.020930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4370dc-e8c0-4049-a00d-6f150f8217f4 service nova] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:28.021207 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4370dc-e8c0-4049-a00d-6f150f8217f4 service nova] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:28.022407 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4370dc-e8c0-4049-a00d-6f150f8217f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:28.157801 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4370dc-e8c0-4049-a00d-6f150f8217f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:28.162896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4370dc-e8c0-4049-a00d-6f150f8217f4 service nova] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:28.205664 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 856/1717] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:28.236444 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfa079-cf61-4560-bb8e-10b5963f84cb service cinder] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:28.250475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfa079-cf61-4560-bb8e-10b5963f84cb service cinder] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:28.266255 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c6a9c-13ef-4d57-9d14-c69ec053c260 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:28.267714 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c6a9c-13ef-4d57-9d14-c69ec053c260 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:28.268001 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c6a9c-13ef-4d57-9d14-c69ec053c260 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:28.268330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c6a9c-13ef-4d57-9d14-c69ec053c260 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:28.355449 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c6a9c-13ef-4d57-9d14-c69ec053c260 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:28.357052 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c6a9c-13ef-4d57-9d14-c69ec053c260 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:28.368885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 862/1718] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:28.548934 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edbc65-e4c7-4652-b9fa-2b99132918e3 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:28.549528 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edbc65-e4c7-4652-b9fa-2b99132918e3 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:28.549983 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edbc65-e4c7-4652-b9fa-2b99132918e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:28.586340 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-82edbc65-e4c7-4652-b9fa-2b99132918e3 None None] MFA Rules not processed for user `4bf4652bf6ac4713ab4931365b943d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:28.592031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-82edbc65-e4c7-4652-b9fa-2b99132918e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:28.746833 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 857/1719] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:28.880399 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c6a9c-13ef-4d57-9d14-c69ec053c260 service cinder] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:28.884064 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-b21c6a9c-13ef-4d57-9d14-c69ec053c260 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:29.038231 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c6a9c-13ef-4d57-9d14-c69ec053c260 service cinder] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:29.049713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e4528-cbfa-4fa5-a8af-05d9eb97309d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:29.052712 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e4528-cbfa-4fa5-a8af-05d9eb97309d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:29.053259 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e4528-cbfa-4fa5-a8af-05d9eb97309d admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:29.054763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e4528-cbfa-4fa5-a8af-05d9eb97309d admin admin] PATH_INFO: `/v3/projects/968e2cb599d64b0d8115717b1d5365a3` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:29.072409 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e4528-cbfa-4fa5-a8af-05d9eb97309d admin admin] RBAC: Authorizing `identity:delete_project(project_id=968e2cb599d64b0d8115717b1d5365a3)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:29.074464 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e4528-cbfa-4fa5-a8af-05d9eb97309d admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:29.197709 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-535e4528-cbfa-4fa5-a8af-05d9eb97309d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '968e2cb599d64b0d8115717b1d5365a3', 'request_id': 'req-535e4528-cbfa-4fa5-a8af-05d9eb97309d'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:29.217065 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-535e4528-cbfa-4fa5-a8af-05d9eb97309d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '968e2cb599d64b0d8115717b1d5365a3', 'request_id': 'req-535e4528-cbfa-4fa5-a8af-05d9eb97309d'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:29.229106 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-535e4528-cbfa-4fa5-a8af-05d9eb97309d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '968e2cb599d64b0d8115717b1d5365a3', 'request_id': 'req-535e4528-cbfa-4fa5-a8af-05d9eb97309d'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:29.270034 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-535e4528-cbfa-4fa5-a8af-05d9eb97309d admin admin] The token cache is being invalidate because project 968e2cb599d64b0d8115717b1d5365a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:25:29.270897 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-535e4528-cbfa-4fa5-a8af-05d9eb97309d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:29.276935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-535e4528-cbfa-4fa5-a8af-05d9eb97309d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:29.281509 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 863/1720] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:25:28 2022] DELETE /identity/v3/projects/968e2cb599d64b0d8115717b1d5365a3 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:29.286294 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11582f4b-3442-4bb2-9728-4c051d57dabd None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:29.286780 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11582f4b-3442-4bb2-9728-4c051d57dabd None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:29.287354 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11582f4b-3442-4bb2-9728-4c051d57dabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:29.317710 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-11582f4b-3442-4bb2-9728-4c051d57dabd None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:29.324349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-11582f4b-3442-4bb2-9728-4c051d57dabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:29.438830 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 858/1721] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:29.449367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23db8bd-5334-4b3c-aba0-0da8741efdd8 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:29.450390 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23db8bd-5334-4b3c-aba0-0da8741efdd8 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:29.450878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23db8bd-5334-4b3c-aba0-0da8741efdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:29.472730 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-d23db8bd-5334-4b3c-aba0-0da8741efdd8 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:29.474100 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-d23db8bd-5334-4b3c-aba0-0da8741efdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:29.484867 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 864/1722] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:29.487862 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11582f4b-3442-4bb2-9728-4c051d57dabd None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:29.499731 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11582f4b-3442-4bb2-9728-4c051d57dabd None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:29.506322 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04471d-82c7-491c-af27-6b91f64daa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:29.507534 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04471d-82c7-491c-af27-6b91f64daa4e admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:29.508044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04471d-82c7-491c-af27-6b91f64daa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:29.508563 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04471d-82c7-491c-af27-6b91f64daa4e admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:29.509796 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04471d-82c7-491c-af27-6b91f64daa4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:29.510167 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04471d-82c7-491c-af27-6b91f64daa4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:29.512204 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04471d-82c7-491c-af27-6b91f64daa4e admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:29.532016 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 859/1723] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:29.533934 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23db8bd-5334-4b3c-aba0-0da8741efdd8 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:29.545563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23db8bd-5334-4b3c-aba0-0da8741efdd8 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:29.551337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133e8c5-eacc-4e1c-95e3-2e06cc5d6f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:29.552422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133e8c5-eacc-4e1c-95e3-2e06cc5d6f18 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:29.553528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133e8c5-eacc-4e1c-95e3-2e06cc5d6f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:29.554051 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133e8c5-eacc-4e1c-95e3-2e06cc5d6f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:29.554776 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133e8c5-eacc-4e1c-95e3-2e06cc5d6f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:29.557136 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133e8c5-eacc-4e1c-95e3-2e06cc5d6f18 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:29.658099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04471d-82c7-491c-af27-6b91f64daa4e admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:29.667572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 865/1724] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:29 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:29.677213 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc42bf-e122-4d7c-b57b-1cd8bbe1cbbf None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:29.679243 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04471d-82c7-491c-af27-6b91f64daa4e admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:29.680505 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc42bf-e122-4d7c-b57b-1cd8bbe1cbbf None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:29.681566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc42bf-e122-4d7c-b57b-1cd8bbe1cbbf None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:29.685635 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 866/1725] 10.222.0.71 () {54 vars in 921 bytes} [Mon May 16 20:25:29 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:25:29.745673 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ebba1-518c-42e2-a2c3-6ab65fb9fa17 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:29.746369 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ebba1-518c-42e2-a2c3-6ab65fb9fa17 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:29.747490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ebba1-518c-42e2-a2c3-6ab65fb9fa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:29.816239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-605ebba1-518c-42e2-a2c3-6ab65fb9fa17 None None] MFA Rules not processed for user `242d4f9634a74013af05f50981280864`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:29.823949 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-605ebba1-518c-42e2-a2c3-6ab65fb9fa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:29.904265 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78693ba2-966a-42ea-969a-40e4c42b9068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:29.905689 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78693ba2-966a-42ea-969a-40e4c42b9068 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:29.909463 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78693ba2-966a-42ea-969a-40e4c42b9068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:29.909742 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78693ba2-966a-42ea-969a-40e4c42b9068 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:29.910843 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78693ba2-966a-42ea-969a-40e4c42b9068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:29.913954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78693ba2-966a-42ea-969a-40e4c42b9068 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:29.979403 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 860/1726] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:29 2022] POST /identity/v3/users => generated 283 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:29.993452 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78693ba2-966a-42ea-969a-40e4c42b9068 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:30.003005 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 867/1727] 10.222.0.71 () {58 vars in 1018 bytes} [Mon May 16 20:25:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:25:30.004328 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78693ba2-966a-42ea-969a-40e4c42b9068 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:30.029441 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42b923-a94d-484b-b7c7-54cf1097afa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:30.030167 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42b923-a94d-484b-b7c7-54cf1097afa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:30.030452 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42b923-a94d-484b-b7c7-54cf1097afa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:30.030735 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42b923-a94d-484b-b7c7-54cf1097afa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:30.031519 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42b923-a94d-484b-b7c7-54cf1097afa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:30.035464 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42b923-a94d-484b-b7c7-54cf1097afa5 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:30.065623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 861/1728] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:30.068825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ebba1-518c-42e2-a2c3-6ab65fb9fa17 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:30.086650 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ebba1-518c-42e2-a2c3-6ab65fb9fa17 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:30.150412 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1206b-3735-4950-91ea-1cb2ea092d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:30.159361 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1206b-3735-4950-91ea-1cb2ea092d37 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:30.162149 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1206b-3735-4950-91ea-1cb2ea092d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:30.164006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1206b-3735-4950-91ea-1cb2ea092d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:30.166786 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1206b-3735-4950-91ea-1cb2ea092d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:30.186961 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1206b-3735-4950-91ea-1cb2ea092d37 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:30.197307 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cb20c-a51e-4076-9ec4-f56526735f4d None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:30.197929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cb20c-a51e-4076-9ec4-f56526735f4d None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:30.198351 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cb20c-a51e-4076-9ec4-f56526735f4d None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:30.200272 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 862/1729] 10.222.0.71 () {54 vars in 912 bytes} [Mon May 16 20:25:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:25:30.226020 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6600b-cfcf-4810-955b-d9575bebe567 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:30.226542 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6600b-cfcf-4810-955b-d9575bebe567 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:30.226962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6600b-cfcf-4810-955b-d9575bebe567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:30.276645 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-fba6600b-cfcf-4810-955b-d9575bebe567 None None] MFA Rules not processed for user `eedc173e2cdc48b489ac40f3d9dccb7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:30.277889 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-fba6600b-cfcf-4810-955b-d9575bebe567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:30.292090 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 868/1730] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:25:30.309074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1206b-3735-4950-91ea-1cb2ea092d37 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:30.357300 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1206b-3735-4950-91ea-1cb2ea092d37 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:30.394285 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a9523-f671-43a3-939f-04e493edad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:30.395516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a9523-f671-43a3-939f-04e493edad49 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:30.399289 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a9523-f671-43a3-939f-04e493edad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:30.400009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a9523-f671-43a3-939f-04e493edad49 admin admin] PATH_INFO: `/v3/projects/1c0c4b33b11745fe881fd1b4ecee55ef/users/f732ae2a35bf46e8a3fd338c65f4d9c4/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:30.465121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a9523-f671-43a3-939f-04e493edad49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c0c4b33b11745fe881fd1b4ecee55ef, user_id=f732ae2a35bf46e8a3fd338c65f4d9c4, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:30.481923 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a9523-f671-43a3-939f-04e493edad49 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:30.512952 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 863/1731] 10.222.0.71 () {58 vars in 1009 bytes} [Mon May 16 20:25:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:25:30.546502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 869/1732] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:30 2022] PUT /identity/v3/projects/1c0c4b33b11745fe881fd1b4ecee55ef/users/f732ae2a35bf46e8a3fd338c65f4d9c4/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:30.547696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d985d6-911a-4cc2-8ac9-772281dacfb8 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:30.547990 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d985d6-911a-4cc2-8ac9-772281dacfb8 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:30.548289 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d985d6-911a-4cc2-8ac9-772281dacfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:30.622797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a9523-f671-43a3-939f-04e493edad49 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:30.624943 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-1e2a9523-f671-43a3-939f-04e493edad49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:30.661171 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-c5d985d6-911a-4cc2-8ac9-772281dacfb8 None None] MFA Rules not processed for user `f732ae2a35bf46e8a3fd338c65f4d9c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:30.665563 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c5d985d6-911a-4cc2-8ac9-772281dacfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:30.897301 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a9523-f671-43a3-939f-04e493edad49 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:30.919194 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f0eff-496d-4fd3-9ded-222c72ef64f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:30.921792 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f0eff-496d-4fd3-9ded-222c72ef64f0 service nova] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:30.922583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f0eff-496d-4fd3-9ded-222c72ef64f0 service nova] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:30.923704 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f0eff-496d-4fd3-9ded-222c72ef64f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:30.960456 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f0eff-496d-4fd3-9ded-222c72ef64f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:30.966993 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 864/1733] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:30.968674 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d985d6-911a-4cc2-8ac9-772281dacfb8 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:30.970349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c5d985d6-911a-4cc2-8ac9-772281dacfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:30.978252 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f0eff-496d-4fd3-9ded-222c72ef64f0 service nova] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:31.012006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 870/1734] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:25:31.012978 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f0eff-496d-4fd3-9ded-222c72ef64f0 service nova] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:31.153251 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f0eff-496d-4fd3-9ded-222c72ef64f0 service nova] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:31.168303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49793f2d-bc21-4474-b715-df037a3efbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:31.171089 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49793f2d-bc21-4474-b715-df037a3efbe7 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:31.172665 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49793f2d-bc21-4474-b715-df037a3efbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:31.174783 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49793f2d-bc21-4474-b715-df037a3efbe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:31.179317 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d985d6-911a-4cc2-8ac9-772281dacfb8 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:31.180016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49793f2d-bc21-4474-b715-df037a3efbe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:31.183024 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49793f2d-bc21-4474-b715-df037a3efbe7 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:31.195245 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa6cd2-de92-4b57-a64a-90e6103b5806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:31.199615 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa6cd2-de92-4b57-a64a-90e6103b5806 service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:31.204708 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa6cd2-de92-4b57-a64a-90e6103b5806 service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:31.206798 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa6cd2-de92-4b57-a64a-90e6103b5806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:31.230915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa6cd2-de92-4b57-a64a-90e6103b5806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:31.232937 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa6cd2-de92-4b57-a64a-90e6103b5806 service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:31.253740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 871/1735] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:31 2022] POST /identity/v3/projects => generated 365 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:31.258873 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49793f2d-bc21-4474-b715-df037a3efbe7 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:31.260121 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 865/1736] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:31.432276 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49793f2d-bc21-4474-b715-df037a3efbe7 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:31.447004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295b510-fe8f-4b58-bce1-493a3cf39d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:31.449174 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295b510-fe8f-4b58-bce1-493a3cf39d25 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:31.449527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295b510-fe8f-4b58-bce1-493a3cf39d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:31.449813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295b510-fe8f-4b58-bce1-493a3cf39d25 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:31.451128 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295b510-fe8f-4b58-bce1-493a3cf39d25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:31.454828 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295b510-fe8f-4b58-bce1-493a3cf39d25 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:31.495211 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 872/1737] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:31 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:25:31.497424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa6cd2-de92-4b57-a64a-90e6103b5806 service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:31.514537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa6cd2-de92-4b57-a64a-90e6103b5806 service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:31.520806 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43bef2-5c8e-455d-a185-ad1684e8671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:31.522154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43bef2-5c8e-455d-a185-ad1684e8671a admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:31.522442 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43bef2-5c8e-455d-a185-ad1684e8671a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:31.523193 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43bef2-5c8e-455d-a185-ad1684e8671a admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:31.525108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43bef2-5c8e-455d-a185-ad1684e8671a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:31.530663 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43bef2-5c8e-455d-a185-ad1684e8671a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:31.549035 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 866/1738] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:31.550582 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295b510-fe8f-4b58-bce1-493a3cf39d25 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:31.567873 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295b510-fe8f-4b58-bce1-493a3cf39d25 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:31.582265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455e082-3ae3-4bab-b11c-412ebea9c7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:31.585426 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455e082-3ae3-4bab-b11c-412ebea9c7e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:31.585706 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455e082-3ae3-4bab-b11c-412ebea9c7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:31.586348 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455e082-3ae3-4bab-b11c-412ebea9c7e4 admin admin] PATH_INFO: `/v3/projects/2eabfcfcf1b542288d06c526703076fb/users/ad981a5d6c2c4659a6c2fea685253e2d/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:31.615128 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455e082-3ae3-4bab-b11c-412ebea9c7e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eabfcfcf1b542288d06c526703076fb, user_id=ad981a5d6c2c4659a6c2fea685253e2d, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:31.620072 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455e082-3ae3-4bab-b11c-412ebea9c7e4 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:31.654140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 873/1739] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:31 2022] PUT /identity/v3/projects/2eabfcfcf1b542288d06c526703076fb/users/ad981a5d6c2c4659a6c2fea685253e2d/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:25:31.655985 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43bef2-5c8e-455d-a185-ad1684e8671a admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:31.681998 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43bef2-5c8e-455d-a185-ad1684e8671a admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:31.962674 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a928628-0b87-4c90-9e27-099a00918ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:31.963382 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a928628-0b87-4c90-9e27-099a00918ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:31.963665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a928628-0b87-4c90-9e27-099a00918ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:31.963941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a928628-0b87-4c90-9e27-099a00918ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:31.964716 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a928628-0b87-4c90-9e27-099a00918ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:31.966354 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a928628-0b87-4c90-9e27-099a00918ae9 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:31.993488 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 867/1740] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:31.998129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455e082-3ae3-4bab-b11c-412ebea9c7e4 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:32.013660 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455e082-3ae3-4bab-b11c-412ebea9c7e4 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:32.022099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a928628-0b87-4c90-9e27-099a00918ae9 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:32.024850 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-1a928628-0b87-4c90-9e27-099a00918ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:32.031561 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2b0cf-4739-4d6a-93e7-0919aca3344f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:32.033772 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2b0cf-4739-4d6a-93e7-0919aca3344f admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:32.035422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2b0cf-4739-4d6a-93e7-0919aca3344f admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:32.036317 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2b0cf-4739-4d6a-93e7-0919aca3344f admin admin] PATH_INFO: `/v3/projects/2eabfcfcf1b542288d06c526703076fb/users/ad981a5d6c2c4659a6c2fea685253e2d/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:32.042128 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2b0cf-4739-4d6a-93e7-0919aca3344f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eabfcfcf1b542288d06c526703076fb, user_id=ad981a5d6c2c4659a6c2fea685253e2d, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:32.048764 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a928628-0b87-4c90-9e27-099a00918ae9 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:32.055576 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2b0cf-4739-4d6a-93e7-0919aca3344f admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:32.062189 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48704c-f5c9-4467-8f0a-fe7488808314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:32.063965 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48704c-f5c9-4467-8f0a-fe7488808314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:32.064306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48704c-f5c9-4467-8f0a-fe7488808314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:32.064574 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48704c-f5c9-4467-8f0a-fe7488808314 admin admin] PATH_INFO: `/v3/users/8d8b6349a4d54c0aa538c69ec2220fb6` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:32.066786 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48704c-f5c9-4467-8f0a-fe7488808314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d8b6349a4d54c0aa538c69ec2220fb6)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:32.069461 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48704c-f5c9-4467-8f0a-fe7488808314 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:32.091119 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 874/1741] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:31 2022] PUT /identity/v3/projects/2eabfcfcf1b542288d06c526703076fb/users/ad981a5d6c2c4659a6c2fea685253e2d/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:32.102949 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fb45b-3c7b-4ada-a8b2-c36b35346b96 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:32.103791 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fb45b-3c7b-4ada-a8b2-c36b35346b96 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:32.104371 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fb45b-3c7b-4ada-a8b2-c36b35346b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:32.175044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-7f1fb45b-3c7b-4ada-a8b2-c36b35346b96 None None] MFA Rules not processed for user `ad981a5d6c2c4659a6c2fea685253e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:32.178564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-7f1fb45b-3c7b-4ada-a8b2-c36b35346b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:32.240643 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-5e48704c-f5c9-4467-8f0a-fe7488808314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d8b6349a4d54c0aa538c69ec2220fb6'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:32.242565 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-5e48704c-f5c9-4467-8f0a-fe7488808314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d8b6349a4d54c0aa538c69ec2220fb6'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:32.274576 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-5e48704c-f5c9-4467-8f0a-fe7488808314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d8b6349a4d54c0aa538c69ec2220fb6'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:32.300420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-5e48704c-f5c9-4467-8f0a-fe7488808314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d8b6349a4d54c0aa538c69ec2220fb6'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:32.338505 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-5e48704c-f5c9-4467-8f0a-fe7488808314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d8b6349a4d54c0aa538c69ec2220fb6'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:32.362373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 868/1742] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:25:32 2022] DELETE /identity/v3/users/8d8b6349a4d54c0aa538c69ec2220fb6 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:32.368549 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526e350-03ab-4d0a-bd91-0a5bab08a0bc None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:32.368965 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526e350-03ab-4d0a-bd91-0a5bab08a0bc None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:32.369480 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526e350-03ab-4d0a-bd91-0a5bab08a0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:32.429936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-8526e350-03ab-4d0a-bd91-0a5bab08a0bc None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:32.431855 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8526e350-03ab-4d0a-bd91-0a5bab08a0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:32.456674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 875/1743] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:32.496365 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fb45b-3c7b-4ada-a8b2-c36b35346b96 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:32.499460 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-7f1fb45b-3c7b-4ada-a8b2-c36b35346b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:32.681078 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fb45b-3c7b-4ada-a8b2-c36b35346b96 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:32.715350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 869/1744] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:32.801713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5537c-05d5-4109-844f-8478d3d05ab5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:32.803943 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5537c-05d5-4109-844f-8478d3d05ab5 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:32.804456 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5537c-05d5-4109-844f-8478d3d05ab5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:32.804912 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5537c-05d5-4109-844f-8478d3d05ab5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:32.886227 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526e350-03ab-4d0a-bd91-0a5bab08a0bc None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:32.887885 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8526e350-03ab-4d0a-bd91-0a5bab08a0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:33.026992 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5537c-05d5-4109-844f-8478d3d05ab5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:33.028630 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5537c-05d5-4109-844f-8478d3d05ab5 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:33.121465 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 876/1745] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:32 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:25:33.132031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526e350-03ab-4d0a-bd91-0a5bab08a0bc None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:33.156548 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fb53e-ae5b-4522-92c8-12f7fd7ffc6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:33.158957 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fb53e-ae5b-4522-92c8-12f7fd7ffc6e service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:33.162590 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fb53e-ae5b-4522-92c8-12f7fd7ffc6e service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:33.182222 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fb53e-ae5b-4522-92c8-12f7fd7ffc6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:33.247509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95fb53e-ae5b-4522-92c8-12f7fd7ffc6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:33.249361 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95fb53e-ae5b-4522-92c8-12f7fd7ffc6e service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:33.303386 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 870/1746] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:25:34.615837 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e000c-4d05-4ce2-a9dd-3da39fa3bce6 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:34.616692 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e000c-4d05-4ce2-a9dd-3da39fa3bce6 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:34.616692 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e000c-4d05-4ce2-a9dd-3da39fa3bce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:34.662416 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-457e000c-4d05-4ce2-a9dd-3da39fa3bce6 None None] MFA Rules not processed for user `c330fcea8dda449ab5e125b741d49ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:34.671046 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-457e000c-4d05-4ce2-a9dd-3da39fa3bce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:34.802860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fb53e-ae5b-4522-92c8-12f7fd7ffc6e service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:34.805188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-d95fb53e-ae5b-4522-92c8-12f7fd7ffc6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:34.902761 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fb53e-ae5b-4522-92c8-12f7fd7ffc6e service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:34.933555 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 877/1747] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:34.933858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69051f9-bde0-42e1-bfc5-76160cac4245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:34.935488 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69051f9-bde0-42e1-bfc5-76160cac4245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:34.939455 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69051f9-bde0-42e1-bfc5-76160cac4245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:34.940012 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69051f9-bde0-42e1-bfc5-76160cac4245 admin admin] PATH_INFO: `/v3/users/f732ae2a35bf46e8a3fd338c65f4d9c4` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:34.956367 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69051f9-bde0-42e1-bfc5-76160cac4245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f732ae2a35bf46e8a3fd338c65f4d9c4)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:34.967800 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69051f9-bde0-42e1-bfc5-76160cac4245 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:35.171612 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e69051f9-bde0-42e1-bfc5-76160cac4245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f732ae2a35bf46e8a3fd338c65f4d9c4'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:35.172536 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e69051f9-bde0-42e1-bfc5-76160cac4245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f732ae2a35bf46e8a3fd338c65f4d9c4'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:35.185686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e69051f9-bde0-42e1-bfc5-76160cac4245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f732ae2a35bf46e8a3fd338c65f4d9c4'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:35.212787 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e69051f9-bde0-42e1-bfc5-76160cac4245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f732ae2a35bf46e8a3fd338c65f4d9c4'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:35.230323 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e69051f9-bde0-42e1-bfc5-76160cac4245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f732ae2a35bf46e8a3fd338c65f4d9c4'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:35.252114 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891dde4-1445-40e5-96ea-e1b162501303 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:35.253039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891dde4-1445-40e5-96ea-e1b162501303 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:35.253665 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891dde4-1445-40e5-96ea-e1b162501303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:35.262473 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 871/1748] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:25:34 2022] DELETE /identity/v3/users/f732ae2a35bf46e8a3fd338c65f4d9c4 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:35.281724 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-b891dde4-1445-40e5-96ea-e1b162501303 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:35.283951 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-b891dde4-1445-40e5-96ea-e1b162501303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:35.404889 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 878/1749] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:35.443916 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69051f9-bde0-42e1-bfc5-76160cac4245 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:35.446106 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-e69051f9-bde0-42e1-bfc5-76160cac4245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:35.529699 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69051f9-bde0-42e1-bfc5-76160cac4245 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:35.533417 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d6f85-bf4d-4bd8-810c-5a789f0aeb27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:35.534084 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d6f85-bf4d-4bd8-810c-5a789f0aeb27 service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:35.534366 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d6f85-bf4d-4bd8-810c-5a789f0aeb27 service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:35.534641 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d6f85-bf4d-4bd8-810c-5a789f0aeb27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:35.547340 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d6f85-bf4d-4bd8-810c-5a789f0aeb27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:35.548662 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d6f85-bf4d-4bd8-810c-5a789f0aeb27 service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:35.560966 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 872/1750] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:36.080844 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891dde4-1445-40e5-96ea-e1b162501303 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:36.082185 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-b891dde4-1445-40e5-96ea-e1b162501303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:36.111660 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891dde4-1445-40e5-96ea-e1b162501303 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:36.117975 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bda9e1-48e7-4f51-be3e-7fec8607fdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:36.120254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bda9e1-48e7-4f51-be3e-7fec8607fdba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:36.120683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bda9e1-48e7-4f51-be3e-7fec8607fdba admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:36.121582 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bda9e1-48e7-4f51-be3e-7fec8607fdba admin admin] PATH_INFO: `/v3/projects/37408c457c8641b19f6a29509df2f77a` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:36.123111 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bda9e1-48e7-4f51-be3e-7fec8607fdba admin admin] RBAC: Authorizing `identity:delete_project(project_id=37408c457c8641b19f6a29509df2f77a)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:36.125081 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bda9e1-48e7-4f51-be3e-7fec8607fdba admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:36.186094 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-23bda9e1-48e7-4f51-be3e-7fec8607fdba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37408c457c8641b19f6a29509df2f77a', 'request_id': 'req-23bda9e1-48e7-4f51-be3e-7fec8607fdba'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:36.193869 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-23bda9e1-48e7-4f51-be3e-7fec8607fdba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37408c457c8641b19f6a29509df2f77a', 'request_id': 'req-23bda9e1-48e7-4f51-be3e-7fec8607fdba'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:36.203113 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-23bda9e1-48e7-4f51-be3e-7fec8607fdba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37408c457c8641b19f6a29509df2f77a', 'request_id': 'req-23bda9e1-48e7-4f51-be3e-7fec8607fdba'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:36.220470 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-23bda9e1-48e7-4f51-be3e-7fec8607fdba admin admin] The token cache is being invalidate because project 37408c457c8641b19f6a29509df2f77a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:25:36.220893 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-23bda9e1-48e7-4f51-be3e-7fec8607fdba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:36.221748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-23bda9e1-48e7-4f51-be3e-7fec8607fdba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:36.226910 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 879/1751] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:25:36 2022] DELETE /identity/v3/projects/37408c457c8641b19f6a29509df2f77a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:36.227824 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d6f85-bf4d-4bd8-810c-5a789f0aeb27 service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:36.239551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d6f85-bf4d-4bd8-810c-5a789f0aeb27 service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:36.328086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b450b-dcde-4243-81e3-2f5dada8e729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:36.329147 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b450b-dcde-4243-81e3-2f5dada8e729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:36.329545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b450b-dcde-4243-81e3-2f5dada8e729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:36.330061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b450b-dcde-4243-81e3-2f5dada8e729 admin admin] PATH_INFO: `/v3/users/b027cc232e364fdc9272528eddff1b7a` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:36.331851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b450b-dcde-4243-81e3-2f5dada8e729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b027cc232e364fdc9272528eddff1b7a)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:36.335012 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b450b-dcde-4243-81e3-2f5dada8e729 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:36.408572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-459b450b-dcde-4243-81e3-2f5dada8e729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b027cc232e364fdc9272528eddff1b7a'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:36.409333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-459b450b-dcde-4243-81e3-2f5dada8e729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b027cc232e364fdc9272528eddff1b7a'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:36.424669 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-459b450b-dcde-4243-81e3-2f5dada8e729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b027cc232e364fdc9272528eddff1b7a'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:36.441807 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-459b450b-dcde-4243-81e3-2f5dada8e729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b027cc232e364fdc9272528eddff1b7a'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:36.475809 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-459b450b-dcde-4243-81e3-2f5dada8e729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b027cc232e364fdc9272528eddff1b7a'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:36.486805 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 873/1752] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:25:36 2022] DELETE /identity/v3/users/b027cc232e364fdc9272528eddff1b7a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:36.495419 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bda9e1-48e7-4f51-be3e-7fec8607fdba admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:36.497186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-23bda9e1-48e7-4f51-be3e-7fec8607fdba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:36.533499 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bda9e1-48e7-4f51-be3e-7fec8607fdba admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:36.570218 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7edaac-d28b-4310-8783-9eb4f53ccb23 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:36.570657 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7edaac-d28b-4310-8783-9eb4f53ccb23 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:36.571082 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7edaac-d28b-4310-8783-9eb4f53ccb23 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:36.573387 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 874/1753] 10.222.0.71 () {54 vars in 921 bytes} [Mon May 16 20:25:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:25:36.582088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81719811-dec3-4572-b847-83338b586b6c None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:36.582381 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81719811-dec3-4572-b847-83338b586b6c None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:36.582664 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81719811-dec3-4572-b847-83338b586b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:36.626187 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-81719811-dec3-4572-b847-83338b586b6c None None] MFA Rules not processed for user `242d4f9634a74013af05f50981280864`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:36.627423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-81719811-dec3-4572-b847-83338b586b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:36.728671 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f2aee-b793-4008-b53c-39036852ada4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:36.739304 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f2aee-b793-4008-b53c-39036852ada4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:36.739622 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f2aee-b793-4008-b53c-39036852ada4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:36.740813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f2aee-b793-4008-b53c-39036852ada4 admin admin] PATH_INFO: `/v3/projects/1c0c4b33b11745fe881fd1b4ecee55ef` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:36.747627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f2aee-b793-4008-b53c-39036852ada4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c0c4b33b11745fe881fd1b4ecee55ef)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:36.750467 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f2aee-b793-4008-b53c-39036852ada4 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:36.854337 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 875/1754] 10.222.0.71 () {58 vars in 1018 bytes} [Mon May 16 20:25:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:25:36.960838 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-6d6f2aee-b793-4008-b53c-39036852ada4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c0c4b33b11745fe881fd1b4ecee55ef', 'request_id': 'req-6d6f2aee-b793-4008-b53c-39036852ada4'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:36.979932 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-6d6f2aee-b793-4008-b53c-39036852ada4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c0c4b33b11745fe881fd1b4ecee55ef', 'request_id': 'req-6d6f2aee-b793-4008-b53c-39036852ada4'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:37.013229 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-6d6f2aee-b793-4008-b53c-39036852ada4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c0c4b33b11745fe881fd1b4ecee55ef', 'request_id': 'req-6d6f2aee-b793-4008-b53c-39036852ada4'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:37.060073 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-6d6f2aee-b793-4008-b53c-39036852ada4 admin admin] The token cache is being invalidate because project 1c0c4b33b11745fe881fd1b4ecee55ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:25:37.060548 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-6d6f2aee-b793-4008-b53c-39036852ada4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:37.061698 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-6d6f2aee-b793-4008-b53c-39036852ada4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:37.070093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 880/1755] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:25:36 2022] DELETE /identity/v3/projects/1c0c4b33b11745fe881fd1b4ecee55ef => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:37.077433 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81719811-dec3-4572-b847-83338b586b6c None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:37.079624 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-81719811-dec3-4572-b847-83338b586b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:37.105077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81719811-dec3-4572-b847-83338b586b6c None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:37.230576 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f2aee-b793-4008-b53c-39036852ada4 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:37.232988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-6d6f2aee-b793-4008-b53c-39036852ada4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:37.288894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e763ccd-4e86-426a-8144-1c7b31d186e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:37.291161 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e763ccd-4e86-426a-8144-1c7b31d186e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:37.291538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e763ccd-4e86-426a-8144-1c7b31d186e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:37.292862 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e763ccd-4e86-426a-8144-1c7b31d186e6 admin admin] PATH_INFO: `/v3/users/ad981a5d6c2c4659a6c2fea685253e2d` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:37.294829 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e763ccd-4e86-426a-8144-1c7b31d186e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad981a5d6c2c4659a6c2fea685253e2d)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:37.300391 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e763ccd-4e86-426a-8144-1c7b31d186e6 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:37.345612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f2aee-b793-4008-b53c-39036852ada4 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:37.355208 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f0e19-25d4-4726-8ffc-ca522c905625 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:37.355983 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f0e19-25d4-4726-8ffc-ca522c905625 service nova] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:37.356331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f0e19-25d4-4726-8ffc-ca522c905625 service nova] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:37.356614 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f0e19-25d4-4726-8ffc-ca522c905625 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:37.359354 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-4c3f0e19-25d4-4726-8ffc-ca522c905625 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:37.375368 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f0e19-25d4-4726-8ffc-ca522c905625 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:37.377363 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f0e19-25d4-4726-8ffc-ca522c905625 service nova] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:37.377554 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-0e763ccd-4e86-426a-8144-1c7b31d186e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad981a5d6c2c4659a6c2fea685253e2d'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:37.378636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-0e763ccd-4e86-426a-8144-1c7b31d186e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad981a5d6c2c4659a6c2fea685253e2d'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:37.391221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 881/1756] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:25:37.399088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-0e763ccd-4e86-426a-8144-1c7b31d186e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad981a5d6c2c4659a6c2fea685253e2d'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:37.413343 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-0e763ccd-4e86-426a-8144-1c7b31d186e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad981a5d6c2c4659a6c2fea685253e2d'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:37.430373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-0e763ccd-4e86-426a-8144-1c7b31d186e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad981a5d6c2c4659a6c2fea685253e2d'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:37.444660 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 876/1757] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:25:37 2022] DELETE /identity/v3/users/ad981a5d6c2c4659a6c2fea685253e2d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:25:37.738008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f0e19-25d4-4726-8ffc-ca522c905625 service nova] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:37.740122 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-4c3f0e19-25d4-4726-8ffc-ca522c905625 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:37.796123 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f0e19-25d4-4726-8ffc-ca522c905625 service nova] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:37.928408 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f98aa-12b6-4398-930b-f12ba5d4960b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:37.930073 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f98aa-12b6-4398-930b-f12ba5d4960b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:37.930590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f98aa-12b6-4398-930b-f12ba5d4960b admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:37.931087 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f98aa-12b6-4398-930b-f12ba5d4960b admin admin] PATH_INFO: `/v3/projects/7f9eaeeff1c64886aeca81425ceb4b13` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:37.932591 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f98aa-12b6-4398-930b-f12ba5d4960b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9eaeeff1c64886aeca81425ceb4b13)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:37.935238 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f98aa-12b6-4398-930b-f12ba5d4960b admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:38.003755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f69f98aa-12b6-4398-930b-f12ba5d4960b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9eaeeff1c64886aeca81425ceb4b13', 'request_id': 'req-f69f98aa-12b6-4398-930b-f12ba5d4960b'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:38.011399 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f69f98aa-12b6-4398-930b-f12ba5d4960b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9eaeeff1c64886aeca81425ceb4b13', 'request_id': 'req-f69f98aa-12b6-4398-930b-f12ba5d4960b'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:38.023111 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f69f98aa-12b6-4398-930b-f12ba5d4960b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9eaeeff1c64886aeca81425ceb4b13', 'request_id': 'req-f69f98aa-12b6-4398-930b-f12ba5d4960b'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:38.037956 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f69f98aa-12b6-4398-930b-f12ba5d4960b admin admin] The token cache is being invalidate because project 7f9eaeeff1c64886aeca81425ceb4b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:25:38.038473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f69f98aa-12b6-4398-930b-f12ba5d4960b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:38.039293 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f69f98aa-12b6-4398-930b-f12ba5d4960b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:38.041246 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 882/1758] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:25:37 2022] DELETE /identity/v3/projects/7f9eaeeff1c64886aeca81425ceb4b13 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:38.046320 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65782a-1134-41d4-a626-1163fa1d3549 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:38.046666 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65782a-1134-41d4-a626-1163fa1d3549 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:38.046949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65782a-1134-41d4-a626-1163fa1d3549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:38.055518 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f98aa-12b6-4398-930b-f12ba5d4960b admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:38.057873 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f69f98aa-12b6-4398-930b-f12ba5d4960b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:38.070339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-8b65782a-1134-41d4-a626-1163fa1d3549 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:38.071555 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8b65782a-1134-41d4-a626-1163fa1d3549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:38.145528 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 877/1759] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:38.155165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f98aa-12b6-4398-930b-f12ba5d4960b admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:38.155968 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7218a-b022-42d4-9871-3f290145e21a None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:38.156403 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7218a-b022-42d4-9871-3f290145e21a None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:38.156793 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7218a-b022-42d4-9871-3f290145e21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:38.160894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395505be-d476-4a23-a64d-d060bfaef509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:38.162405 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395505be-d476-4a23-a64d-d060bfaef509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:38.162973 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395505be-d476-4a23-a64d-d060bfaef509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:38.163292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395505be-d476-4a23-a64d-d060bfaef509 admin admin] PATH_INFO: `/v3/users/4271e8ab9fed42089b4e9d32dc2b9198` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:38.164552 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395505be-d476-4a23-a64d-d060bfaef509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4271e8ab9fed42089b4e9d32dc2b9198)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:38.166476 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395505be-d476-4a23-a64d-d060bfaef509 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:38.187369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-c3c7218a-b022-42d4-9871-3f290145e21a None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:38.188575 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c3c7218a-b022-42d4-9871-3f290145e21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:38.198219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 878/1760] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:38.202169 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7218a-b022-42d4-9871-3f290145e21a None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:38.228789 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7218a-b022-42d4-9871-3f290145e21a None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:38.246326 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994554d8-e62f-4732-a980-98373ac7c05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:38.247399 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994554d8-e62f-4732-a980-98373ac7c05c admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:38.247833 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994554d8-e62f-4732-a980-98373ac7c05c admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:38.248456 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994554d8-e62f-4732-a980-98373ac7c05c admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:38.249391 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994554d8-e62f-4732-a980-98373ac7c05c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:38.249845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994554d8-e62f-4732-a980-98373ac7c05c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:38.252499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994554d8-e62f-4732-a980-98373ac7c05c admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:38.271220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 879/1761] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:38.275905 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-395505be-d476-4a23-a64d-d060bfaef509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4271e8ab9fed42089b4e9d32dc2b9198'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:38.278197 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994554d8-e62f-4732-a980-98373ac7c05c admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:38.293147 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-395505be-d476-4a23-a64d-d060bfaef509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4271e8ab9fed42089b4e9d32dc2b9198'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:38.299620 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994554d8-e62f-4732-a980-98373ac7c05c admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:38.307317 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f643f-5e76-452b-91cf-3397b7d1edac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:38.308863 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f643f-5e76-452b-91cf-3397b7d1edac admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:38.309296 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f643f-5e76-452b-91cf-3397b7d1edac admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:38.309910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f643f-5e76-452b-91cf-3397b7d1edac admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:38.310830 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f643f-5e76-452b-91cf-3397b7d1edac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:38.311837 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-395505be-d476-4a23-a64d-d060bfaef509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4271e8ab9fed42089b4e9d32dc2b9198'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:38.312758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-395505be-d476-4a23-a64d-d060bfaef509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4271e8ab9fed42089b4e9d32dc2b9198'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:38.313676 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f643f-5e76-452b-91cf-3397b7d1edac admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:38.330337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-395505be-d476-4a23-a64d-d060bfaef509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4271e8ab9fed42089b4e9d32dc2b9198'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:38.343637 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 883/1762] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:25:38 2022] DELETE /identity/v3/users/4271e8ab9fed42089b4e9d32dc2b9198 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:38.345214 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395505be-d476-4a23-a64d-d060bfaef509 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:38.350853 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-395505be-d476-4a23-a64d-d060bfaef509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:38.384115 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 880/1763] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:38 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:38.386704 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989f99a-6fca-42de-9d9e-7de5baef7fda None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:38.387274 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989f99a-6fca-42de-9d9e-7de5baef7fda None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:38.387274 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989f99a-6fca-42de-9d9e-7de5baef7fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:38.414701 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-b989f99a-6fca-42de-9d9e-7de5baef7fda None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:38.416246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-b989f99a-6fca-42de-9d9e-7de5baef7fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:38.465990 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395505be-d476-4a23-a64d-d060bfaef509 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:38.547043 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 881/1764] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:38.547043 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989f99a-6fca-42de-9d9e-7de5baef7fda None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:38.557383 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578285b-ca39-49ef-9229-fb6afd33cd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:38.558920 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578285b-ca39-49ef-9229-fb6afd33cd09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:38.559172 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578285b-ca39-49ef-9229-fb6afd33cd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:38.559453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578285b-ca39-49ef-9229-fb6afd33cd09 admin admin] PATH_INFO: `/v3/projects/2eabfcfcf1b542288d06c526703076fb` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:38.561312 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578285b-ca39-49ef-9229-fb6afd33cd09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eabfcfcf1b542288d06c526703076fb)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:38.563914 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578285b-ca39-49ef-9229-fb6afd33cd09 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:38.564069 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-b989f99a-6fca-42de-9d9e-7de5baef7fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:38.603755 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989f99a-6fca-42de-9d9e-7de5baef7fda None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:38.620320 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef4d29-11b4-42a6-8cd4-fd53ef7d4faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:38.623951 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4d29-11b4-42a6-8cd4-fd53ef7d4faa admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:38.624484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4d29-11b4-42a6-8cd4-fd53ef7d4faa admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:38.626447 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4d29-11b4-42a6-8cd4-fd53ef7d4faa admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:38.627821 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef4d29-11b4-42a6-8cd4-fd53ef7d4faa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:38.633723 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef4d29-11b4-42a6-8cd4-fd53ef7d4faa admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:38.694400 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 882/1765] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:38 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:38.695573 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef4d29-11b4-42a6-8cd4-fd53ef7d4faa admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:38.702201 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-e4ef4d29-11b4-42a6-8cd4-fd53ef7d4faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:38.740866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0578285b-ca39-49ef-9229-fb6afd33cd09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eabfcfcf1b542288d06c526703076fb', 'request_id': 'req-0578285b-ca39-49ef-9229-fb6afd33cd09'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:38.755314 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0578285b-ca39-49ef-9229-fb6afd33cd09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eabfcfcf1b542288d06c526703076fb', 'request_id': 'req-0578285b-ca39-49ef-9229-fb6afd33cd09'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:38.769640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0578285b-ca39-49ef-9229-fb6afd33cd09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eabfcfcf1b542288d06c526703076fb', 'request_id': 'req-0578285b-ca39-49ef-9229-fb6afd33cd09'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:38.811572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0578285b-ca39-49ef-9229-fb6afd33cd09 admin admin] The token cache is being invalidate because project 2eabfcfcf1b542288d06c526703076fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:25:38.811572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0578285b-ca39-49ef-9229-fb6afd33cd09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:38.812342 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0578285b-ca39-49ef-9229-fb6afd33cd09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:38.814653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 884/1766] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:25:38 2022] DELETE /identity/v3/projects/2eabfcfcf1b542288d06c526703076fb => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:38.815827 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578285b-ca39-49ef-9229-fb6afd33cd09 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:38.817480 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-0578285b-ca39-49ef-9229-fb6afd33cd09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:38.927023 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef4d29-11b4-42a6-8cd4-fd53ef7d4faa admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:38.937208 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578285b-ca39-49ef-9229-fb6afd33cd09 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:38.950462 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d4d72-50fb-4be7-b18b-bc2d41783610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:38.951970 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d4d72-50fb-4be7-b18b-bc2d41783610 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:38.952350 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d4d72-50fb-4be7-b18b-bc2d41783610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:38.952641 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d4d72-50fb-4be7-b18b-bc2d41783610 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:38.953429 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d4d72-50fb-4be7-b18b-bc2d41783610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:38.955081 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d4d72-50fb-4be7-b18b-bc2d41783610 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:38.973535 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 885/1767] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:38.975040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63a9a7-5fd1-47fc-a5a4-f0e5f4153d5e None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:38.975334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63a9a7-5fd1-47fc-a5a4-f0e5f4153d5e None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:38.975609 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63a9a7-5fd1-47fc-a5a4-f0e5f4153d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:39.015887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-ce63a9a7-5fd1-47fc-a5a4-f0e5f4153d5e None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:39.017184 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-ce63a9a7-5fd1-47fc-a5a4-f0e5f4153d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:39.048768 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 886/1768] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:39.049543 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63a9a7-5fd1-47fc-a5a4-f0e5f4153d5e None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:39.071993 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63a9a7-5fd1-47fc-a5a4-f0e5f4153d5e None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:39.086926 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953f935-4ed3-4479-8c2d-6f76e30b7e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:39.087266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953f935-4ed3-4479-8c2d-6f76e30b7e57 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:39.087598 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953f935-4ed3-4479-8c2d-6f76e30b7e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:39.087831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953f935-4ed3-4479-8c2d-6f76e30b7e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:39.089011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953f935-4ed3-4479-8c2d-6f76e30b7e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:39.092677 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953f935-4ed3-4479-8c2d-6f76e30b7e57 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:39.095043 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e813e2-34a2-4df0-86a9-1ea2360831a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:39.095986 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e813e2-34a2-4df0-86a9-1ea2360831a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:39.096442 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e813e2-34a2-4df0-86a9-1ea2360831a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:39.096886 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e813e2-34a2-4df0-86a9-1ea2360831a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:39.106238 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-61e813e2-34a2-4df0-86a9-1ea2360831a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:39.127586 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 887/1769] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:39.127586 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352e68f-11d2-45cd-a1da-957907b6cfa5 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:39.127586 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352e68f-11d2-45cd-a1da-957907b6cfa5 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:39.127586 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352e68f-11d2-45cd-a1da-957907b6cfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:39.171967 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-b352e68f-11d2-45cd-a1da-957907b6cfa5 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:39.173525 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-b352e68f-11d2-45cd-a1da-957907b6cfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:39.177062 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e813e2-34a2-4df0-86a9-1ea2360831a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:39.179377 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e813e2-34a2-4df0-86a9-1ea2360831a7 service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:39.196744 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 888/1770] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:39.197733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352e68f-11d2-45cd-a1da-957907b6cfa5 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:39.217013 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 883/1771] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:39.217925 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e813e2-34a2-4df0-86a9-1ea2360831a7 service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:39.219532 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352e68f-11d2-45cd-a1da-957907b6cfa5 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:39.234283 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f171f0-111e-49b2-b22b-4b5378d3be8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:39.235549 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f171f0-111e-49b2-b22b-4b5378d3be8b admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:39.235640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f171f0-111e-49b2-b22b-4b5378d3be8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:39.236012 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f171f0-111e-49b2-b22b-4b5378d3be8b admin admin] PATH_INFO: `/v3/projects/70e5f751aa784a26babc8a35ae2c194a/users/1cdec0bf6f014f86a61bf4dcfb6d8c2a/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:39.238514 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e813e2-34a2-4df0-86a9-1ea2360831a7 service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:39.249904 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd2c3e-9126-4644-abc2-26e2ad4fca65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:39.250576 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd2c3e-9126-4644-abc2-26e2ad4fca65 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:39.250856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd2c3e-9126-4644-abc2-26e2ad4fca65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:39.251187 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd2c3e-9126-4644-abc2-26e2ad4fca65 admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:39.251930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd2c3e-9126-4644-abc2-26e2ad4fca65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:39.252257 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd2c3e-9126-4644-abc2-26e2ad4fca65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:39.255235 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd2c3e-9126-4644-abc2-26e2ad4fca65 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:39.275253 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 884/1772] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:39.276795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd2c3e-9126-4644-abc2-26e2ad4fca65 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:39.294511 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd2c3e-9126-4644-abc2-26e2ad4fca65 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:39.295987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f171f0-111e-49b2-b22b-4b5378d3be8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=70e5f751aa784a26babc8a35ae2c194a, user_id=1cdec0bf6f014f86a61bf4dcfb6d8c2a, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:39.298806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f171f0-111e-49b2-b22b-4b5378d3be8b admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:39.303967 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82768a-d015-436b-9c62-8be7d21f2ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:39.305376 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82768a-d015-436b-9c62-8be7d21f2ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:39.305815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82768a-d015-436b-9c62-8be7d21f2ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:39.306364 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82768a-d015-436b-9c62-8be7d21f2ac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:39.307462 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82768a-d015-436b-9c62-8be7d21f2ac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:39.310237 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82768a-d015-436b-9c62-8be7d21f2ac9 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:39.341331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 889/1773] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:39 2022] PUT /identity/v3/projects/70e5f751aa784a26babc8a35ae2c194a/users/1cdec0bf6f014f86a61bf4dcfb6d8c2a/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:39.346555 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285364ef-12d2-4084-b929-8c16622def7d None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:39.346912 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285364ef-12d2-4084-b929-8c16622def7d None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:39.347252 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285364ef-12d2-4084-b929-8c16622def7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:39.383357 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 885/1774] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:39 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:39.386160 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82768a-d015-436b-9c62-8be7d21f2ac9 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:39.396836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-285364ef-12d2-4084-b929-8c16622def7d None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:39.399391 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-285364ef-12d2-4084-b929-8c16622def7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:39.500764 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 890/1775] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:39.505235 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82768a-d015-436b-9c62-8be7d21f2ac9 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:39.513360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c6ca9-2135-4c09-81b4-c1137c125263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:39.513769 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c6ca9-2135-4c09-81b4-c1137c125263 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:39.514099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c6ca9-2135-4c09-81b4-c1137c125263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:39.514435 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c6ca9-2135-4c09-81b4-c1137c125263 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:39.515287 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c6ca9-2135-4c09-81b4-c1137c125263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:39.519499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c6ca9-2135-4c09-81b4-c1137c125263 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:39.538836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285364ef-12d2-4084-b929-8c16622def7d None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:39.543986 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-285364ef-12d2-4084-b929-8c16622def7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:39.569525 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 886/1776] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:39 2022] POST /identity/v3/users => generated 282 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:39.572897 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c6ca9-2135-4c09-81b4-c1137c125263 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:39.593070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c6ca9-2135-4c09-81b4-c1137c125263 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:39.617495 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e1ba7-0751-4da7-b2e3-e75eb16e363a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:39.619643 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e1ba7-0751-4da7-b2e3-e75eb16e363a admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:39.622088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e1ba7-0751-4da7-b2e3-e75eb16e363a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:39.624410 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e1ba7-0751-4da7-b2e3-e75eb16e363a admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:39.626329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e1ba7-0751-4da7-b2e3-e75eb16e363a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:39.632777 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e1ba7-0751-4da7-b2e3-e75eb16e363a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:39.669728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 887/1777] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:39.670231 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285364ef-12d2-4084-b929-8c16622def7d None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:39.676357 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e1ba7-0751-4da7-b2e3-e75eb16e363a admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:39.689056 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50703bc-5a9a-47d8-b262-0a3829b1b896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:39.689992 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50703bc-5a9a-47d8-b262-0a3829b1b896 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:39.690411 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50703bc-5a9a-47d8-b262-0a3829b1b896 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:39.690829 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50703bc-5a9a-47d8-b262-0a3829b1b896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:39.693477 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e1ba7-0751-4da7-b2e3-e75eb16e363a admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:39.700923 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaded2e5-347f-4bfa-9712-d7dc54cff39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:39.701620 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaded2e5-347f-4bfa-9712-d7dc54cff39c admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:39.701965 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaded2e5-347f-4bfa-9712-d7dc54cff39c admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:39.702245 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaded2e5-347f-4bfa-9712-d7dc54cff39c admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:39.703032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaded2e5-347f-4bfa-9712-d7dc54cff39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:39.704669 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50703bc-5a9a-47d8-b262-0a3829b1b896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:39.706294 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50703bc-5a9a-47d8-b262-0a3829b1b896 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:39.722947 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaded2e5-347f-4bfa-9712-d7dc54cff39c admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:39.728780 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 891/1778] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:39.758460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 888/1779] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:39.759369 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50703bc-5a9a-47d8-b262-0a3829b1b896 service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:39.776590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50703bc-5a9a-47d8-b262-0a3829b1b896 service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:39.784757 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c41c3-8528-42e8-ad18-312dce068c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:39.786139 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c41c3-8528-42e8-ad18-312dce068c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:39.786601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c41c3-8528-42e8-ad18-312dce068c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:39.787112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c41c3-8528-42e8-ad18-312dce068c50 admin admin] PATH_INFO: `/v3/projects/b80b2933087844ff95114a65fd440340/users/06f6272fb6eb43618ed8efe946b59dff/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:39.813587 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c41c3-8528-42e8-ad18-312dce068c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b80b2933087844ff95114a65fd440340, user_id=06f6272fb6eb43618ed8efe946b59dff, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:39.816983 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c41c3-8528-42e8-ad18-312dce068c50 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:39.865764 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 892/1780] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:39 2022] PUT /identity/v3/projects/b80b2933087844ff95114a65fd440340/users/06f6272fb6eb43618ed8efe946b59dff/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:39.872818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b744d9-3262-4a08-a734-fe11cebf68a7 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:39.873098 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b744d9-3262-4a08-a734-fe11cebf68a7 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:39.874447 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b744d9-3262-4a08-a734-fe11cebf68a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:39.933075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-52b744d9-3262-4a08-a734-fe11cebf68a7 None None] MFA Rules not processed for user `06f6272fb6eb43618ed8efe946b59dff`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:39.935122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-52b744d9-3262-4a08-a734-fe11cebf68a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:40.072646 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 889/1781] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:39 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:40.073824 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c41c3-8528-42e8-ad18-312dce068c50 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:40.186560 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c41c3-8528-42e8-ad18-312dce068c50 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:40.192485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad40d27-4373-42e8-b22e-f361cd3694a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:40.194312 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad40d27-4373-42e8-b22e-f361cd3694a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:40.194752 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad40d27-4373-42e8-b22e-f361cd3694a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:40.195778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad40d27-4373-42e8-b22e-f361cd3694a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:40.196590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad40d27-4373-42e8-b22e-f361cd3694a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:40.199463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad40d27-4373-42e8-b22e-f361cd3694a5 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:40.237963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 893/1782] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:40 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:40.238064 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b744d9-3262-4a08-a734-fe11cebf68a7 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:40.253016 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b744d9-3262-4a08-a734-fe11cebf68a7 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:40.327225 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982456a-98f2-439b-9fe3-e9bb4a332ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:40.327938 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982456a-98f2-439b-9fe3-e9bb4a332ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:40.328257 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982456a-98f2-439b-9fe3-e9bb4a332ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:40.328575 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982456a-98f2-439b-9fe3-e9bb4a332ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:40.329270 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982456a-98f2-439b-9fe3-e9bb4a332ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:40.331351 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982456a-98f2-439b-9fe3-e9bb4a332ef7 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:40.369030 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 890/1783] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:40 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:40.370590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad40d27-4373-42e8-b22e-f361cd3694a5 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:40.385367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad40d27-4373-42e8-b22e-f361cd3694a5 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:40.402119 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae82e1-fec3-49d8-af3c-5cabba762fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:40.402890 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae82e1-fec3-49d8-af3c-5cabba762fcd admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:40.403256 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae82e1-fec3-49d8-af3c-5cabba762fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:40.403785 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae82e1-fec3-49d8-af3c-5cabba762fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:40.404731 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae82e1-fec3-49d8-af3c-5cabba762fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:40.406575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae82e1-fec3-49d8-af3c-5cabba762fcd admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:40.424211 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 894/1784] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:40.426268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982456a-98f2-439b-9fe3-e9bb4a332ef7 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:40.438834 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982456a-98f2-439b-9fe3-e9bb4a332ef7 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:40.445755 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447721a-6936-441b-b446-c20afefdb8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:40.449148 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447721a-6936-441b-b446-c20afefdb8a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:40.449484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447721a-6936-441b-b446-c20afefdb8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:40.449794 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447721a-6936-441b-b446-c20afefdb8a3 admin admin] PATH_INFO: `/v3/projects/39258ac537ef425aa3476d6c76df25bb/users/22c28dfdf7444515b93f04481b845a0a/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:40.470223 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447721a-6936-441b-b446-c20afefdb8a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39258ac537ef425aa3476d6c76df25bb, user_id=22c28dfdf7444515b93f04481b845a0a, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:40.476834 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447721a-6936-441b-b446-c20afefdb8a3 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:40.503489 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 891/1785] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:40 2022] PUT /identity/v3/projects/39258ac537ef425aa3476d6c76df25bb/users/22c28dfdf7444515b93f04481b845a0a/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:40.508322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae82e1-fec3-49d8-af3c-5cabba762fcd admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:40.518979 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae82e1-fec3-49d8-af3c-5cabba762fcd admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:40.590369 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60535305-80f1-47ad-aad3-978a3ed572ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:40.590960 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60535305-80f1-47ad-aad3-978a3ed572ff admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:40.591241 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60535305-80f1-47ad-aad3-978a3ed572ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:40.592431 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60535305-80f1-47ad-aad3-978a3ed572ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:40.593478 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60535305-80f1-47ad-aad3-978a3ed572ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:40.594863 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60535305-80f1-47ad-aad3-978a3ed572ff admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:40.607979 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 895/1786] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:40.612470 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447721a-6936-441b-b446-c20afefdb8a3 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:40.624011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447721a-6936-441b-b446-c20afefdb8a3 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:40.629452 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144adf9-8423-4bfb-9cf0-777321d8e464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:40.630468 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144adf9-8423-4bfb-9cf0-777321d8e464 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:40.631389 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144adf9-8423-4bfb-9cf0-777321d8e464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:40.631684 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144adf9-8423-4bfb-9cf0-777321d8e464 admin admin] PATH_INFO: `/v3/projects/39258ac537ef425aa3476d6c76df25bb/users/22c28dfdf7444515b93f04481b845a0a/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:40.633833 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144adf9-8423-4bfb-9cf0-777321d8e464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39258ac537ef425aa3476d6c76df25bb, user_id=22c28dfdf7444515b93f04481b845a0a, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:40.636602 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144adf9-8423-4bfb-9cf0-777321d8e464 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:40.649003 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 892/1787] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:40 2022] PUT /identity/v3/projects/39258ac537ef425aa3476d6c76df25bb/users/22c28dfdf7444515b93f04481b845a0a/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:40.660593 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f88c3c-51bb-4955-8d28-9ffc47c30903 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:40.660904 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f88c3c-51bb-4955-8d28-9ffc47c30903 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:40.661167 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f88c3c-51bb-4955-8d28-9ffc47c30903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:40.692230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-97f88c3c-51bb-4955-8d28-9ffc47c30903 None None] MFA Rules not processed for user `22c28dfdf7444515b93f04481b845a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:40.694401 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-97f88c3c-51bb-4955-8d28-9ffc47c30903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:40.782957 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 896/1788] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:40 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:40.796800 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144adf9-8423-4bfb-9cf0-777321d8e464 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:40.799535 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-4144adf9-8423-4bfb-9cf0-777321d8e464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:40.868631 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144adf9-8423-4bfb-9cf0-777321d8e464 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:40.872357 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685c218-8bcb-4e76-91d2-a8f7dc69a6c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:40.873017 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685c218-8bcb-4e76-91d2-a8f7dc69a6c2 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:40.873293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685c218-8bcb-4e76-91d2-a8f7dc69a6c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:40.873564 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685c218-8bcb-4e76-91d2-a8f7dc69a6c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:40.885100 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685c218-8bcb-4e76-91d2-a8f7dc69a6c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:40.886683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685c218-8bcb-4e76-91d2-a8f7dc69a6c2 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:40.892883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f88c3c-51bb-4955-8d28-9ffc47c30903 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:40.895160 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-97f88c3c-51bb-4955-8d28-9ffc47c30903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:40.898750 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 893/1789] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:40 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:25:41.029238 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685c218-8bcb-4e76-91d2-a8f7dc69a6c2 service cinder] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:41.040432 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685c218-8bcb-4e76-91d2-a8f7dc69a6c2 service cinder] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:41.046408 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e2ba5-5436-4c66-a276-662928291645 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:41.047628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e2ba5-5436-4c66-a276-662928291645 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:41.048482 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e2ba5-5436-4c66-a276-662928291645 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:41.048905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e2ba5-5436-4c66-a276-662928291645 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:41.067699 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f88c3c-51bb-4955-8d28-9ffc47c30903 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:41.073025 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73402e-36ff-4b0f-8d04-9672355a7983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:41.073907 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73402e-36ff-4b0f-8d04-9672355a7983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:41.074185 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73402e-36ff-4b0f-8d04-9672355a7983 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:41.074461 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73402e-36ff-4b0f-8d04-9672355a7983 admin admin] PATH_INFO: `/v3/projects/5d953e249fb841dd95d2e599393a1d97` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:41.077888 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73402e-36ff-4b0f-8d04-9672355a7983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d953e249fb841dd95d2e599393a1d97)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:41.077888 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73402e-36ff-4b0f-8d04-9672355a7983 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:41.145112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-bd73402e-36ff-4b0f-8d04-9672355a7983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d953e249fb841dd95d2e599393a1d97', 'request_id': 'req-bd73402e-36ff-4b0f-8d04-9672355a7983'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:41.153301 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-bd73402e-36ff-4b0f-8d04-9672355a7983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d953e249fb841dd95d2e599393a1d97', 'request_id': 'req-bd73402e-36ff-4b0f-8d04-9672355a7983'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:41.167914 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-bd73402e-36ff-4b0f-8d04-9672355a7983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d953e249fb841dd95d2e599393a1d97', 'request_id': 'req-bd73402e-36ff-4b0f-8d04-9672355a7983'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:41.174093 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e2ba5-5436-4c66-a276-662928291645 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:41.180834 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e2ba5-5436-4c66-a276-662928291645 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:41.199228 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-bd73402e-36ff-4b0f-8d04-9672355a7983 admin admin] The token cache is being invalidate because project 5d953e249fb841dd95d2e599393a1d97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:25:41.200448 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-bd73402e-36ff-4b0f-8d04-9672355a7983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:41.202577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 894/1790] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:41 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:41.202927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-bd73402e-36ff-4b0f-8d04-9672355a7983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:41.207593 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 897/1791] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:25:40 2022] DELETE /identity/v3/projects/5d953e249fb841dd95d2e599393a1d97 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:25:41.210002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e2ba5-5436-4c66-a276-662928291645 service cinder] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:41.231811 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e2ba5-5436-4c66-a276-662928291645 service cinder] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:41.336386 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21489e99-5f4d-42ea-b759-95127590e270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:41.337423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21489e99-5f4d-42ea-b759-95127590e270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:41.337782 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21489e99-5f4d-42ea-b759-95127590e270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:41.338180 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21489e99-5f4d-42ea-b759-95127590e270 admin admin] PATH_INFO: `/v3/users/694dcca037c64fdcac05e2b46ce3ea70` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:41.339764 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21489e99-5f4d-42ea-b759-95127590e270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=694dcca037c64fdcac05e2b46ce3ea70)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:41.342433 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21489e99-5f4d-42ea-b759-95127590e270 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:41.439591 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-21489e99-5f4d-42ea-b759-95127590e270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '694dcca037c64fdcac05e2b46ce3ea70'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:41.444490 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-21489e99-5f4d-42ea-b759-95127590e270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '694dcca037c64fdcac05e2b46ce3ea70'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:41.461650 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-21489e99-5f4d-42ea-b759-95127590e270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '694dcca037c64fdcac05e2b46ce3ea70'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:41.477945 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-21489e99-5f4d-42ea-b759-95127590e270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '694dcca037c64fdcac05e2b46ce3ea70'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:41.500724 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-21489e99-5f4d-42ea-b759-95127590e270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '694dcca037c64fdcac05e2b46ce3ea70'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:41.515304 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 895/1792] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:25:41 2022] DELETE /identity/v3/users/694dcca037c64fdcac05e2b46ce3ea70 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:41.595417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73402e-36ff-4b0f-8d04-9672355a7983 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:41.598086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-bd73402e-36ff-4b0f-8d04-9672355a7983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:41.620825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73402e-36ff-4b0f-8d04-9672355a7983 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:41.709982 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1674d-f543-42fd-afb6-740311d9d242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:41.711496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1674d-f543-42fd-afb6-740311d9d242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:41.711820 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1674d-f543-42fd-afb6-740311d9d242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:41.712133 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1674d-f543-42fd-afb6-740311d9d242 admin admin] PATH_INFO: `/v3/users/fe38c43a249c4a188945360b7b525e29` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:41.714300 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1674d-f543-42fd-afb6-740311d9d242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe38c43a249c4a188945360b7b525e29)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:41.717005 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1674d-f543-42fd-afb6-740311d9d242 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:41.785216 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-3aa1674d-f543-42fd-afb6-740311d9d242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe38c43a249c4a188945360b7b525e29'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:41.802132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-3aa1674d-f543-42fd-afb6-740311d9d242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe38c43a249c4a188945360b7b525e29'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:41.814029 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-3aa1674d-f543-42fd-afb6-740311d9d242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe38c43a249c4a188945360b7b525e29'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:41.814814 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-3aa1674d-f543-42fd-afb6-740311d9d242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe38c43a249c4a188945360b7b525e29'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:41.828994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-3aa1674d-f543-42fd-afb6-740311d9d242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe38c43a249c4a188945360b7b525e29'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:41.838571 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 898/1793] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:25:41 2022] DELETE /identity/v3/users/fe38c43a249c4a188945360b7b525e29 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:41.843889 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50da33d-6d88-49d5-9772-0b3e4a8be22e None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:41.844230 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50da33d-6d88-49d5-9772-0b3e4a8be22e None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:41.844517 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50da33d-6d88-49d5-9772-0b3e4a8be22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:41.884491 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-c50da33d-6d88-49d5-9772-0b3e4a8be22e None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:41.885760 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c50da33d-6d88-49d5-9772-0b3e4a8be22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:41.978447 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 896/1794] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:42.019264 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1674d-f543-42fd-afb6-740311d9d242 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:42.020735 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-3aa1674d-f543-42fd-afb6-740311d9d242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:42.063699 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57693bb-45f2-41a4-abee-5c37ed164809 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:42.063990 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57693bb-45f2-41a4-abee-5c37ed164809 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:42.064461 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57693bb-45f2-41a4-abee-5c37ed164809 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:42.066397 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 897/1795] 10.222.0.71 () {54 vars in 921 bytes} [Mon May 16 20:25:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:25:42.088905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d765f-840a-492a-aeaf-69ae02ceda03 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:42.089138 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d765f-840a-492a-aeaf-69ae02ceda03 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:42.089393 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d765f-840a-492a-aeaf-69ae02ceda03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:42.129269 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-c73d765f-840a-492a-aeaf-69ae02ceda03 None None] MFA Rules not processed for user `242d4f9634a74013af05f50981280864`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:42.135941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c73d765f-840a-492a-aeaf-69ae02ceda03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:42.140443 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1674d-f543-42fd-afb6-740311d9d242 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:42.152202 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6adff-aa92-42a3-b5b2-abe7040a93cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:42.154528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6adff-aa92-42a3-b5b2-abe7040a93cf service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:42.155234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6adff-aa92-42a3-b5b2-abe7040a93cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:42.155429 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6adff-aa92-42a3-b5b2-abe7040a93cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:42.167236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6adff-aa92-42a3-b5b2-abe7040a93cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:42.169026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6adff-aa92-42a3-b5b2-abe7040a93cf service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:42.184068 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 899/1796] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:42.281278 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 898/1797] 10.222.0.71 () {58 vars in 1018 bytes} [Mon May 16 20:25:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:42.301709 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6adff-aa92-42a3-b5b2-abe7040a93cf service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:42.304009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-36a6adff-aa92-42a3-b5b2-abe7040a93cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:42.331448 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6adff-aa92-42a3-b5b2-abe7040a93cf service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:42.345928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dccb92-e765-4e90-a44e-061ef5f83cbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:42.346694 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dccb92-e765-4e90-a44e-061ef5f83cbc service nova] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:42.346980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dccb92-e765-4e90-a44e-061ef5f83cbc service nova] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:42.347259 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dccb92-e765-4e90-a44e-061ef5f83cbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:42.369585 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dccb92-e765-4e90-a44e-061ef5f83cbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:42.371457 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dccb92-e765-4e90-a44e-061ef5f83cbc service nova] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:42.395697 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 900/1798] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:42.398159 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d765f-840a-492a-aeaf-69ae02ceda03 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:42.402633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c73d765f-840a-492a-aeaf-69ae02ceda03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:42.439185 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d765f-840a-492a-aeaf-69ae02ceda03 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:42.458797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c41ed0-28e5-4295-9b80-5c14c91ef509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:42.460126 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c41ed0-28e5-4295-9b80-5c14c91ef509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:42.460524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c41ed0-28e5-4295-9b80-5c14c91ef509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:42.460899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c41ed0-28e5-4295-9b80-5c14c91ef509 admin admin] PATH_INFO: `/v3/projects/e460e7173d4e4d58b1e9fa28d08085f2` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:42.469874 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c41ed0-28e5-4295-9b80-5c14c91ef509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e460e7173d4e4d58b1e9fa28d08085f2)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:42.472020 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c41ed0-28e5-4295-9b80-5c14c91ef509 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:42.564132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-77c41ed0-28e5-4295-9b80-5c14c91ef509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e460e7173d4e4d58b1e9fa28d08085f2', 'request_id': 'req-77c41ed0-28e5-4295-9b80-5c14c91ef509'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:42.575862 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-77c41ed0-28e5-4295-9b80-5c14c91ef509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e460e7173d4e4d58b1e9fa28d08085f2', 'request_id': 'req-77c41ed0-28e5-4295-9b80-5c14c91ef509'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:42.596666 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-77c41ed0-28e5-4295-9b80-5c14c91ef509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e460e7173d4e4d58b1e9fa28d08085f2', 'request_id': 'req-77c41ed0-28e5-4295-9b80-5c14c91ef509'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:42.612999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-77c41ed0-28e5-4295-9b80-5c14c91ef509 admin admin] The token cache is being invalidate because project e460e7173d4e4d58b1e9fa28d08085f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:25:42.613404 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-77c41ed0-28e5-4295-9b80-5c14c91ef509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:42.614261 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-77c41ed0-28e5-4295-9b80-5c14c91ef509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:42.617224 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 899/1799] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:25:42 2022] DELETE /identity/v3/projects/e460e7173d4e4d58b1e9fa28d08085f2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:42.622746 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ea66a-9573-468c-82a0-bf7db6ac6bce None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:42.623666 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ea66a-9573-468c-82a0-bf7db6ac6bce None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:42.623951 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ea66a-9573-468c-82a0-bf7db6ac6bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:42.666644 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-db7ea66a-9573-468c-82a0-bf7db6ac6bce None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:42.666644 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-db7ea66a-9573-468c-82a0-bf7db6ac6bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:42.781400 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 901/1800] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:42.790966 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98532e-4857-4349-96d3-2377122a28df None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:42.791387 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98532e-4857-4349-96d3-2377122a28df None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:42.791767 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98532e-4857-4349-96d3-2377122a28df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:42.822404 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-7b98532e-4857-4349-96d3-2377122a28df None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:42.824061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-7b98532e-4857-4349-96d3-2377122a28df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:42.837878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 900/1801] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:25:42.841725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ea66a-9573-468c-82a0-bf7db6ac6bce None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:42.856420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ea66a-9573-468c-82a0-bf7db6ac6bce None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:42.866648 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9d2a1-8c23-4b76-954e-75689b2aa9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:42.867411 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9d2a1-8c23-4b76-954e-75689b2aa9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:42.867696 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9d2a1-8c23-4b76-954e-75689b2aa9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:42.867991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9d2a1-8c23-4b76-954e-75689b2aa9e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:42.868737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9d2a1-8c23-4b76-954e-75689b2aa9e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:42.869175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9d2a1-8c23-4b76-954e-75689b2aa9e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:42.870748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9d2a1-8c23-4b76-954e-75689b2aa9e2 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:42.888208 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 902/1802] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:42.889931 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98532e-4857-4349-96d3-2377122a28df None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:42.904192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98532e-4857-4349-96d3-2377122a28df None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:42.911049 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e8eaa-2d30-4611-8bfa-5c11d98ea772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:42.913393 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e8eaa-2d30-4611-8bfa-5c11d98ea772 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:42.916519 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e8eaa-2d30-4611-8bfa-5c11d98ea772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:42.917021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e8eaa-2d30-4611-8bfa-5c11d98ea772 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:42.918202 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e8eaa-2d30-4611-8bfa-5c11d98ea772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:42.920939 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e8eaa-2d30-4611-8bfa-5c11d98ea772 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:42.955187 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 901/1803] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:42 2022] POST /identity/v3/projects => generated 367 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:42.959715 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9d2a1-8c23-4b76-954e-75689b2aa9e2 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:42.971241 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9d2a1-8c23-4b76-954e-75689b2aa9e2 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:43.085688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7afe70-bc19-4a1d-af0d-e50e8c84155e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:43.086445 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7afe70-bc19-4a1d-af0d-e50e8c84155e admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:43.086731 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7afe70-bc19-4a1d-af0d-e50e8c84155e admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:43.088452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7afe70-bc19-4a1d-af0d-e50e8c84155e admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:43.090453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7afe70-bc19-4a1d-af0d-e50e8c84155e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:43.097131 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7afe70-bc19-4a1d-af0d-e50e8c84155e admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:43.145261 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 903/1804] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:42 2022] POST /identity/v3/users => generated 284 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:43.149420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e8eaa-2d30-4611-8bfa-5c11d98ea772 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:43.166152 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e8eaa-2d30-4611-8bfa-5c11d98ea772 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:43.175658 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ba4a1-1b7b-4147-ae3c-335998e8ad7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:43.178089 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ba4a1-1b7b-4147-ae3c-335998e8ad7a admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:43.178540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ba4a1-1b7b-4147-ae3c-335998e8ad7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:43.179854 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ba4a1-1b7b-4147-ae3c-335998e8ad7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:43.182280 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ba4a1-1b7b-4147-ae3c-335998e8ad7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:43.186370 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ba4a1-1b7b-4147-ae3c-335998e8ad7a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:43.212411 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 902/1805] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:43.217525 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7afe70-bc19-4a1d-af0d-e50e8c84155e admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:43.230554 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7afe70-bc19-4a1d-af0d-e50e8c84155e admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:43.243741 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496bef1-3aae-4e1d-afd4-d1c1870ee852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:43.245069 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496bef1-3aae-4e1d-afd4-d1c1870ee852 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:43.245069 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496bef1-3aae-4e1d-afd4-d1c1870ee852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:43.252664 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496bef1-3aae-4e1d-afd4-d1c1870ee852 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:43.256511 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496bef1-3aae-4e1d-afd4-d1c1870ee852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:43.258427 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496bef1-3aae-4e1d-afd4-d1c1870ee852 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:43.284063 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 904/1806] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:43.285030 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ba4a1-1b7b-4147-ae3c-335998e8ad7a admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:43.298064 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ba4a1-1b7b-4147-ae3c-335998e8ad7a admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:43.305253 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98cffe-84ec-4b08-9606-59fc8aa35d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:43.306542 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98cffe-84ec-4b08-9606-59fc8aa35d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:43.307075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98cffe-84ec-4b08-9606-59fc8aa35d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:43.307556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98cffe-84ec-4b08-9606-59fc8aa35d41 admin admin] PATH_INFO: `/v3/projects/6220bfb10b12466089c994527f46e9ac/users/7630824180e249299ff0c3c3419c5a00/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:43.329037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98cffe-84ec-4b08-9606-59fc8aa35d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6220bfb10b12466089c994527f46e9ac, user_id=7630824180e249299ff0c3c3419c5a00, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:43.332631 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98cffe-84ec-4b08-9606-59fc8aa35d41 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:43.353338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 903/1807] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:43 2022] PUT /identity/v3/projects/6220bfb10b12466089c994527f46e9ac/users/7630824180e249299ff0c3c3419c5a00/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:43.366991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb8ec9-b5d1-469e-95bc-12a6aff856fe None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:43.367362 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb8ec9-b5d1-469e-95bc-12a6aff856fe None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:43.367757 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb8ec9-b5d1-469e-95bc-12a6aff856fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:43.429426 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-93cb8ec9-b5d1-469e-95bc-12a6aff856fe None None] MFA Rules not processed for user `7630824180e249299ff0c3c3419c5a00`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:43.430825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-93cb8ec9-b5d1-469e-95bc-12a6aff856fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:43.577923 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 905/1808] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:43.578633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98cffe-84ec-4b08-9606-59fc8aa35d41 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:43.592685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127afa8-8496-40a7-a3c8-5101f8aab80a None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:43.593054 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127afa8-8496-40a7-a3c8-5101f8aab80a None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:43.593426 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127afa8-8496-40a7-a3c8-5101f8aab80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:43.652527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-7127afa8-8496-40a7-a3c8-5101f8aab80a None None] MFA Rules not processed for user `1cdec0bf6f014f86a61bf4dcfb6d8c2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:43.654539 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-7127afa8-8496-40a7-a3c8-5101f8aab80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:43.703148 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98cffe-84ec-4b08-9606-59fc8aa35d41 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:43.711465 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c990341-7f50-4695-ae9d-91e8b7d392ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:43.712483 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c990341-7f50-4695-ae9d-91e8b7d392ff admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:43.712821 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c990341-7f50-4695-ae9d-91e8b7d392ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:43.713099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c990341-7f50-4695-ae9d-91e8b7d392ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:43.713940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c990341-7f50-4695-ae9d-91e8b7d392ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:43.717286 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c990341-7f50-4695-ae9d-91e8b7d392ff admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:43.790729 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 906/1809] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:25:43.796814 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127afa8-8496-40a7-a3c8-5101f8aab80a None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:43.812374 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 904/1810] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:43 2022] POST /identity/v3/projects => generated 369 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:43.812374 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c990341-7f50-4695-ae9d-91e8b7d392ff admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:43.812517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-7127afa8-8496-40a7-a3c8-5101f8aab80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:43.812649 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-6c990341-7f50-4695-ae9d-91e8b7d392ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:43.844312 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127afa8-8496-40a7-a3c8-5101f8aab80a None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:44.003646 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c990341-7f50-4695-ae9d-91e8b7d392ff admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:44.017091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfbaaa-7b12-4b6d-9263-0b437a0b9bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:44.017984 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfbaaa-7b12-4b6d-9263-0b437a0b9bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:44.018266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfbaaa-7b12-4b6d-9263-0b437a0b9bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:44.018793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfbaaa-7b12-4b6d-9263-0b437a0b9bf4 admin admin] PATH_INFO: `/v3/projects/a455dad2f0964673966eecade99ee629` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:44.023859 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee06f3d-5238-41fb-bdd4-cdc9dec93256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:44.024575 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee06f3d-5238-41fb-bdd4-cdc9dec93256 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:44.025500 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee06f3d-5238-41fb-bdd4-cdc9dec93256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:44.026864 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfbaaa-7b12-4b6d-9263-0b437a0b9bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a455dad2f0964673966eecade99ee629)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:44.028866 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee06f3d-5238-41fb-bdd4-cdc9dec93256 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:44.030658 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee06f3d-5238-41fb-bdd4-cdc9dec93256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:44.035657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfbaaa-7b12-4b6d-9263-0b437a0b9bf4 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:44.038524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee06f3d-5238-41fb-bdd4-cdc9dec93256 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:44.093732 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 905/1811] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:43 2022] POST /identity/v3/projects => generated 371 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:44.095075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee06f3d-5238-41fb-bdd4-cdc9dec93256 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:44.166477 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-b8cfbaaa-7b12-4b6d-9263-0b437a0b9bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a455dad2f0964673966eecade99ee629', 'request_id': 'req-b8cfbaaa-7b12-4b6d-9263-0b437a0b9bf4'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:44.173700 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-b8cfbaaa-7b12-4b6d-9263-0b437a0b9bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a455dad2f0964673966eecade99ee629', 'request_id': 'req-b8cfbaaa-7b12-4b6d-9263-0b437a0b9bf4'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:44.189243 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-b8cfbaaa-7b12-4b6d-9263-0b437a0b9bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a455dad2f0964673966eecade99ee629', 'request_id': 'req-b8cfbaaa-7b12-4b6d-9263-0b437a0b9bf4'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:44.207942 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-b8cfbaaa-7b12-4b6d-9263-0b437a0b9bf4 admin admin] The token cache is being invalidate because project a455dad2f0964673966eecade99ee629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:25:44.208286 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-b8cfbaaa-7b12-4b6d-9263-0b437a0b9bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:44.225093 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee06f3d-5238-41fb-bdd4-cdc9dec93256 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:44.225233 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-b8cfbaaa-7b12-4b6d-9263-0b437a0b9bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:44.231990 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 907/1812] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:25:43 2022] DELETE /identity/v3/projects/a455dad2f0964673966eecade99ee629 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:44.231990 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfbaaa-7b12-4b6d-9263-0b437a0b9bf4 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:44.239712 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-b8cfbaaa-7b12-4b6d-9263-0b437a0b9bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:44.319748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405107d-2fca-4d24-b483-3a5b1b4cffb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:44.320681 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405107d-2fca-4d24-b483-3a5b1b4cffb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:44.320791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405107d-2fca-4d24-b483-3a5b1b4cffb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:44.321009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405107d-2fca-4d24-b483-3a5b1b4cffb1 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:44.321989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405107d-2fca-4d24-b483-3a5b1b4cffb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:44.324109 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405107d-2fca-4d24-b483-3a5b1b4cffb1 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:44.356212 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 906/1813] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:44 2022] POST /identity/v3/users => generated 291 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:44.357613 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405107d-2fca-4d24-b483-3a5b1b4cffb1 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:44.360261 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-2405107d-2fca-4d24-b483-3a5b1b4cffb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:44.378918 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405107d-2fca-4d24-b483-3a5b1b4cffb1 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:44.385739 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e9dd4-bc25-4dd6-b317-7bbbff9baa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:44.387282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e9dd4-bc25-4dd6-b317-7bbbff9baa56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:44.387733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e9dd4-bc25-4dd6-b317-7bbbff9baa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:44.388017 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e9dd4-bc25-4dd6-b317-7bbbff9baa56 admin admin] PATH_INFO: `/v3/users/ab9ca21de4f7480ab431d18795a3c164` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:44.389414 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e9dd4-bc25-4dd6-b317-7bbbff9baa56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab9ca21de4f7480ab431d18795a3c164)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:44.392119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e9dd4-bc25-4dd6-b317-7bbbff9baa56 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:44.417247 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfbaaa-7b12-4b6d-9263-0b437a0b9bf4 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:44.425053 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798ea58-e1b3-4dc5-a01d-527b6281f285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:44.425744 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798ea58-e1b3-4dc5-a01d-527b6281f285 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:44.426025 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798ea58-e1b3-4dc5-a01d-527b6281f285 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:44.426304 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798ea58-e1b3-4dc5-a01d-527b6281f285 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:44.426997 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798ea58-e1b3-4dc5-a01d-527b6281f285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:44.429715 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798ea58-e1b3-4dc5-a01d-527b6281f285 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:44.470287 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 908/1814] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:44 2022] POST /identity/v3/users => generated 292 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:44.471425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798ea58-e1b3-4dc5-a01d-527b6281f285 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:44.474288 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-7798ea58-e1b3-4dc5-a01d-527b6281f285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:44.475291 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-610e9dd4-bc25-4dd6-b317-7bbbff9baa56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab9ca21de4f7480ab431d18795a3c164'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:44.476528 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-610e9dd4-bc25-4dd6-b317-7bbbff9baa56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab9ca21de4f7480ab431d18795a3c164'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:44.497167 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-610e9dd4-bc25-4dd6-b317-7bbbff9baa56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab9ca21de4f7480ab431d18795a3c164'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:44.511617 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798ea58-e1b3-4dc5-a01d-527b6281f285 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:44.519850 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-610e9dd4-bc25-4dd6-b317-7bbbff9baa56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab9ca21de4f7480ab431d18795a3c164'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:44.530690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf527f-9d89-42fa-ab9b-afadc2d912e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:44.531754 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf527f-9d89-42fa-ab9b-afadc2d912e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:44.532242 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf527f-9d89-42fa-ab9b-afadc2d912e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:44.532951 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf527f-9d89-42fa-ab9b-afadc2d912e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:44.534211 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf527f-9d89-42fa-ab9b-afadc2d912e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:44.535977 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf527f-9d89-42fa-ab9b-afadc2d912e1 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:44.556868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-610e9dd4-bc25-4dd6-b317-7bbbff9baa56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab9ca21de4f7480ab431d18795a3c164'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:44.574775 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 909/1815] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:44.577658 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 907/1816] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:25:44 2022] DELETE /identity/v3/users/ab9ca21de4f7480ab431d18795a3c164 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:44.581645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf527f-9d89-42fa-ab9b-afadc2d912e1 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:44.581803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e9dd4-bc25-4dd6-b317-7bbbff9baa56 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:44.585201 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-2abf527f-9d89-42fa-ab9b-afadc2d912e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:44.585490 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-610e9dd4-bc25-4dd6-b317-7bbbff9baa56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:44.604662 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf527f-9d89-42fa-ab9b-afadc2d912e1 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:44.708112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483da06-2848-46eb-9668-a9b28c42b72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:44.709562 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483da06-2848-46eb-9668-a9b28c42b72f admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:44.709865 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483da06-2848-46eb-9668-a9b28c42b72f admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:44.710151 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483da06-2848-46eb-9668-a9b28c42b72f admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:44.710970 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483da06-2848-46eb-9668-a9b28c42b72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:44.712845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483da06-2848-46eb-9668-a9b28c42b72f admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:44.712992 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e9dd4-bc25-4dd6-b317-7bbbff9baa56 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:44.721443 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9ef70-4178-4a37-b5d2-9f261663b78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:44.723243 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9ef70-4178-4a37-b5d2-9f261663b78a admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:44.723682 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9ef70-4178-4a37-b5d2-9f261663b78a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:44.724798 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9ef70-4178-4a37-b5d2-9f261663b78a admin admin] PATH_INFO: `/v3/projects/817eac755ef44c8781459a50f2f0d4a5/users/1caef660a6984e008f92961fb4a74063/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:44.727870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 910/1817] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:44.728602 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483da06-2848-46eb-9668-a9b28c42b72f admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:44.730508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-d483da06-2848-46eb-9668-a9b28c42b72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:44.746653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483da06-2848-46eb-9668-a9b28c42b72f admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:44.755462 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411ca97-3892-4051-89fd-0518906c05e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:44.756863 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411ca97-3892-4051-89fd-0518906c05e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:44.757154 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411ca97-3892-4051-89fd-0518906c05e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:44.757436 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411ca97-3892-4051-89fd-0518906c05e1 admin admin] PATH_INFO: `/v3/users/06f6272fb6eb43618ed8efe946b59dff` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:44.759459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411ca97-3892-4051-89fd-0518906c05e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06f6272fb6eb43618ed8efe946b59dff)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:44.761103 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9ef70-4178-4a37-b5d2-9f261663b78a admin admin] RBAC: Authorizing `identity:create_grant(project_id=817eac755ef44c8781459a50f2f0d4a5, user_id=1caef660a6984e008f92961fb4a74063, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:44.761598 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411ca97-3892-4051-89fd-0518906c05e1 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:44.766226 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9ef70-4178-4a37-b5d2-9f261663b78a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:44.791749 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 908/1818] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:44 2022] PUT /identity/v3/projects/817eac755ef44c8781459a50f2f0d4a5/users/1caef660a6984e008f92961fb4a74063/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:44.796028 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9ef70-4178-4a37-b5d2-9f261663b78a admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:44.876973 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0411ca97-3892-4051-89fd-0518906c05e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06f6272fb6eb43618ed8efe946b59dff'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:44.901850 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9ef70-4178-4a37-b5d2-9f261663b78a admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:44.908338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2347af-dd15-48e0-947e-129da1bc88e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:44.909411 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2347af-dd15-48e0-947e-129da1bc88e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:44.909640 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2347af-dd15-48e0-947e-129da1bc88e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:44.910002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2347af-dd15-48e0-947e-129da1bc88e4 admin admin] PATH_INFO: `/v3/projects/f386e50522fe4837bbada29befbcd7c4/users/e78d215f5fd44b85ae7ba60132788f86/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:44.928918 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2347af-dd15-48e0-947e-129da1bc88e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f386e50522fe4837bbada29befbcd7c4, user_id=e78d215f5fd44b85ae7ba60132788f86, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:44.931912 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2347af-dd15-48e0-947e-129da1bc88e4 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:44.946143 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0411ca97-3892-4051-89fd-0518906c05e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06f6272fb6eb43618ed8efe946b59dff'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:44.954206 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 909/1819] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:44 2022] PUT /identity/v3/projects/f386e50522fe4837bbada29befbcd7c4/users/e78d215f5fd44b85ae7ba60132788f86/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:44.956026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2347af-dd15-48e0-947e-129da1bc88e4 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:44.964623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0411ca97-3892-4051-89fd-0518906c05e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06f6272fb6eb43618ed8efe946b59dff'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:44.965220 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0411ca97-3892-4051-89fd-0518906c05e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06f6272fb6eb43618ed8efe946b59dff'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:44.992119 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0411ca97-3892-4051-89fd-0518906c05e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06f6272fb6eb43618ed8efe946b59dff'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:45.002473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 911/1820] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:25:44 2022] DELETE /identity/v3/users/06f6272fb6eb43618ed8efe946b59dff => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:45.007360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411ca97-3892-4051-89fd-0518906c05e1 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:45.010964 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-0411ca97-3892-4051-89fd-0518906c05e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:45.051895 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2347af-dd15-48e0-947e-129da1bc88e4 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:45.140572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454aea5f-6cbb-4ced-b628-eedf8793eed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:45.141527 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454aea5f-6cbb-4ced-b628-eedf8793eed0 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:45.141885 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454aea5f-6cbb-4ced-b628-eedf8793eed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:45.144119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454aea5f-6cbb-4ced-b628-eedf8793eed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:45.148569 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454aea5f-6cbb-4ced-b628-eedf8793eed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:45.150850 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454aea5f-6cbb-4ced-b628-eedf8793eed0 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:45.161389 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411ca97-3892-4051-89fd-0518906c05e1 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:45.167282 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473217b9-d8de-4f77-a9eb-22cc8298e801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:45.168437 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473217b9-d8de-4f77-a9eb-22cc8298e801 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:45.168881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473217b9-d8de-4f77-a9eb-22cc8298e801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:45.169253 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473217b9-d8de-4f77-a9eb-22cc8298e801 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:45.170001 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473217b9-d8de-4f77-a9eb-22cc8298e801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:45.171642 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473217b9-d8de-4f77-a9eb-22cc8298e801 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:45.183003 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 910/1821] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:45.189847 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 912/1822] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:45.191061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473217b9-d8de-4f77-a9eb-22cc8298e801 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:45.193872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-473217b9-d8de-4f77-a9eb-22cc8298e801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:45.196028 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677b2b7-7a4f-4557-b41a-788d0279ac68 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:45.196489 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677b2b7-7a4f-4557-b41a-788d0279ac68 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:45.196949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677b2b7-7a4f-4557-b41a-788d0279ac68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:45.215440 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473217b9-d8de-4f77-a9eb-22cc8298e801 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:45.237586 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3cc0a-7541-4f0c-9fea-9577f2aa2ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:45.238761 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3cc0a-7541-4f0c-9fea-9577f2aa2ad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:45.239117 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3cc0a-7541-4f0c-9fea-9577f2aa2ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:45.239471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3cc0a-7541-4f0c-9fea-9577f2aa2ad2 admin admin] PATH_INFO: `/v3/projects/817eac755ef44c8781459a50f2f0d4a5/users/1caef660a6984e008f92961fb4a74063/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:45.239958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-e677b2b7-7a4f-4557-b41a-788d0279ac68 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:45.241492 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-e677b2b7-7a4f-4557-b41a-788d0279ac68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:45.244525 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3cc0a-7541-4f0c-9fea-9577f2aa2ad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=817eac755ef44c8781459a50f2f0d4a5, user_id=1caef660a6984e008f92961fb4a74063, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:45.247932 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3cc0a-7541-4f0c-9fea-9577f2aa2ad2 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:45.260734 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 911/1823] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:45.262113 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677b2b7-7a4f-4557-b41a-788d0279ac68 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:45.264454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 913/1824] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:45 2022] PUT /identity/v3/projects/817eac755ef44c8781459a50f2f0d4a5/users/1caef660a6984e008f92961fb4a74063/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:45.276684 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b7dff-2b23-4910-84db-088651834b84 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:45.277214 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b7dff-2b23-4910-84db-088651834b84 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:45.278134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677b2b7-7a4f-4557-b41a-788d0279ac68 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:45.278468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b7dff-2b23-4910-84db-088651834b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:45.316949 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-c00b7dff-2b23-4910-84db-088651834b84 None None] MFA Rules not processed for user `1caef660a6984e008f92961fb4a74063`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:45.319481 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-c00b7dff-2b23-4910-84db-088651834b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:45.388727 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d0bf6-b01e-4a5d-bd08-779185eabc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:45.389646 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d0bf6-b01e-4a5d-bd08-779185eabc99 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:45.390411 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d0bf6-b01e-4a5d-bd08-779185eabc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:45.390631 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d0bf6-b01e-4a5d-bd08-779185eabc99 admin admin] PATH_INFO: `/v3/projects/f386e50522fe4837bbada29befbcd7c4/users/e78d215f5fd44b85ae7ba60132788f86/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:45.393446 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d0bf6-b01e-4a5d-bd08-779185eabc99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f386e50522fe4837bbada29befbcd7c4, user_id=e78d215f5fd44b85ae7ba60132788f86, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:45.396830 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d0bf6-b01e-4a5d-bd08-779185eabc99 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:45.412075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 912/1825] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:45 2022] PUT /identity/v3/projects/f386e50522fe4837bbada29befbcd7c4/users/e78d215f5fd44b85ae7ba60132788f86/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:45.413912 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d0bf6-b01e-4a5d-bd08-779185eabc99 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:45.415603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-a16d0bf6-b01e-4a5d-bd08-779185eabc99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:45.435442 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 914/1826] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:45 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:45.448012 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b7dff-2b23-4910-84db-088651834b84 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:45.449702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-c00b7dff-2b23-4910-84db-088651834b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:45.504101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d0bf6-b01e-4a5d-bd08-779185eabc99 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:45.508134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f050bf-2793-4701-a7db-0e0fdbb074f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:45.508672 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f050bf-2793-4701-a7db-0e0fdbb074f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:45.509992 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f050bf-2793-4701-a7db-0e0fdbb074f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:45.510104 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f050bf-2793-4701-a7db-0e0fdbb074f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:45.528356 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b7dff-2b23-4910-84db-088651834b84 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:45.633768 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f050bf-2793-4701-a7db-0e0fdbb074f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:45.636608 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f050bf-2793-4701-a7db-0e0fdbb074f4 service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:45.656028 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 913/1827] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:45.668650 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d014a-158f-49ab-908f-2bca24c077f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:45.673745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d014a-158f-49ab-908f-2bca24c077f6 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:45.674542 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d014a-158f-49ab-908f-2bca24c077f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:45.674990 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d014a-158f-49ab-908f-2bca24c077f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:45.740333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f050bf-2793-4701-a7db-0e0fdbb074f4 service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:45.742341 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-37f050bf-2793-4701-a7db-0e0fdbb074f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:45.764946 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f050bf-2793-4701-a7db-0e0fdbb074f4 service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:45.778832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1323428-6f57-488b-8349-d37b8f934da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:45.779927 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1323428-6f57-488b-8349-d37b8f934da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:45.781179 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1323428-6f57-488b-8349-d37b8f934da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:45.781647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1323428-6f57-488b-8349-d37b8f934da5 admin admin] PATH_INFO: `/v3/projects/cda98e6bfc5b48de9f50e0c05f2044bf` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:45.783489 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1323428-6f57-488b-8349-d37b8f934da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cda98e6bfc5b48de9f50e0c05f2044bf)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:45.791204 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1323428-6f57-488b-8349-d37b8f934da5 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:45.814354 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d014a-158f-49ab-908f-2bca24c077f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:45.818093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d014a-158f-49ab-908f-2bca24c077f6 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:45.856135 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 915/1828] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:45 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:25:45.919067 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f1323428-6f57-488b-8349-d37b8f934da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cda98e6bfc5b48de9f50e0c05f2044bf', 'request_id': 'req-f1323428-6f57-488b-8349-d37b8f934da5'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:45.934446 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f1323428-6f57-488b-8349-d37b8f934da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cda98e6bfc5b48de9f50e0c05f2044bf', 'request_id': 'req-f1323428-6f57-488b-8349-d37b8f934da5'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:45.950122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f1323428-6f57-488b-8349-d37b8f934da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cda98e6bfc5b48de9f50e0c05f2044bf', 'request_id': 'req-f1323428-6f57-488b-8349-d37b8f934da5'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:45.965977 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f1323428-6f57-488b-8349-d37b8f934da5 admin admin] The token cache is being invalidate because project cda98e6bfc5b48de9f50e0c05f2044bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:25:45.966275 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f1323428-6f57-488b-8349-d37b8f934da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:45.967347 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f1323428-6f57-488b-8349-d37b8f934da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:45.972738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 914/1829] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:25:45 2022] DELETE /identity/v3/projects/cda98e6bfc5b48de9f50e0c05f2044bf => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:45.975323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdf70d-2f68-44e9-9352-224c940ff9de None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:45.975766 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdf70d-2f68-44e9-9352-224c940ff9de None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:45.976222 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdf70d-2f68-44e9-9352-224c940ff9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:46.024563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-eabdf70d-2f68-44e9-9352-224c940ff9de None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:46.041357 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-eabdf70d-2f68-44e9-9352-224c940ff9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:46.149285 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 916/1830] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:46.165908 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fec60-9f34-4e12-8242-bb91bd119d54 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:46.166805 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fec60-9f34-4e12-8242-bb91bd119d54 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:46.167552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fec60-9f34-4e12-8242-bb91bd119d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:46.209431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-ea1fec60-9f34-4e12-8242-bb91bd119d54 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:46.212616 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-ea1fec60-9f34-4e12-8242-bb91bd119d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:46.240833 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 915/1831] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:25:46.243132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdf70d-2f68-44e9-9352-224c940ff9de None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:46.258850 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdf70d-2f68-44e9-9352-224c940ff9de None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:46.278436 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab5e05-a95d-45c6-b4e6-4d6b4bec961e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:46.281164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab5e05-a95d-45c6-b4e6-4d6b4bec961e admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:46.281856 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab5e05-a95d-45c6-b4e6-4d6b4bec961e admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:46.282525 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab5e05-a95d-45c6-b4e6-4d6b4bec961e admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:46.283492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab5e05-a95d-45c6-b4e6-4d6b4bec961e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:46.284526 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab5e05-a95d-45c6-b4e6-4d6b4bec961e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:46.287352 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab5e05-a95d-45c6-b4e6-4d6b4bec961e admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:46.313397 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 917/1832] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:46.317242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fec60-9f34-4e12-8242-bb91bd119d54 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:46.332143 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fec60-9f34-4e12-8242-bb91bd119d54 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:46.341084 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a6bfa-2640-4a09-914d-4cd0176d61e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:46.341823 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a6bfa-2640-4a09-914d-4cd0176d61e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:46.342100 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a6bfa-2640-4a09-914d-4cd0176d61e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:46.342415 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a6bfa-2640-4a09-914d-4cd0176d61e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:46.343108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a6bfa-2640-4a09-914d-4cd0176d61e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:46.345936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a6bfa-2640-4a09-914d-4cd0176d61e1 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:46.396812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 916/1833] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:46 2022] POST /identity/v3/projects => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:46.397469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab5e05-a95d-45c6-b4e6-4d6b4bec961e admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:46.453653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab5e05-a95d-45c6-b4e6-4d6b4bec961e admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:46.579461 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68351c22-8eda-4cd9-ac16-057889578483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:46.589378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68351c22-8eda-4cd9-ac16-057889578483 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:46.589378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68351c22-8eda-4cd9-ac16-057889578483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:46.589378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68351c22-8eda-4cd9-ac16-057889578483 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:46.589378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68351c22-8eda-4cd9-ac16-057889578483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:46.589378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68351c22-8eda-4cd9-ac16-057889578483 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:46.620772 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 918/1834] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:46 2022] POST /identity/v3/users => generated 284 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:25:46.623423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a6bfa-2640-4a09-914d-4cd0176d61e1 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:46.639303 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a6bfa-2640-4a09-914d-4cd0176d61e1 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:46.646969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d3923-b9d1-437f-85fb-5cab2bf2d19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:46.648034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d3923-b9d1-437f-85fb-5cab2bf2d19b admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:46.648454 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d3923-b9d1-437f-85fb-5cab2bf2d19b admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:46.648889 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d3923-b9d1-437f-85fb-5cab2bf2d19b admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:46.649895 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d3923-b9d1-437f-85fb-5cab2bf2d19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:46.652435 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d3923-b9d1-437f-85fb-5cab2bf2d19b admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:46.687447 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 917/1835] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:46.689136 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68351c22-8eda-4cd9-ac16-057889578483 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:46.702485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68351c22-8eda-4cd9-ac16-057889578483 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:46.708082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282485d-4b3b-4ee2-871a-7fa4f269953c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:46.709903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282485d-4b3b-4ee2-871a-7fa4f269953c admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:46.710815 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282485d-4b3b-4ee2-871a-7fa4f269953c admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:46.711684 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282485d-4b3b-4ee2-871a-7fa4f269953c admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:46.712609 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282485d-4b3b-4ee2-871a-7fa4f269953c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:46.714457 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282485d-4b3b-4ee2-871a-7fa4f269953c admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:46.726285 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 919/1836] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:46.730403 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d3923-b9d1-437f-85fb-5cab2bf2d19b admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:46.744366 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d3923-b9d1-437f-85fb-5cab2bf2d19b admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:46.755549 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d2e63-1a9c-412b-8283-8673a5388bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:46.756548 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d2e63-1a9c-412b-8283-8673a5388bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:46.756831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d2e63-1a9c-412b-8283-8673a5388bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:46.757107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d2e63-1a9c-412b-8283-8673a5388bb3 admin admin] PATH_INFO: `/v3/projects/bf4b318085a34d95978da96d674fd0c0/users/e1aac524fb4d4e73b02b07c764b7a722/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:46.777657 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d2e63-1a9c-412b-8283-8673a5388bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf4b318085a34d95978da96d674fd0c0, user_id=e1aac524fb4d4e73b02b07c764b7a722, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:46.790280 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d2e63-1a9c-412b-8283-8673a5388bb3 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:46.812762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 918/1837] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:46 2022] PUT /identity/v3/projects/bf4b318085a34d95978da96d674fd0c0/users/e1aac524fb4d4e73b02b07c764b7a722/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:46.828128 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542c524-f6d8-431a-9e4e-e8950b05eb65 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:46.828675 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542c524-f6d8-431a-9e4e-e8950b05eb65 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:46.828763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542c524-f6d8-431a-9e4e-e8950b05eb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:46.889724 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-6542c524-f6d8-431a-9e4e-e8950b05eb65 None None] MFA Rules not processed for user `e1aac524fb4d4e73b02b07c764b7a722`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:46.890980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-6542c524-f6d8-431a-9e4e-e8950b05eb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:46.912113 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d2e63-1a9c-412b-8283-8673a5388bb3 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:46.914656 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-a82d2e63-1a9c-412b-8283-8673a5388bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:47.042527 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d2e63-1a9c-412b-8283-8673a5388bb3 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:47.049213 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aac02a-18b7-46ce-8791-b5311a9bac36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:47.051083 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac02a-18b7-46ce-8791-b5311a9bac36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:47.051580 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac02a-18b7-46ce-8791-b5311a9bac36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:47.052420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac02a-18b7-46ce-8791-b5311a9bac36 admin admin] PATH_INFO: `/v3/projects/b80b2933087844ff95114a65fd440340` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:47.054214 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aac02a-18b7-46ce-8791-b5311a9bac36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b80b2933087844ff95114a65fd440340)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:47.056847 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aac02a-18b7-46ce-8791-b5311a9bac36 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:47.104785 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 920/1838] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:47.106653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d173d6-214e-4bef-8b6c-1b12412b4c7c None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:47.107094 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d173d6-214e-4bef-8b6c-1b12412b4c7c None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:47.107857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d173d6-214e-4bef-8b6c-1b12412b4c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:47.123585 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-81aac02a-18b7-46ce-8791-b5311a9bac36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b80b2933087844ff95114a65fd440340', 'request_id': 'req-81aac02a-18b7-46ce-8791-b5311a9bac36'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:47.133492 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-81aac02a-18b7-46ce-8791-b5311a9bac36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b80b2933087844ff95114a65fd440340', 'request_id': 'req-81aac02a-18b7-46ce-8791-b5311a9bac36'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:47.141704 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-81aac02a-18b7-46ce-8791-b5311a9bac36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b80b2933087844ff95114a65fd440340', 'request_id': 'req-81aac02a-18b7-46ce-8791-b5311a9bac36'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:47.150979 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-d7d173d6-214e-4bef-8b6c-1b12412b4c7c None None] MFA Rules not processed for user `e78d215f5fd44b85ae7ba60132788f86`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:47.152350 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-d7d173d6-214e-4bef-8b6c-1b12412b4c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:47.163951 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-81aac02a-18b7-46ce-8791-b5311a9bac36 admin admin] The token cache is being invalidate because project b80b2933087844ff95114a65fd440340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:25:47.164493 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-81aac02a-18b7-46ce-8791-b5311a9bac36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:47.165755 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-81aac02a-18b7-46ce-8791-b5311a9bac36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:47.170531 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 919/1839] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:25:46 2022] DELETE /identity/v3/projects/b80b2933087844ff95114a65fd440340 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:25:47.172709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aac02a-18b7-46ce-8791-b5311a9bac36 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:47.176039 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-81aac02a-18b7-46ce-8791-b5311a9bac36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:47.313684 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 921/1840] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:47 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:47.314716 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d173d6-214e-4bef-8b6c-1b12412b4c7c None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:47.319695 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-d7d173d6-214e-4bef-8b6c-1b12412b4c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:47.346541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d173d6-214e-4bef-8b6c-1b12412b4c7c None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:47.348348 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aac02a-18b7-46ce-8791-b5311a9bac36 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:47.360092 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91143bbf-5a2b-424a-a611-426e01b5d950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:47.363076 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91143bbf-5a2b-424a-a611-426e01b5d950 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:47.363199 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91143bbf-5a2b-424a-a611-426e01b5d950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:47.363418 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91143bbf-5a2b-424a-a611-426e01b5d950 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:47.364142 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91143bbf-5a2b-424a-a611-426e01b5d950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:47.370638 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91143bbf-5a2b-424a-a611-426e01b5d950 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:47.385309 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f881f67-537f-492f-aa23-745e7f75a9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:47.389138 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f881f67-537f-492f-aa23-745e7f75a9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:47.390141 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f881f67-537f-492f-aa23-745e7f75a9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:47.390433 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f881f67-537f-492f-aa23-745e7f75a9ae admin admin] PATH_INFO: `/v3/users/22c28dfdf7444515b93f04481b845a0a` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:47.394825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f881f67-537f-492f-aa23-745e7f75a9ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=22c28dfdf7444515b93f04481b845a0a)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:47.401548 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f881f67-537f-492f-aa23-745e7f75a9ae admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:47.448045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 920/1841] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:47 2022] POST /identity/v3/projects => generated 365 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:47.456597 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91143bbf-5a2b-424a-a611-426e01b5d950 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:47.462751 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-91143bbf-5a2b-424a-a611-426e01b5d950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:47.511310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-6f881f67-537f-492f-aa23-745e7f75a9ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22c28dfdf7444515b93f04481b845a0a'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:47.533514 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-6f881f67-537f-492f-aa23-745e7f75a9ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22c28dfdf7444515b93f04481b845a0a'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:47.549977 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-6f881f67-537f-492f-aa23-745e7f75a9ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22c28dfdf7444515b93f04481b845a0a'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:47.550779 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-6f881f67-537f-492f-aa23-745e7f75a9ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22c28dfdf7444515b93f04481b845a0a'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:47.565779 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-6f881f67-537f-492f-aa23-745e7f75a9ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22c28dfdf7444515b93f04481b845a0a'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:47.579292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 922/1842] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:25:47 2022] DELETE /identity/v3/users/22c28dfdf7444515b93f04481b845a0a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:47.580470 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f881f67-537f-492f-aa23-745e7f75a9ae admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:47.585205 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-6f881f67-537f-492f-aa23-745e7f75a9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:47.614386 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91143bbf-5a2b-424a-a611-426e01b5d950 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:47.726762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40bc03-44fd-4fcf-974f-eb52367532c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:47.727243 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40bc03-44fd-4fcf-974f-eb52367532c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:47.727431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40bc03-44fd-4fcf-974f-eb52367532c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:47.727871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40bc03-44fd-4fcf-974f-eb52367532c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:47.729990 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8f40bc03-44fd-4fcf-974f-eb52367532c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:47.762625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f881f67-537f-492f-aa23-745e7f75a9ae admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:47.781650 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d4cbc-8a14-4fe4-9830-4441bf1c1b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:47.782476 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d4cbc-8a14-4fe4-9830-4441bf1c1b14 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:47.782947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d4cbc-8a14-4fe4-9830-4441bf1c1b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:47.783315 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d4cbc-8a14-4fe4-9830-4441bf1c1b14 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:47.784110 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d4cbc-8a14-4fe4-9830-4441bf1c1b14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:47.786159 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d4cbc-8a14-4fe4-9830-4441bf1c1b14 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:47.825232 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 923/1843] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:47 2022] POST /identity/v3/users => generated 289 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:47.830426 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d4cbc-8a14-4fe4-9830-4441bf1c1b14 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:47.846709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40bc03-44fd-4fcf-974f-eb52367532c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:47.848089 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d4cbc-8a14-4fe4-9830-4441bf1c1b14 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:47.848242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40bc03-44fd-4fcf-974f-eb52367532c7 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:47.857244 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9f50c-b4c6-46e3-9b72-c34acacc34a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:47.859199 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9f50c-b4c6-46e3-9b72-c34acacc34a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:47.859801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9f50c-b4c6-46e3-9b72-c34acacc34a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:47.860662 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9f50c-b4c6-46e3-9b72-c34acacc34a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:47.862436 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9f50c-b4c6-46e3-9b72-c34acacc34a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:47.865562 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9f50c-b4c6-46e3-9b72-c34acacc34a7 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:47.869330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 921/1844] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:47.883705 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 924/1845] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:47.884963 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40bc03-44fd-4fcf-974f-eb52367532c7 service cinder] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:47.911908 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40bc03-44fd-4fcf-974f-eb52367532c7 service cinder] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:47.919790 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70bfbb-be68-4211-a134-697b0d4d1a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:47.921101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70bfbb-be68-4211-a134-697b0d4d1a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:47.921545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70bfbb-be68-4211-a134-697b0d4d1a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:47.921916 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70bfbb-be68-4211-a134-697b0d4d1a94 admin admin] PATH_INFO: `/v3/projects/2b281c0fbe46459288bcef236ebed029/users/8cdefc74b3cf45bbbefbcee16a6dcb5e/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:47.954179 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70bfbb-be68-4211-a134-697b0d4d1a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b281c0fbe46459288bcef236ebed029, user_id=8cdefc74b3cf45bbbefbcee16a6dcb5e, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:47.968336 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70bfbb-be68-4211-a134-697b0d4d1a94 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:48.000253 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 922/1846] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:47 2022] PUT /identity/v3/projects/2b281c0fbe46459288bcef236ebed029/users/8cdefc74b3cf45bbbefbcee16a6dcb5e/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:48.001040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9f50c-b4c6-46e3-9b72-c34acacc34a7 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:48.014313 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9f50c-b4c6-46e3-9b72-c34acacc34a7 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:48.130221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d939fc-39bf-4669-85f0-43b568b2d13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:48.131140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d939fc-39bf-4669-85f0-43b568b2d13d admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:48.131439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d939fc-39bf-4669-85f0-43b568b2d13d admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:48.131705 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d939fc-39bf-4669-85f0-43b568b2d13d admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:48.132481 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d939fc-39bf-4669-85f0-43b568b2d13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:48.135367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d939fc-39bf-4669-85f0-43b568b2d13d admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:48.154486 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70bfbb-be68-4211-a134-697b0d4d1a94 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:48.160277 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 925/1847] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:25:48.170991 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70bfbb-be68-4211-a134-697b0d4d1a94 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:48.178525 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093f481-d37e-433e-88f2-243c842ed053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:48.179778 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093f481-d37e-433e-88f2-243c842ed053 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:48.180135 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093f481-d37e-433e-88f2-243c842ed053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:48.180452 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093f481-d37e-433e-88f2-243c842ed053 admin admin] PATH_INFO: `/v3/projects/2b281c0fbe46459288bcef236ebed029/users/8cdefc74b3cf45bbbefbcee16a6dcb5e/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:48.183573 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093f481-d37e-433e-88f2-243c842ed053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b281c0fbe46459288bcef236ebed029, user_id=8cdefc74b3cf45bbbefbcee16a6dcb5e, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:48.187669 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093f481-d37e-433e-88f2-243c842ed053 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:48.213039 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 923/1848] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:48 2022] PUT /identity/v3/projects/2b281c0fbe46459288bcef236ebed029/users/8cdefc74b3cf45bbbefbcee16a6dcb5e/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:48.225695 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c58029-34d4-4557-93d7-6a7b20232563 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:48.226371 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c58029-34d4-4557-93d7-6a7b20232563 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:48.226977 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c58029-34d4-4557-93d7-6a7b20232563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:48.264047 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093f481-d37e-433e-88f2-243c842ed053 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:48.265896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-5093f481-d37e-433e-88f2-243c842ed053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:48.273036 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-e0c58029-34d4-4557-93d7-6a7b20232563 None None] MFA Rules not processed for user `8cdefc74b3cf45bbbefbcee16a6dcb5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:48.274519 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-e0c58029-34d4-4557-93d7-6a7b20232563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:48.362170 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093f481-d37e-433e-88f2-243c842ed053 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:48.367661 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0052e-9e9e-4a2a-b830-edcee510e46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:48.368574 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0052e-9e9e-4a2a-b830-edcee510e46d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:48.368856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0052e-9e9e-4a2a-b830-edcee510e46d admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:48.369129 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0052e-9e9e-4a2a-b830-edcee510e46d admin admin] PATH_INFO: `/v3/projects/39258ac537ef425aa3476d6c76df25bb` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:48.370791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b0052e-9e9e-4a2a-b830-edcee510e46d admin admin] RBAC: Authorizing `identity:delete_project(project_id=39258ac537ef425aa3476d6c76df25bb)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:48.373205 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b0052e-9e9e-4a2a-b830-edcee510e46d admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:48.391369 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 926/1849] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:48 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:48.435824 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-90b0052e-9e9e-4a2a-b830-edcee510e46d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39258ac537ef425aa3476d6c76df25bb', 'request_id': 'req-90b0052e-9e9e-4a2a-b830-edcee510e46d'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:48.438610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c58029-34d4-4557-93d7-6a7b20232563 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:48.440238 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-e0c58029-34d4-4557-93d7-6a7b20232563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:48.447006 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-90b0052e-9e9e-4a2a-b830-edcee510e46d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39258ac537ef425aa3476d6c76df25bb', 'request_id': 'req-90b0052e-9e9e-4a2a-b830-edcee510e46d'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:48.456269 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-90b0052e-9e9e-4a2a-b830-edcee510e46d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39258ac537ef425aa3476d6c76df25bb', 'request_id': 'req-90b0052e-9e9e-4a2a-b830-edcee510e46d'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:48.473234 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-90b0052e-9e9e-4a2a-b830-edcee510e46d admin admin] The token cache is being invalidate because project 39258ac537ef425aa3476d6c76df25bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:25:48.473693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-90b0052e-9e9e-4a2a-b830-edcee510e46d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:48.475472 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-90b0052e-9e9e-4a2a-b830-edcee510e46d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:48.478268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 924/1850] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:25:48 2022] DELETE /identity/v3/projects/39258ac537ef425aa3476d6c76df25bb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:25:48.482807 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190953b4-a349-4fb0-99ad-0134a3e201c3 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:48.483090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190953b4-a349-4fb0-99ad-0134a3e201c3 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:48.483368 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190953b4-a349-4fb0-99ad-0134a3e201c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:48.526921 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-190953b4-a349-4fb0-99ad-0134a3e201c3 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:48.528384 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-190953b4-a349-4fb0-99ad-0134a3e201c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:48.541118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c58029-34d4-4557-93d7-6a7b20232563 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:48.596783 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96173015-81e1-467f-ba39-37ffd2bbfb59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:48.597438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96173015-81e1-467f-ba39-37ffd2bbfb59 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:48.597726 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96173015-81e1-467f-ba39-37ffd2bbfb59 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:48.598002 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96173015-81e1-467f-ba39-37ffd2bbfb59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:48.600136 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-96173015-81e1-467f-ba39-37ffd2bbfb59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:48.602320 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 925/1851] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:48.610625 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745dbf9-7083-44d3-8c14-8f48242cbd73 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:48.611116 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745dbf9-7083-44d3-8c14-8f48242cbd73 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:48.611590 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745dbf9-7083-44d3-8c14-8f48242cbd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:48.634760 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-d745dbf9-7083-44d3-8c14-8f48242cbd73 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:48.635992 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-d745dbf9-7083-44d3-8c14-8f48242cbd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:48.644761 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 926/1852] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:25:48.649300 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745dbf9-7083-44d3-8c14-8f48242cbd73 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:48.659225 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745dbf9-7083-44d3-8c14-8f48242cbd73 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:48.664612 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c63800-0c0d-40ac-be73-d4e80fc721ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:48.665265 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c63800-0c0d-40ac-be73-d4e80fc721ba admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:48.665544 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c63800-0c0d-40ac-be73-d4e80fc721ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:48.665815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c63800-0c0d-40ac-be73-d4e80fc721ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:48.666539 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c63800-0c0d-40ac-be73-d4e80fc721ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:48.666840 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c63800-0c0d-40ac-be73-d4e80fc721ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:48.668448 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c63800-0c0d-40ac-be73-d4e80fc721ba admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:48.672262 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96173015-81e1-467f-ba39-37ffd2bbfb59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:48.675625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96173015-81e1-467f-ba39-37ffd2bbfb59 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:48.688341 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 927/1853] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:25:48.688507 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 927/1854] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:48 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:25:48.691970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c63800-0c0d-40ac-be73-d4e80fc721ba admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:48.706068 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c63800-0c0d-40ac-be73-d4e80fc721ba admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:48.712443 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b32517-c42d-4454-becc-31d2e920a2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:48.713286 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b32517-c42d-4454-becc-31d2e920a2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:48.713722 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b32517-c42d-4454-becc-31d2e920a2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:48.714031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b32517-c42d-4454-becc-31d2e920a2f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:48.714913 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b32517-c42d-4454-becc-31d2e920a2f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:48.717644 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b32517-c42d-4454-becc-31d2e920a2f6 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:48.720681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96173015-81e1-467f-ba39-37ffd2bbfb59 service cinder] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:48.722084 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-96173015-81e1-467f-ba39-37ffd2bbfb59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:48.746095 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96173015-81e1-467f-ba39-37ffd2bbfb59 service cinder] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:48.749677 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 928/1855] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:48 2022] POST /identity/v3/projects => generated 407 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:48.754385 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b32517-c42d-4454-becc-31d2e920a2f6 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:48.754672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506a8d4-3331-4c0f-9a7d-93f2c1fcf33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:48.756694 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506a8d4-3331-4c0f-9a7d-93f2c1fcf33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:48.757343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506a8d4-3331-4c0f-9a7d-93f2c1fcf33a admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:48.757863 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506a8d4-3331-4c0f-9a7d-93f2c1fcf33a admin admin] PATH_INFO: `/v3/users/7630824180e249299ff0c3c3419c5a00` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:48.759623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506a8d4-3331-4c0f-9a7d-93f2c1fcf33a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7630824180e249299ff0c3c3419c5a00)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:48.762338 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506a8d4-3331-4c0f-9a7d-93f2c1fcf33a admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:48.840295 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0506a8d4-3331-4c0f-9a7d-93f2c1fcf33a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7630824180e249299ff0c3c3419c5a00'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:48.851386 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b32517-c42d-4454-becc-31d2e920a2f6 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:48.855853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a997b-fdf8-451b-87e7-9b9c2d2cc851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:48.856666 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a997b-fdf8-451b-87e7-9b9c2d2cc851 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:48.857013 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a997b-fdf8-451b-87e7-9b9c2d2cc851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:48.857360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a997b-fdf8-451b-87e7-9b9c2d2cc851 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:48.858660 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0506a8d4-3331-4c0f-9a7d-93f2c1fcf33a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7630824180e249299ff0c3c3419c5a00'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:48.858951 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a997b-fdf8-451b-87e7-9b9c2d2cc851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:48.860212 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a997b-fdf8-451b-87e7-9b9c2d2cc851 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:48.867799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0506a8d4-3331-4c0f-9a7d-93f2c1fcf33a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7630824180e249299ff0c3c3419c5a00'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:48.868828 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0506a8d4-3331-4c0f-9a7d-93f2c1fcf33a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7630824180e249299ff0c3c3419c5a00'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:48.878957 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0506a8d4-3331-4c0f-9a7d-93f2c1fcf33a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7630824180e249299ff0c3c3419c5a00'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:48.889714 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 929/1856] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:48 2022] POST /identity/v3/users => generated 304 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:48.889714 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a997b-fdf8-451b-87e7-9b9c2d2cc851 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:48.889714 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-ac3a997b-fdf8-451b-87e7-9b9c2d2cc851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:48.890484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 928/1857] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:25:48 2022] DELETE /identity/v3/users/7630824180e249299ff0c3c3419c5a00 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:25:48.893700 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506a8d4-3331-4c0f-9a7d-93f2c1fcf33a admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:48.893700 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-0506a8d4-3331-4c0f-9a7d-93f2c1fcf33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:48.951103 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a997b-fdf8-451b-87e7-9b9c2d2cc851 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:48.982865 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506a8d4-3331-4c0f-9a7d-93f2c1fcf33a admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:48.990716 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a09b1-959c-484d-9a80-44e27594bb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:48.991400 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a09b1-959c-484d-9a80-44e27594bb4e admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:48.991687 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a09b1-959c-484d-9a80-44e27594bb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:48.991967 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a09b1-959c-484d-9a80-44e27594bb4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:48.992731 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a09b1-959c-484d-9a80-44e27594bb4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:48.994349 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a09b1-959c-484d-9a80-44e27594bb4e admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:49.013716 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 929/1858] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:49.015211 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722a47d-609b-4d84-8f10-914a293ad4df None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:49.015507 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722a47d-609b-4d84-8f10-914a293ad4df None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:49.015782 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722a47d-609b-4d84-8f10-914a293ad4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:49.021227 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeae73c-ef26-4664-aead-87d6ac946a53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:49.023104 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeae73c-ef26-4664-aead-87d6ac946a53 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:49.023104 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeae73c-ef26-4664-aead-87d6ac946a53 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:49.023679 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeae73c-ef26-4664-aead-87d6ac946a53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:49.025778 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-4eeae73c-ef26-4664-aead-87d6ac946a53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:49.052115 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-3722a47d-609b-4d84-8f10-914a293ad4df None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:49.054214 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-3722a47d-609b-4d84-8f10-914a293ad4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:49.066341 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 930/1859] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:49.067274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722a47d-609b-4d84-8f10-914a293ad4df None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:49.085529 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722a47d-609b-4d84-8f10-914a293ad4df None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:49.091327 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33126602-a341-47dc-a16d-1002643d7203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:49.092237 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33126602-a341-47dc-a16d-1002643d7203 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:49.092968 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33126602-a341-47dc-a16d-1002643d7203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:49.093256 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33126602-a341-47dc-a16d-1002643d7203 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:49.094088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33126602-a341-47dc-a16d-1002643d7203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:49.095731 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33126602-a341-47dc-a16d-1002643d7203 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:49.108748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 931/1860] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:49.109657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33126602-a341-47dc-a16d-1002643d7203 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:49.111835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-33126602-a341-47dc-a16d-1002643d7203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:49.118191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeae73c-ef26-4664-aead-87d6ac946a53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:49.129331 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeae73c-ef26-4664-aead-87d6ac946a53 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:49.140481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 930/1861] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:49.141404 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeae73c-ef26-4664-aead-87d6ac946a53 service cinder] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:49.154535 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeae73c-ef26-4664-aead-87d6ac946a53 service cinder] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:49.161209 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b44c7a-9236-4fef-a706-9f919778172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:49.164893 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b44c7a-9236-4fef-a706-9f919778172d admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:49.164893 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b44c7a-9236-4fef-a706-9f919778172d admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:49.164893 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b44c7a-9236-4fef-a706-9f919778172d admin admin] PATH_INFO: `/v3/projects/cd401d1a905342f6a45cd1ace678a6a4/users/0c03e50ea66b4cceb694ec78d7134461/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:49.180963 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b44c7a-9236-4fef-a706-9f919778172d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd401d1a905342f6a45cd1ace678a6a4, user_id=0c03e50ea66b4cceb694ec78d7134461, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:49.183709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b44c7a-9236-4fef-a706-9f919778172d admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:49.189923 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33126602-a341-47dc-a16d-1002643d7203 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:49.195681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd32bde-2172-45b0-8022-91bed35baa37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:49.196478 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd32bde-2172-45b0-8022-91bed35baa37 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:49.196825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd32bde-2172-45b0-8022-91bed35baa37 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:49.197126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd32bde-2172-45b0-8022-91bed35baa37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:49.201625 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 931/1862] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:49 2022] PUT /identity/v3/projects/cd401d1a905342f6a45cd1ace678a6a4/users/0c03e50ea66b4cceb694ec78d7134461/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:49.213775 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b4db9-ec1a-4b87-8092-e4de897774ec None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:49.214118 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b4db9-ec1a-4b87-8092-e4de897774ec None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:49.214405 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b4db9-ec1a-4b87-8092-e4de897774ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:49.215838 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd32bde-2172-45b0-8022-91bed35baa37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:49.217839 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd32bde-2172-45b0-8022-91bed35baa37 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:49.233171 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 932/1863] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:49.247062 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-7d2b4db9-ec1a-4b87-8092-e4de897774ec None None] MFA Rules not processed for user `0c03e50ea66b4cceb694ec78d7134461`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:49.248320 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-7d2b4db9-ec1a-4b87-8092-e4de897774ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:49.332092 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 932/1864] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:49 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:49.339714 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd32bde-2172-45b0-8022-91bed35baa37 service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:49.352765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd32bde-2172-45b0-8022-91bed35baa37 service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:49.472039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0556f-11c7-4034-8423-d0f16498e997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:49.473212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0556f-11c7-4034-8423-d0f16498e997 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:49.473212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0556f-11c7-4034-8423-d0f16498e997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:49.473387 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0556f-11c7-4034-8423-d0f16498e997 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:49.474714 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0556f-11c7-4034-8423-d0f16498e997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:49.477121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0556f-11c7-4034-8423-d0f16498e997 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:49.553304 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 933/1865] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:49 2022] POST /identity/v3/projects => generated 409 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:49.554888 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b4db9-ec1a-4b87-8092-e4de897774ec None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:49.573348 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b4db9-ec1a-4b87-8092-e4de897774ec None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:49.616558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0556f-11c7-4034-8423-d0f16498e997 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:49.618289 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-12d0556f-11c7-4034-8423-d0f16498e997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:49.704449 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dcda1-4ca9-4e14-b92e-e947a6bdaccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:49.706351 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dcda1-4ca9-4e14-b92e-e947a6bdaccf admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:49.706772 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dcda1-4ca9-4e14-b92e-e947a6bdaccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:49.707732 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dcda1-4ca9-4e14-b92e-e947a6bdaccf admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:49.709657 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93dcda1-4ca9-4e14-b92e-e947a6bdaccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:49.711835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93dcda1-4ca9-4e14-b92e-e947a6bdaccf admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:49.749230 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 933/1866] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:49 2022] POST /identity/v3/users => generated 311 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:49.752790 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dcda1-4ca9-4e14-b92e-e947a6bdaccf admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:49.763198 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0556f-11c7-4034-8423-d0f16498e997 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:49.769632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dcda1-4ca9-4e14-b92e-e947a6bdaccf admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:49.775973 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9de3e7-41ae-4340-9073-156be7e33e5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:49.776775 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9de3e7-41ae-4340-9073-156be7e33e5a service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:49.777091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9de3e7-41ae-4340-9073-156be7e33e5a service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:49.777405 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9de3e7-41ae-4340-9073-156be7e33e5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:49.779835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ccee2-faed-4450-89e2-93437389acd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:49.781733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-9e9de3e7-41ae-4340-9073-156be7e33e5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:49.781926 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ccee2-faed-4450-89e2-93437389acd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:49.782425 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ccee2-faed-4450-89e2-93437389acd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:49.782873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ccee2-faed-4450-89e2-93437389acd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:49.783861 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ccee2-faed-4450-89e2-93437389acd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:49.786394 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ccee2-faed-4450-89e2-93437389acd9 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:49.804210 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 934/1867] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:25:49.805880 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ccee2-faed-4450-89e2-93437389acd9 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:49.832674 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ccee2-faed-4450-89e2-93437389acd9 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:49.840519 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ef91b-8924-4d66-aae9-b7e9205ee09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:49.841421 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ef91b-8924-4d66-aae9-b7e9205ee09d admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:49.841700 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ef91b-8924-4d66-aae9-b7e9205ee09d admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:49.842088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ef91b-8924-4d66-aae9-b7e9205ee09d admin admin] PATH_INFO: `/v3/projects/030200e535244ab99fb02da8c736ab44/users/22b5568083a54016a4164dcb8ceeec41/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:49.857761 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ef91b-8924-4d66-aae9-b7e9205ee09d admin admin] RBAC: Authorizing `identity:create_grant(project_id=030200e535244ab99fb02da8c736ab44, user_id=22b5568083a54016a4164dcb8ceeec41, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:49.860633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ef91b-8924-4d66-aae9-b7e9205ee09d admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:49.886668 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 935/1868] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:49 2022] PUT /identity/v3/projects/030200e535244ab99fb02da8c736ab44/users/22b5568083a54016a4164dcb8ceeec41/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:25:49.892441 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ef91b-8924-4d66-aae9-b7e9205ee09d admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:49.924727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9de3e7-41ae-4340-9073-156be7e33e5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:49.929359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9de3e7-41ae-4340-9073-156be7e33e5a service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:49.957740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 934/1869] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:49 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:25:49.958959 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9de3e7-41ae-4340-9073-156be7e33e5a service cinder] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:49.963637 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-9e9de3e7-41ae-4340-9073-156be7e33e5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:49.992963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9de3e7-41ae-4340-9073-156be7e33e5a service cinder] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:50.047952 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ef91b-8924-4d66-aae9-b7e9205ee09d admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:50.058750 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f47540-6630-4508-a2ff-1f83e4653e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:50.059440 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f47540-6630-4508-a2ff-1f83e4653e8a admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:50.059726 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f47540-6630-4508-a2ff-1f83e4653e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:50.060534 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f47540-6630-4508-a2ff-1f83e4653e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:50.061299 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f47540-6630-4508-a2ff-1f83e4653e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:50.062932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f47540-6630-4508-a2ff-1f83e4653e8a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:50.096661 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 936/1870] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:25:50.102398 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f47540-6630-4508-a2ff-1f83e4653e8a admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:50.119205 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639bcea-0a39-4162-a5d3-baae5d584297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:50.120080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639bcea-0a39-4162-a5d3-baae5d584297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:50.120480 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639bcea-0a39-4162-a5d3-baae5d584297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:50.120665 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639bcea-0a39-4162-a5d3-baae5d584297 admin admin] PATH_INFO: `/v3/projects/6220bfb10b12466089c994527f46e9ac` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:50.122262 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639bcea-0a39-4162-a5d3-baae5d584297 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6220bfb10b12466089c994527f46e9ac)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:50.123806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639bcea-0a39-4162-a5d3-baae5d584297 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:50.125892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f47540-6630-4508-a2ff-1f83e4653e8a admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:50.140866 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3152e57-00eb-4003-9604-3cb3cef3d90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:50.141853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3152e57-00eb-4003-9604-3cb3cef3d90d admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:50.142043 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3152e57-00eb-4003-9604-3cb3cef3d90d admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:50.142322 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3152e57-00eb-4003-9604-3cb3cef3d90d admin admin] PATH_INFO: `/v3/projects/030200e535244ab99fb02da8c736ab44/users/22b5568083a54016a4164dcb8ceeec41/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:50.148140 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3152e57-00eb-4003-9604-3cb3cef3d90d admin admin] RBAC: Authorizing `identity:create_grant(project_id=030200e535244ab99fb02da8c736ab44, user_id=22b5568083a54016a4164dcb8ceeec41, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:50.150851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3152e57-00eb-4003-9604-3cb3cef3d90d admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:50.180608 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 937/1871] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:50 2022] PUT /identity/v3/projects/030200e535244ab99fb02da8c736ab44/users/22b5568083a54016a4164dcb8ceeec41/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:50.192356 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90162e3a-b3fe-42c0-9386-8fa5e6456d54 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:50.193249 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90162e3a-b3fe-42c0-9386-8fa5e6456d54 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:50.194253 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90162e3a-b3fe-42c0-9386-8fa5e6456d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:50.233087 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c639bcea-0a39-4162-a5d3-baae5d584297 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6220bfb10b12466089c994527f46e9ac', 'request_id': 'req-c639bcea-0a39-4162-a5d3-baae5d584297'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:50.237574 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-90162e3a-b3fe-42c0-9386-8fa5e6456d54 None None] MFA Rules not processed for user `22b5568083a54016a4164dcb8ceeec41`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:50.238874 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-90162e3a-b3fe-42c0-9386-8fa5e6456d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:50.243667 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c639bcea-0a39-4162-a5d3-baae5d584297 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6220bfb10b12466089c994527f46e9ac', 'request_id': 'req-c639bcea-0a39-4162-a5d3-baae5d584297'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:50.276682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c639bcea-0a39-4162-a5d3-baae5d584297 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6220bfb10b12466089c994527f46e9ac', 'request_id': 'req-c639bcea-0a39-4162-a5d3-baae5d584297'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:50.305204 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c639bcea-0a39-4162-a5d3-baae5d584297 admin admin] The token cache is being invalidate because project 6220bfb10b12466089c994527f46e9ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:25:50.305668 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c639bcea-0a39-4162-a5d3-baae5d584297 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:50.306465 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c639bcea-0a39-4162-a5d3-baae5d584297 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:50.311206 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 935/1872] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:25:49 2022] DELETE /identity/v3/projects/6220bfb10b12466089c994527f46e9ac => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:50.316287 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639bcea-0a39-4162-a5d3-baae5d584297 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:50.325386 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-c639bcea-0a39-4162-a5d3-baae5d584297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:50.369108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 938/1873] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:50 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:50.383593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90162e3a-b3fe-42c0-9386-8fa5e6456d54 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:50.385138 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-90162e3a-b3fe-42c0-9386-8fa5e6456d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:50.433073 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639bcea-0a39-4162-a5d3-baae5d584297 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:50.439201 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc7f08-c36f-4324-992f-5498c30d2a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:50.440091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc7f08-c36f-4324-992f-5498c30d2a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:50.440411 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc7f08-c36f-4324-992f-5498c30d2a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:50.440691 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc7f08-c36f-4324-992f-5498c30d2a7b admin admin] PATH_INFO: `/v3/users/1caef660a6984e008f92961fb4a74063` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:50.441900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc7f08-c36f-4324-992f-5498c30d2a7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1caef660a6984e008f92961fb4a74063)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:50.445113 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc7f08-c36f-4324-992f-5498c30d2a7b admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:50.451161 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90162e3a-b3fe-42c0-9386-8fa5e6456d54 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:50.454849 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898407d5-a740-4811-87fc-cb956b73d2bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:50.455647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898407d5-a740-4811-87fc-cb956b73d2bc service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:50.455931 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898407d5-a740-4811-87fc-cb956b73d2bc service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:50.456240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898407d5-a740-4811-87fc-cb956b73d2bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:50.466426 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898407d5-a740-4811-87fc-cb956b73d2bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:50.467901 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898407d5-a740-4811-87fc-cb956b73d2bc service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:50.479448 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 939/1874] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:50 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:25:50.493156 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-55cc7f08-c36f-4324-992f-5498c30d2a7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1caef660a6984e008f92961fb4a74063'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:50.508114 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-55cc7f08-c36f-4324-992f-5498c30d2a7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1caef660a6984e008f92961fb4a74063'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:50.515393 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-55cc7f08-c36f-4324-992f-5498c30d2a7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1caef660a6984e008f92961fb4a74063'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:50.516417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-55cc7f08-c36f-4324-992f-5498c30d2a7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1caef660a6984e008f92961fb4a74063'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:50.525613 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-55cc7f08-c36f-4324-992f-5498c30d2a7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1caef660a6984e008f92961fb4a74063'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:50.533837 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 936/1875] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:25:50 2022] DELETE /identity/v3/users/1caef660a6984e008f92961fb4a74063 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:50.791464 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898407d5-a740-4811-87fc-cb956b73d2bc service cinder] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:50.792438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-898407d5-a740-4811-87fc-cb956b73d2bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:50.805550 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898407d5-a740-4811-87fc-cb956b73d2bc service cinder] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:50.872679 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b5f67-d4f3-4115-b8b4-15473b77fb0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:50.873358 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b5f67-d4f3-4115-b8b4-15473b77fb0c service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:50.873672 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b5f67-d4f3-4115-b8b4-15473b77fb0c service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:50.873943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b5f67-d4f3-4115-b8b4-15473b77fb0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:50.875948 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-915b5f67-d4f3-4115-b8b4-15473b77fb0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:50.955982 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b5f67-d4f3-4115-b8b4-15473b77fb0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:50.957695 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b5f67-d4f3-4115-b8b4-15473b77fb0c service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:50.968496 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 940/1876] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:50 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:51.024852 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc7f08-c36f-4324-992f-5498c30d2a7b admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:51.026714 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-55cc7f08-c36f-4324-992f-5498c30d2a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:51.115512 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc7f08-c36f-4324-992f-5498c30d2a7b admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:51.125822 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a280620-0844-4300-9001-eb36c515d8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:51.126817 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a280620-0844-4300-9001-eb36c515d8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:51.127190 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a280620-0844-4300-9001-eb36c515d8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:51.127525 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a280620-0844-4300-9001-eb36c515d8f7 admin admin] PATH_INFO: `/v3/projects/817eac755ef44c8781459a50f2f0d4a5` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:51.128921 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a280620-0844-4300-9001-eb36c515d8f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=817eac755ef44c8781459a50f2f0d4a5)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:51.132133 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a280620-0844-4300-9001-eb36c515d8f7 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:51.213488 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-1a280620-0844-4300-9001-eb36c515d8f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '817eac755ef44c8781459a50f2f0d4a5', 'request_id': 'req-1a280620-0844-4300-9001-eb36c515d8f7'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:51.222768 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-1a280620-0844-4300-9001-eb36c515d8f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '817eac755ef44c8781459a50f2f0d4a5', 'request_id': 'req-1a280620-0844-4300-9001-eb36c515d8f7'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:51.244214 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-1a280620-0844-4300-9001-eb36c515d8f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '817eac755ef44c8781459a50f2f0d4a5', 'request_id': 'req-1a280620-0844-4300-9001-eb36c515d8f7'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:51.262179 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-1a280620-0844-4300-9001-eb36c515d8f7 admin admin] The token cache is being invalidate because project 817eac755ef44c8781459a50f2f0d4a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:25:51.262469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-1a280620-0844-4300-9001-eb36c515d8f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:51.263364 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-1a280620-0844-4300-9001-eb36c515d8f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:51.265497 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 937/1877] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:25:51 2022] DELETE /identity/v3/projects/817eac755ef44c8781459a50f2f0d4a5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:51.271873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62dc8f7-d0ac-4e57-9211-bead777ded37 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:51.272500 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62dc8f7-d0ac-4e57-9211-bead777ded37 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:51.272962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62dc8f7-d0ac-4e57-9211-bead777ded37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:51.312081 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-f62dc8f7-d0ac-4e57-9211-bead777ded37 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:51.316929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f62dc8f7-d0ac-4e57-9211-bead777ded37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:51.548629 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 941/1878] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:51.557558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce5304-1696-43ff-b01d-552ade2a4005 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:51.557892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce5304-1696-43ff-b01d-552ade2a4005 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:51.558134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce5304-1696-43ff-b01d-552ade2a4005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:51.612290 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-10ce5304-1696-43ff-b01d-552ade2a4005 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:51.613859 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-10ce5304-1696-43ff-b01d-552ade2a4005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:51.637305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 938/1879] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:25:51.641598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62dc8f7-d0ac-4e57-9211-bead777ded37 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:51.659660 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62dc8f7-d0ac-4e57-9211-bead777ded37 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:51.666475 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e78423-5ce7-49b6-b7b8-e3f7bea62c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:51.667770 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e78423-5ce7-49b6-b7b8-e3f7bea62c2b admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:51.668307 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e78423-5ce7-49b6-b7b8-e3f7bea62c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:51.668429 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e78423-5ce7-49b6-b7b8-e3f7bea62c2b admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:51.669225 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e78423-5ce7-49b6-b7b8-e3f7bea62c2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:51.669532 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e78423-5ce7-49b6-b7b8-e3f7bea62c2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:51.671467 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e78423-5ce7-49b6-b7b8-e3f7bea62c2b admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:51.694797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 942/1880] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:25:51.695119 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce5304-1696-43ff-b01d-552ade2a4005 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:51.718939 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce5304-1696-43ff-b01d-552ade2a4005 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:51.726731 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679bf7f-8e5c-49c6-b8ec-28106279fbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:51.728651 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679bf7f-8e5c-49c6-b8ec-28106279fbe8 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:51.728651 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679bf7f-8e5c-49c6-b8ec-28106279fbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:51.729166 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679bf7f-8e5c-49c6-b8ec-28106279fbe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:51.731201 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679bf7f-8e5c-49c6-b8ec-28106279fbe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:51.738314 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679bf7f-8e5c-49c6-b8ec-28106279fbe8 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:51.800202 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 939/1881] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:51 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:51.805074 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e78423-5ce7-49b6-b7b8-e3f7bea62c2b admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:51.823701 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e78423-5ce7-49b6-b7b8-e3f7bea62c2b admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:51.951189 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1219afd-05db-42cf-b8d8-548d25108717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:51.952070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1219afd-05db-42cf-b8d8-548d25108717 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:51.952380 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1219afd-05db-42cf-b8d8-548d25108717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:51.952653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1219afd-05db-42cf-b8d8-548d25108717 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:51.953575 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1219afd-05db-42cf-b8d8-548d25108717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:51.956492 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1219afd-05db-42cf-b8d8-548d25108717 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:51.996985 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 943/1882] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:51 2022] POST /identity/v3/users => generated 284 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:52.001908 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679bf7f-8e5c-49c6-b8ec-28106279fbe8 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:52.016930 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679bf7f-8e5c-49c6-b8ec-28106279fbe8 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:52.024055 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0735b-3ac2-4153-b392-ff40e4ab7aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:52.026034 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0735b-3ac2-4153-b392-ff40e4ab7aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:52.026590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0735b-3ac2-4153-b392-ff40e4ab7aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:52.026590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0735b-3ac2-4153-b392-ff40e4ab7aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:52.027348 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0735b-3ac2-4153-b392-ff40e4ab7aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:52.029055 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0735b-3ac2-4153-b392-ff40e4ab7aa9 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:52.046562 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 940/1883] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:52.046755 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1219afd-05db-42cf-b8d8-548d25108717 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:52.064216 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1219afd-05db-42cf-b8d8-548d25108717 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:52.070465 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df6f63-348b-414f-9862-a9edb0f61a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:52.071361 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df6f63-348b-414f-9862-a9edb0f61a81 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:52.071729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df6f63-348b-414f-9862-a9edb0f61a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:52.072113 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df6f63-348b-414f-9862-a9edb0f61a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:52.072987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df6f63-348b-414f-9862-a9edb0f61a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:52.074700 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df6f63-348b-414f-9862-a9edb0f61a81 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:52.087213 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 944/1884] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:25:52.092398 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0735b-3ac2-4153-b392-ff40e4ab7aa9 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:52.106713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0735b-3ac2-4153-b392-ff40e4ab7aa9 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:52.112492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906384d9-3d92-4c79-9678-3e2a945f7603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:52.113569 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906384d9-3d92-4c79-9678-3e2a945f7603 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:52.113997 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906384d9-3d92-4c79-9678-3e2a945f7603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:52.114524 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906384d9-3d92-4c79-9678-3e2a945f7603 admin admin] PATH_INFO: `/v3/projects/c6945a28cdf94ba981f152191537192b/users/3a8df453359a4954b505f2043db4ec11/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:52.136822 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906384d9-3d92-4c79-9678-3e2a945f7603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6945a28cdf94ba981f152191537192b, user_id=3a8df453359a4954b505f2043db4ec11, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:52.139545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906384d9-3d92-4c79-9678-3e2a945f7603 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:52.156187 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 941/1885] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:52 2022] PUT /identity/v3/projects/c6945a28cdf94ba981f152191537192b/users/3a8df453359a4954b505f2043db4ec11/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:52.171634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c094bab-4d80-47e7-a5e6-d2bc02b73012 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:52.171920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c094bab-4d80-47e7-a5e6-d2bc02b73012 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:52.172222 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c094bab-4d80-47e7-a5e6-d2bc02b73012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:52.204087 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-8c094bab-4d80-47e7-a5e6-d2bc02b73012 None None] MFA Rules not processed for user `3a8df453359a4954b505f2043db4ec11`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:52.205521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8c094bab-4d80-47e7-a5e6-d2bc02b73012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:52.290066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 945/1886] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:52.295250 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906384d9-3d92-4c79-9678-3e2a945f7603 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:52.358504 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906384d9-3d92-4c79-9678-3e2a945f7603 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:52.363825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e526fc2-f108-4237-829a-34eb2e5392ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:52.365475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e526fc2-f108-4237-829a-34eb2e5392ad admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:52.365766 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e526fc2-f108-4237-829a-34eb2e5392ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:52.366040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e526fc2-f108-4237-829a-34eb2e5392ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:52.366735 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e526fc2-f108-4237-829a-34eb2e5392ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:52.368714 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e526fc2-f108-4237-829a-34eb2e5392ad admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:52.394833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 942/1887] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:52 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:52.399891 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c094bab-4d80-47e7-a5e6-d2bc02b73012 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:52.412706 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c094bab-4d80-47e7-a5e6-d2bc02b73012 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:52.473542 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357346e-b2b6-42cd-8455-77bef877c71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:52.474985 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357346e-b2b6-42cd-8455-77bef877c71b admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:52.475373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357346e-b2b6-42cd-8455-77bef877c71b admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:52.475752 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357346e-b2b6-42cd-8455-77bef877c71b admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:52.476601 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357346e-b2b6-42cd-8455-77bef877c71b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:52.478706 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357346e-b2b6-42cd-8455-77bef877c71b admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:52.510265 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 946/1888] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:52 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:52.516086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e526fc2-f108-4237-829a-34eb2e5392ad admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:52.531085 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e526fc2-f108-4237-829a-34eb2e5392ad admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:52.539643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c0042-201a-4464-8e24-15557c61a941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:52.540744 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c0042-201a-4464-8e24-15557c61a941 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:52.541253 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c0042-201a-4464-8e24-15557c61a941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:52.543203 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c0042-201a-4464-8e24-15557c61a941 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:52.544948 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c0042-201a-4464-8e24-15557c61a941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:52.554750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c0042-201a-4464-8e24-15557c61a941 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:52.563186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 943/1889] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:25:52.567476 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357346e-b2b6-42cd-8455-77bef877c71b admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:52.578431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357346e-b2b6-42cd-8455-77bef877c71b admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:52.585617 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23a6f5-d4e8-4f2a-a6bb-084a9fd81873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:52.586530 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23a6f5-d4e8-4f2a-a6bb-084a9fd81873 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:52.586818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23a6f5-d4e8-4f2a-a6bb-084a9fd81873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:52.587097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23a6f5-d4e8-4f2a-a6bb-084a9fd81873 admin admin] PATH_INFO: `/v3/projects/4460c9a8352f4a36be3637343ee110d2/users/f9947b799768452f9a64f2d467088939/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:52.606177 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23a6f5-d4e8-4f2a-a6bb-084a9fd81873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4460c9a8352f4a36be3637343ee110d2, user_id=f9947b799768452f9a64f2d467088939, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:52.609115 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23a6f5-d4e8-4f2a-a6bb-084a9fd81873 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:52.628523 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 947/1890] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:52 2022] PUT /identity/v3/projects/4460c9a8352f4a36be3637343ee110d2/users/f9947b799768452f9a64f2d467088939/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:52.633224 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c0042-201a-4464-8e24-15557c61a941 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:52.644777 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c0042-201a-4464-8e24-15557c61a941 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:52.720978 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929a71f-0278-4d6b-b3a8-d728a3a89f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:52.721841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929a71f-0278-4d6b-b3a8-d728a3a89f7e admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:52.722127 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929a71f-0278-4d6b-b3a8-d728a3a89f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:52.722400 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929a71f-0278-4d6b-b3a8-d728a3a89f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:52.723130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929a71f-0278-4d6b-b3a8-d728a3a89f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:52.725035 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929a71f-0278-4d6b-b3a8-d728a3a89f7e admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:52.740987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 944/1891] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:25:52.744783 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23a6f5-d4e8-4f2a-a6bb-084a9fd81873 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:52.764302 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23a6f5-d4e8-4f2a-a6bb-084a9fd81873 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:52.782568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17feaca-7341-4768-a714-0bd861ef08cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:52.783498 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17feaca-7341-4768-a714-0bd861ef08cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:52.784709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17feaca-7341-4768-a714-0bd861ef08cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:52.784993 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17feaca-7341-4768-a714-0bd861ef08cd admin admin] PATH_INFO: `/v3/projects/4460c9a8352f4a36be3637343ee110d2/users/f9947b799768452f9a64f2d467088939/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:52.787940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17feaca-7341-4768-a714-0bd861ef08cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4460c9a8352f4a36be3637343ee110d2, user_id=f9947b799768452f9a64f2d467088939, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:52.790777 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17feaca-7341-4768-a714-0bd861ef08cd admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:52.809948 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 948/1892] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:25:52 2022] PUT /identity/v3/projects/4460c9a8352f4a36be3637343ee110d2/users/f9947b799768452f9a64f2d467088939/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:25:52.825260 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead3137-7420-4928-9183-a3b8b5e62429 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:52.825701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead3137-7420-4928-9183-a3b8b5e62429 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:52.826106 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead3137-7420-4928-9183-a3b8b5e62429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:52.871443 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-5ead3137-7420-4928-9183-a3b8b5e62429 None None] MFA Rules not processed for user `f9947b799768452f9a64f2d467088939`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:52.875859 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-5ead3137-7420-4928-9183-a3b8b5e62429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:53.031851 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 945/1893] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:52 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:53.070854 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17feaca-7341-4768-a714-0bd861ef08cd admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:53.072777 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-b17feaca-7341-4768-a714-0bd861ef08cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:53.136104 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17feaca-7341-4768-a714-0bd861ef08cd admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:53.142107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdfca1-428a-47a4-bc6a-ce96491291a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:53.142904 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdfca1-428a-47a4-bc6a-ce96491291a7 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:53.144338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdfca1-428a-47a4-bc6a-ce96491291a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:53.144338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdfca1-428a-47a4-bc6a-ce96491291a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:53.155606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bdfca1-428a-47a4-bc6a-ce96491291a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:53.157519 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bdfca1-428a-47a4-bc6a-ce96491291a7 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:53.169763 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 949/1894] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:53 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:53.281344 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead3137-7420-4928-9183-a3b8b5e62429 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:53.292819 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead3137-7420-4928-9183-a3b8b5e62429 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:53.301093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52311e-1b70-4e8e-b03b-669c4ef1a7c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:53.301761 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52311e-1b70-4e8e-b03b-669c4ef1a7c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:53.302600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52311e-1b70-4e8e-b03b-669c4ef1a7c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:53.302879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52311e-1b70-4e8e-b03b-669c4ef1a7c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:53.390577 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52311e-1b70-4e8e-b03b-669c4ef1a7c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:53.392019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52311e-1b70-4e8e-b03b-669c4ef1a7c3 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:53.405422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 946/1895] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:53 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:56.959971 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdfca1-428a-47a4-bc6a-ce96491291a7 service cinder] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:57.048223 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdfca1-428a-47a4-bc6a-ce96491291a7 service cinder] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:57.054452 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03a2ee-caf0-4444-9a6a-cbf412b405bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:57.055329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03a2ee-caf0-4444-9a6a-cbf412b405bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:57.055609 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03a2ee-caf0-4444-9a6a-cbf412b405bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:57.055880 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03a2ee-caf0-4444-9a6a-cbf412b405bc admin admin] PATH_INFO: `/v3/users/3a8df453359a4954b505f2043db4ec11` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:57.057140 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03a2ee-caf0-4444-9a6a-cbf412b405bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a8df453359a4954b505f2043db4ec11)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:57.059070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03a2ee-caf0-4444-9a6a-cbf412b405bc admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:57.113186 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8a03a2ee-caf0-4444-9a6a-cbf412b405bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a8df453359a4954b505f2043db4ec11'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:57.116055 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8a03a2ee-caf0-4444-9a6a-cbf412b405bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a8df453359a4954b505f2043db4ec11'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:57.124670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8a03a2ee-caf0-4444-9a6a-cbf412b405bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a8df453359a4954b505f2043db4ec11'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:57.137703 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8a03a2ee-caf0-4444-9a6a-cbf412b405bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a8df453359a4954b505f2043db4ec11'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:57.152216 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8a03a2ee-caf0-4444-9a6a-cbf412b405bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a8df453359a4954b505f2043db4ec11'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:57.158361 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 950/1896] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:25:56 2022] DELETE /identity/v3/users/3a8df453359a4954b505f2043db4ec11 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:57.163656 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b943791-034f-4d65-b2e9-7cf955454063 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:57.164231 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b943791-034f-4d65-b2e9-7cf955454063 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:57.164231 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b943791-034f-4d65-b2e9-7cf955454063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:57.182064 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-6b943791-034f-4d65-b2e9-7cf955454063 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:57.183613 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-6b943791-034f-4d65-b2e9-7cf955454063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:57.277062 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 947/1897] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:25:57.287990 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03a2ee-caf0-4444-9a6a-cbf412b405bc admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:57.289895 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8a03a2ee-caf0-4444-9a6a-cbf412b405bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:57.357615 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b943791-034f-4d65-b2e9-7cf955454063 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:57.359329 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-6b943791-034f-4d65-b2e9-7cf955454063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:57.362877 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03a2ee-caf0-4444-9a6a-cbf412b405bc admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:57.367073 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c115e02-0050-4513-ac8e-7d9f192f5c27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:57.367736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c115e02-0050-4513-ac8e-7d9f192f5c27 service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:57.368015 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c115e02-0050-4513-ac8e-7d9f192f5c27 service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:57.368322 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c115e02-0050-4513-ac8e-7d9f192f5c27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:57.375820 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b943791-034f-4d65-b2e9-7cf955454063 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:57.378144 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c115e02-0050-4513-ac8e-7d9f192f5c27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:57.379602 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c115e02-0050-4513-ac8e-7d9f192f5c27 service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:57.382824 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6e753-c3fe-4dec-9e34-6a86706db1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:57.384140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6e753-c3fe-4dec-9e34-6a86706db1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:57.384611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6e753-c3fe-4dec-9e34-6a86706db1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:57.385049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6e753-c3fe-4dec-9e34-6a86706db1c3 admin admin] PATH_INFO: `/v3/users/e1aac524fb4d4e73b02b07c764b7a722` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:57.386301 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6e753-c3fe-4dec-9e34-6a86706db1c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1aac524fb4d4e73b02b07c764b7a722)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:57.388657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6e753-c3fe-4dec-9e34-6a86706db1c3 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:57.390267 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 951/1898] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:25:57.451219 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d7e6e753-c3fe-4dec-9e34-6a86706db1c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1aac524fb4d4e73b02b07c764b7a722'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:57.469841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d7e6e753-c3fe-4dec-9e34-6a86706db1c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1aac524fb4d4e73b02b07c764b7a722'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:57.478742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d7e6e753-c3fe-4dec-9e34-6a86706db1c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1aac524fb4d4e73b02b07c764b7a722'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:57.480008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d7e6e753-c3fe-4dec-9e34-6a86706db1c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1aac524fb4d4e73b02b07c764b7a722'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:57.490793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d7e6e753-c3fe-4dec-9e34-6a86706db1c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1aac524fb4d4e73b02b07c764b7a722'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:57.498121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 948/1899] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:25:57 2022] DELETE /identity/v3/users/e1aac524fb4d4e73b02b07c764b7a722 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:25:57.502963 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d46dd-d013-464a-a834-2d5aa3dfcef2 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:57.503778 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d46dd-d013-464a-a834-2d5aa3dfcef2 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:57.504488 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d46dd-d013-464a-a834-2d5aa3dfcef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:57.525986 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-953d46dd-d013-464a-a834-2d5aa3dfcef2 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:57.527353 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-953d46dd-d013-464a-a834-2d5aa3dfcef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:57.604810 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 952/1900] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:57.615745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6e753-c3fe-4dec-9e34-6a86706db1c3 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:57.617535 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-d7e6e753-c3fe-4dec-9e34-6a86706db1c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:57.724318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6e753-c3fe-4dec-9e34-6a86706db1c3 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:57.726887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d46dd-d013-464a-a834-2d5aa3dfcef2 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:57.728376 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-953d46dd-d013-464a-a834-2d5aa3dfcef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:57.729524 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1db8c-651a-4ec1-bdc3-def669e8867f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:57.730198 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1db8c-651a-4ec1-bdc3-def669e8867f service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:57.730480 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1db8c-651a-4ec1-bdc3-def669e8867f service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:57.730859 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1db8c-651a-4ec1-bdc3-def669e8867f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:57.742383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d46dd-d013-464a-a834-2d5aa3dfcef2 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:57.746682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1db8c-651a-4ec1-bdc3-def669e8867f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:57.748378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1db8c-651a-4ec1-bdc3-def669e8867f service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:57.748787 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836702c6-e7f2-45a5-9d4f-4ebc0e0c43d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:57.750037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836702c6-e7f2-45a5-9d4f-4ebc0e0c43d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:57.750037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836702c6-e7f2-45a5-9d4f-4ebc0e0c43d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:57.750251 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836702c6-e7f2-45a5-9d4f-4ebc0e0c43d8 admin admin] PATH_INFO: `/v3/projects/c6945a28cdf94ba981f152191537192b` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:57.751483 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836702c6-e7f2-45a5-9d4f-4ebc0e0c43d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6945a28cdf94ba981f152191537192b)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:57.753367 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836702c6-e7f2-45a5-9d4f-4ebc0e0c43d8 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:57.766769 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 949/1901] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:25:57.807246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-836702c6-e7f2-45a5-9d4f-4ebc0e0c43d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6945a28cdf94ba981f152191537192b', 'request_id': 'req-836702c6-e7f2-45a5-9d4f-4ebc0e0c43d8'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:57.816248 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-836702c6-e7f2-45a5-9d4f-4ebc0e0c43d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6945a28cdf94ba981f152191537192b', 'request_id': 'req-836702c6-e7f2-45a5-9d4f-4ebc0e0c43d8'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:57.824540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-836702c6-e7f2-45a5-9d4f-4ebc0e0c43d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6945a28cdf94ba981f152191537192b', 'request_id': 'req-836702c6-e7f2-45a5-9d4f-4ebc0e0c43d8'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:57.837353 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-836702c6-e7f2-45a5-9d4f-4ebc0e0c43d8 admin admin] The token cache is being invalidate because project c6945a28cdf94ba981f152191537192b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:25:57.837636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-836702c6-e7f2-45a5-9d4f-4ebc0e0c43d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:57.838320 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-836702c6-e7f2-45a5-9d4f-4ebc0e0c43d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:57.840766 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 953/1902] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:25:57 2022] DELETE /identity/v3/projects/c6945a28cdf94ba981f152191537192b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:25:57.846500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1db8c-651a-4ec1-bdc3-def669e8867f service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:57.858234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1db8c-651a-4ec1-bdc3-def669e8867f service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:57.927692 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce588e33-b762-4d4d-8f01-b149d60acc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:57.928609 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce588e33-b762-4d4d-8f01-b149d60acc69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:57.928889 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce588e33-b762-4d4d-8f01-b149d60acc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:57.929161 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce588e33-b762-4d4d-8f01-b149d60acc69 admin admin] PATH_INFO: `/v3/users/f9947b799768452f9a64f2d467088939` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:57.930501 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce588e33-b762-4d4d-8f01-b149d60acc69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9947b799768452f9a64f2d467088939)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:57.932446 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce588e33-b762-4d4d-8f01-b149d60acc69 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:57.992835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-ce588e33-b762-4d4d-8f01-b149d60acc69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9947b799768452f9a64f2d467088939'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:58.004561 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-ce588e33-b762-4d4d-8f01-b149d60acc69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9947b799768452f9a64f2d467088939'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:58.011752 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-ce588e33-b762-4d4d-8f01-b149d60acc69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9947b799768452f9a64f2d467088939'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:58.014404 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-ce588e33-b762-4d4d-8f01-b149d60acc69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9947b799768452f9a64f2d467088939'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:58.023381 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-ce588e33-b762-4d4d-8f01-b149d60acc69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9947b799768452f9a64f2d467088939'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:58.030591 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 950/1903] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:25:57 2022] DELETE /identity/v3/users/f9947b799768452f9a64f2d467088939 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:58.677483 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836702c6-e7f2-45a5-9d4f-4ebc0e0c43d8 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:58.679714 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-836702c6-e7f2-45a5-9d4f-4ebc0e0c43d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:58.711488 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836702c6-e7f2-45a5-9d4f-4ebc0e0c43d8 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:58.729479 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce588e33-b762-4d4d-8f01-b149d60acc69 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:58.730803 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-ce588e33-b762-4d4d-8f01-b149d60acc69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:58.810525 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d72b5d-34ed-40cc-b6de-8233357ecbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:58.813526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d72b5d-34ed-40cc-b6de-8233357ecbd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:58.813924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d72b5d-34ed-40cc-b6de-8233357ecbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:58.814622 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d72b5d-34ed-40cc-b6de-8233357ecbd1 admin admin] PATH_INFO: `/v3/projects/4460c9a8352f4a36be3637343ee110d2` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:58.816120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d72b5d-34ed-40cc-b6de-8233357ecbd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4460c9a8352f4a36be3637343ee110d2)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:58.818425 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d72b5d-34ed-40cc-b6de-8233357ecbd1 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:58.818855 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce588e33-b762-4d4d-8f01-b149d60acc69 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:58.823804 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810063f1-6242-4480-bfdb-3e83341e0b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:58.824755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810063f1-6242-4480-bfdb-3e83341e0b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:58.825036 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810063f1-6242-4480-bfdb-3e83341e0b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:58.825312 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810063f1-6242-4480-bfdb-3e83341e0b32 admin admin] PATH_INFO: `/v3/projects/bf4b318085a34d95978da96d674fd0c0` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:58.826759 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810063f1-6242-4480-bfdb-3e83341e0b32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf4b318085a34d95978da96d674fd0c0)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:58.828788 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810063f1-6242-4480-bfdb-3e83341e0b32 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:58.934510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e5d72b5d-34ed-40cc-b6de-8233357ecbd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4460c9a8352f4a36be3637343ee110d2', 'request_id': 'req-e5d72b5d-34ed-40cc-b6de-8233357ecbd1'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:58.939656 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-810063f1-6242-4480-bfdb-3e83341e0b32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf4b318085a34d95978da96d674fd0c0', 'request_id': 'req-810063f1-6242-4480-bfdb-3e83341e0b32'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:58.949807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-810063f1-6242-4480-bfdb-3e83341e0b32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf4b318085a34d95978da96d674fd0c0', 'request_id': 'req-810063f1-6242-4480-bfdb-3e83341e0b32'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:58.954077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e5d72b5d-34ed-40cc-b6de-8233357ecbd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4460c9a8352f4a36be3637343ee110d2', 'request_id': 'req-e5d72b5d-34ed-40cc-b6de-8233357ecbd1'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:58.964878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-810063f1-6242-4480-bfdb-3e83341e0b32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf4b318085a34d95978da96d674fd0c0', 'request_id': 'req-810063f1-6242-4480-bfdb-3e83341e0b32'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:58.966906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e5d72b5d-34ed-40cc-b6de-8233357ecbd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4460c9a8352f4a36be3637343ee110d2', 'request_id': 'req-e5d72b5d-34ed-40cc-b6de-8233357ecbd1'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:58.991620 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-810063f1-6242-4480-bfdb-3e83341e0b32 admin admin] The token cache is being invalidate because project bf4b318085a34d95978da96d674fd0c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:25:58.992274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-810063f1-6242-4480-bfdb-3e83341e0b32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:58.993181 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-810063f1-6242-4480-bfdb-3e83341e0b32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:58.995009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e5d72b5d-34ed-40cc-b6de-8233357ecbd1 admin admin] The token cache is being invalidate because project 4460c9a8352f4a36be3637343ee110d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:25:58.995436 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e5d72b5d-34ed-40cc-b6de-8233357ecbd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:58.996124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 951/1904] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:25:58 2022] DELETE /identity/v3/projects/bf4b318085a34d95978da96d674fd0c0 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:25:58.996306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e5d72b5d-34ed-40cc-b6de-8233357ecbd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:58.997355 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810063f1-6242-4480-bfdb-3e83341e0b32 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:59.001345 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 954/1905] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:25:58 2022] DELETE /identity/v3/projects/4460c9a8352f4a36be3637343ee110d2 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:59.001345 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d72b5d-34ed-40cc-b6de-8233357ecbd1 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:59.001345 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-e5d72b5d-34ed-40cc-b6de-8233357ecbd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:59.031143 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-810063f1-6242-4480-bfdb-3e83341e0b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:59.085800 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d72b5d-34ed-40cc-b6de-8233357ecbd1 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:59.157491 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7b644-e5b8-492c-ab33-6260f439ba93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:59.158498 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7b644-e5b8-492c-ab33-6260f439ba93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:59.158864 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7b644-e5b8-492c-ab33-6260f439ba93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:59.159206 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7b644-e5b8-492c-ab33-6260f439ba93 admin admin] PATH_INFO: `/v3/users/8cdefc74b3cf45bbbefbcee16a6dcb5e` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:59.160670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7b644-e5b8-492c-ab33-6260f439ba93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cdefc74b3cf45bbbefbcee16a6dcb5e)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:59.164014 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7b644-e5b8-492c-ab33-6260f439ba93 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:59.226813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810063f1-6242-4480-bfdb-3e83341e0b32 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:59.232446 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed265f9-b2be-4721-9561-79cd9ec1e863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:59.233429 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed265f9-b2be-4721-9561-79cd9ec1e863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:59.233832 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed265f9-b2be-4721-9561-79cd9ec1e863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:59.234179 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed265f9-b2be-4721-9561-79cd9ec1e863 admin admin] PATH_INFO: `/v3/users/0c03e50ea66b4cceb694ec78d7134461` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:59.235751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed265f9-b2be-4721-9561-79cd9ec1e863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c03e50ea66b4cceb694ec78d7134461)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:59.237933 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed265f9-b2be-4721-9561-79cd9ec1e863 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:59.264457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-08e7b644-e5b8-492c-ab33-6260f439ba93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cdefc74b3cf45bbbefbcee16a6dcb5e'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:59.265189 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-08e7b644-e5b8-492c-ab33-6260f439ba93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cdefc74b3cf45bbbefbcee16a6dcb5e'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:59.283821 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-08e7b644-e5b8-492c-ab33-6260f439ba93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cdefc74b3cf45bbbefbcee16a6dcb5e'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:59.306022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-08e7b644-e5b8-492c-ab33-6260f439ba93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cdefc74b3cf45bbbefbcee16a6dcb5e'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:59.315204 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9ed265f9-b2be-4721-9561-79cd9ec1e863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c03e50ea66b4cceb694ec78d7134461'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:59.340374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9ed265f9-b2be-4721-9561-79cd9ec1e863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c03e50ea66b4cceb694ec78d7134461'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:59.346530 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-08e7b644-e5b8-492c-ab33-6260f439ba93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cdefc74b3cf45bbbefbcee16a6dcb5e'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:59.351932 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9ed265f9-b2be-4721-9561-79cd9ec1e863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c03e50ea66b4cceb694ec78d7134461'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:59.356680 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9ed265f9-b2be-4721-9561-79cd9ec1e863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c03e50ea66b4cceb694ec78d7134461'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:59.360263 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 955/1906] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:25:58 2022] DELETE /identity/v3/users/8cdefc74b3cf45bbbefbcee16a6dcb5e => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:59.361792 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a289b4-0aa1-42b5-a282-1686bbbc0a15 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:59.362153 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a289b4-0aa1-42b5-a282-1686bbbc0a15 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:59.365297 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a289b4-0aa1-42b5-a282-1686bbbc0a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:59.385172 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9ed265f9-b2be-4721-9561-79cd9ec1e863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c03e50ea66b4cceb694ec78d7134461'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:25:59.396464 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 952/1907] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:25:58 2022] DELETE /identity/v3/users/0c03e50ea66b4cceb694ec78d7134461 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:25:59.398498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0f0ff-36a2-48ad-8de7-1ab592e45554 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:59.398948 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0f0ff-36a2-48ad-8de7-1ab592e45554 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:59.399271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0f0ff-36a2-48ad-8de7-1ab592e45554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:59.409984 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-80a289b4-0aa1-42b5-a282-1686bbbc0a15 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:59.411709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-80a289b4-0aa1-42b5-a282-1686bbbc0a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:59.437347 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-63e0f0ff-36a2-48ad-8de7-1ab592e45554 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:59.450005 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-63e0f0ff-36a2-48ad-8de7-1ab592e45554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:59.547533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 956/1908] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:59.557759 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e174614-cc7f-4581-8e33-2679f8168d0f None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:59.558111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e174614-cc7f-4581-8e33-2679f8168d0f None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:59.558342 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e174614-cc7f-4581-8e33-2679f8168d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:59.560104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 953/1909] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:59.572315 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0f0ff-36a2-48ad-8de7-1ab592e45554 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:59.573849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-63e0f0ff-36a2-48ad-8de7-1ab592e45554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:59.592709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-1e174614-cc7f-4581-8e33-2679f8168d0f None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:25:59.594426 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-1e174614-cc7f-4581-8e33-2679f8168d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:25:59.619952 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 957/1910] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:25:59.621360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e174614-cc7f-4581-8e33-2679f8168d0f None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:59.633273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e174614-cc7f-4581-8e33-2679f8168d0f None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:59.640697 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba6304-cff2-496b-b17e-f1ec37d43214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:59.641745 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba6304-cff2-496b-b17e-f1ec37d43214 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:59.642703 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba6304-cff2-496b-b17e-f1ec37d43214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:59.642703 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba6304-cff2-496b-b17e-f1ec37d43214 admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:59.643908 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba6304-cff2-496b-b17e-f1ec37d43214 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:25:59.644376 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba6304-cff2-496b-b17e-f1ec37d43214 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:59.662792 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba6304-cff2-496b-b17e-f1ec37d43214 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:59.702173 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 958/1911] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:25:59.703103 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba6304-cff2-496b-b17e-f1ec37d43214 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:59.735990 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba6304-cff2-496b-b17e-f1ec37d43214 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:59.741228 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0f0ff-36a2-48ad-8de7-1ab592e45554 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:59.751300 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e1e41-623a-48ff-877b-3e6667fe4c37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:59.752280 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adba53-3094-48b8-a09d-d4d5d671462b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:59.753612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e1e41-623a-48ff-877b-3e6667fe4c37 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:59.753727 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adba53-3094-48b8-a09d-d4d5d671462b admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:59.753892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adba53-3094-48b8-a09d-d4d5d671462b admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:59.754181 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adba53-3094-48b8-a09d-d4d5d671462b admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:59.754680 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e1e41-623a-48ff-877b-3e6667fe4c37 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:59.755655 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30adba53-3094-48b8-a09d-d4d5d671462b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:59.755938 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e1e41-623a-48ff-877b-3e6667fe4c37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:59.758171 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30adba53-3094-48b8-a09d-d4d5d671462b admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:59.769301 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e1e41-623a-48ff-877b-3e6667fe4c37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:59.771624 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e1e41-623a-48ff-877b-3e6667fe4c37 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:59.783207 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 954/1912] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:25:59.816677 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 959/1913] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:25:59 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:59.823181 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e1e41-623a-48ff-877b-3e6667fe4c37 service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:59.841060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e1e41-623a-48ff-877b-3e6667fe4c37 service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:59.931576 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441bc26-ee82-4e1c-99d0-8f6bb1892f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:59.932442 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441bc26-ee82-4e1c-99d0-8f6bb1892f5c admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:59.932739 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441bc26-ee82-4e1c-99d0-8f6bb1892f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:59.933017 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441bc26-ee82-4e1c-99d0-8f6bb1892f5c admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:59.934210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441bc26-ee82-4e1c-99d0-8f6bb1892f5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:59.936144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441bc26-ee82-4e1c-99d0-8f6bb1892f5c admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:25:59.964917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 955/1914] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:25:59 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:25:59.968837 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adba53-3094-48b8-a09d-d4d5d671462b admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:25:59.982312 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adba53-3094-48b8-a09d-d4d5d671462b admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:25:59.988021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657ce7b-4bfa-4fc6-9fd4-c01ca2577a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:25:59.988735 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657ce7b-4bfa-4fc6-9fd4-c01ca2577a34 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:25:59.989016 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657ce7b-4bfa-4fc6-9fd4-c01ca2577a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:25:59.989740 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657ce7b-4bfa-4fc6-9fd4-c01ca2577a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:25:59.990771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657ce7b-4bfa-4fc6-9fd4-c01ca2577a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:25:59.992422 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657ce7b-4bfa-4fc6-9fd4-c01ca2577a34 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:00.004069 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 960/1915] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:26:00.008940 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441bc26-ee82-4e1c-99d0-8f6bb1892f5c admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:00.022672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441bc26-ee82-4e1c-99d0-8f6bb1892f5c admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:00.028551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c00462-2909-41d8-8e54-fcb820bf94d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:00.029355 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c00462-2909-41d8-8e54-fcb820bf94d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:00.029646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c00462-2909-41d8-8e54-fcb820bf94d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:00.029969 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c00462-2909-41d8-8e54-fcb820bf94d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:00.030951 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c00462-2909-41d8-8e54-fcb820bf94d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:00.032759 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c00462-2909-41d8-8e54-fcb820bf94d4 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:00.050154 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 956/1916] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:00.052103 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657ce7b-4bfa-4fc6-9fd4-c01ca2577a34 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:00.064998 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657ce7b-4bfa-4fc6-9fd4-c01ca2577a34 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:00.073930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d41d5a-25cb-4ddd-837f-d83e75bf03a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:00.075296 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d41d5a-25cb-4ddd-837f-d83e75bf03a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:00.075778 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d41d5a-25cb-4ddd-837f-d83e75bf03a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:00.076277 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d41d5a-25cb-4ddd-837f-d83e75bf03a7 admin admin] PATH_INFO: `/v3/projects/fde24d86db3d4abda01df90f54997dac/users/9723109f371e4d0faa073162d7124db2/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:00.087154 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c00462-2909-41d8-8e54-fcb820bf94d4 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:00.089906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-84c00462-2909-41d8-8e54-fcb820bf94d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:00.097128 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d41d5a-25cb-4ddd-837f-d83e75bf03a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde24d86db3d4abda01df90f54997dac, user_id=9723109f371e4d0faa073162d7124db2, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:00.100576 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d41d5a-25cb-4ddd-837f-d83e75bf03a7 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:00.124199 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c00462-2909-41d8-8e54-fcb820bf94d4 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:00.136775 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 961/1917] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:00 2022] PUT /identity/v3/projects/fde24d86db3d4abda01df90f54997dac/users/9723109f371e4d0faa073162d7124db2/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:00.140816 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2878e-c6f0-4063-a0ee-a90d93906ed5 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:00.140816 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2878e-c6f0-4063-a0ee-a90d93906ed5 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:00.141112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2878e-c6f0-4063-a0ee-a90d93906ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:00.174758 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-ddf2878e-c6f0-4063-a0ee-a90d93906ed5 None None] MFA Rules not processed for user `9723109f371e4d0faa073162d7124db2`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:00.176011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-ddf2878e-c6f0-4063-a0ee-a90d93906ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:00.221385 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1048b10-411a-49cf-9379-b8f0bb8f90d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:00.222403 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1048b10-411a-49cf-9379-b8f0bb8f90d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:00.222787 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1048b10-411a-49cf-9379-b8f0bb8f90d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:00.223205 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1048b10-411a-49cf-9379-b8f0bb8f90d9 admin admin] PATH_INFO: `/v3/projects/2b281c0fbe46459288bcef236ebed029` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:00.224958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1048b10-411a-49cf-9379-b8f0bb8f90d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b281c0fbe46459288bcef236ebed029)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:00.227508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1048b10-411a-49cf-9379-b8f0bb8f90d9 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:00.283765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 962/1918] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:26:00.288646 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2878e-c6f0-4063-a0ee-a90d93906ed5 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:00.301324 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c1048b10-411a-49cf-9379-b8f0bb8f90d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b281c0fbe46459288bcef236ebed029', 'request_id': 'req-c1048b10-411a-49cf-9379-b8f0bb8f90d9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:00.307533 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c1048b10-411a-49cf-9379-b8f0bb8f90d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b281c0fbe46459288bcef236ebed029', 'request_id': 'req-c1048b10-411a-49cf-9379-b8f0bb8f90d9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:00.314105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2878e-c6f0-4063-a0ee-a90d93906ed5 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:00.318015 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c1048b10-411a-49cf-9379-b8f0bb8f90d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b281c0fbe46459288bcef236ebed029', 'request_id': 'req-c1048b10-411a-49cf-9379-b8f0bb8f90d9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:00.334767 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c1048b10-411a-49cf-9379-b8f0bb8f90d9 admin admin] The token cache is being invalidate because project 2b281c0fbe46459288bcef236ebed029 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:00.334767 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c1048b10-411a-49cf-9379-b8f0bb8f90d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:00.335341 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c1048b10-411a-49cf-9379-b8f0bb8f90d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:00.337433 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 957/1919] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:00 2022] DELETE /identity/v3/projects/2b281c0fbe46459288bcef236ebed029 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:00.343009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d0b4f-109d-415b-87a0-d76a41428d02 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:00.343560 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d0b4f-109d-415b-87a0-d76a41428d02 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:00.343905 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d0b4f-109d-415b-87a0-d76a41428d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:00.376065 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-036d0b4f-109d-415b-87a0-d76a41428d02 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:00.377305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-036d0b4f-109d-415b-87a0-d76a41428d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:00.447797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55671201-562e-4a4b-8f35-707a7aa212e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:00.448523 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55671201-562e-4a4b-8f35-707a7aa212e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:00.448806 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55671201-562e-4a4b-8f35-707a7aa212e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:00.449183 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55671201-562e-4a4b-8f35-707a7aa212e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:00.449947 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55671201-562e-4a4b-8f35-707a7aa212e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:00.452193 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55671201-562e-4a4b-8f35-707a7aa212e8 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:00.458708 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 958/1920] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:26:00.465646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d0b4f-109d-415b-87a0-d76a41428d02 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:00.468581 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-036d0b4f-109d-415b-87a0-d76a41428d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:00.484445 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d0b4f-109d-415b-87a0-d76a41428d02 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:00.490477 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a6f72-cbdf-4b38-94c6-ec33a2108e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:00.491520 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a6f72-cbdf-4b38-94c6-ec33a2108e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:00.491971 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a6f72-cbdf-4b38-94c6-ec33a2108e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:00.492289 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a6f72-cbdf-4b38-94c6-ec33a2108e41 admin admin] PATH_INFO: `/v3/projects/cd401d1a905342f6a45cd1ace678a6a4` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:00.493908 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a6f72-cbdf-4b38-94c6-ec33a2108e41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd401d1a905342f6a45cd1ace678a6a4)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:00.497097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 963/1921] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:00 2022] POST /identity/v3/projects => generated 379 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:00.497242 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a6f72-cbdf-4b38-94c6-ec33a2108e41 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:00.497421 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4747d-605b-428c-bcd5-34cc61c95299 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:00.497421 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4747d-605b-428c-bcd5-34cc61c95299 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:00.497421 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4747d-605b-428c-bcd5-34cc61c95299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:00.520090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-ced4747d-605b-428c-bcd5-34cc61c95299 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:00.522059 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-ced4747d-605b-428c-bcd5-34cc61c95299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:00.558561 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d16a6f72-cbdf-4b38-94c6-ec33a2108e41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd401d1a905342f6a45cd1ace678a6a4', 'request_id': 'req-d16a6f72-cbdf-4b38-94c6-ec33a2108e41'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:00.566406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d16a6f72-cbdf-4b38-94c6-ec33a2108e41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd401d1a905342f6a45cd1ace678a6a4', 'request_id': 'req-d16a6f72-cbdf-4b38-94c6-ec33a2108e41'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:00.576475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d16a6f72-cbdf-4b38-94c6-ec33a2108e41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd401d1a905342f6a45cd1ace678a6a4', 'request_id': 'req-d16a6f72-cbdf-4b38-94c6-ec33a2108e41'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:00.594725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d16a6f72-cbdf-4b38-94c6-ec33a2108e41 admin admin] The token cache is being invalidate because project cd401d1a905342f6a45cd1ace678a6a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:00.595018 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d16a6f72-cbdf-4b38-94c6-ec33a2108e41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:00.595677 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d16a6f72-cbdf-4b38-94c6-ec33a2108e41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:00.597510 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 959/1922] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:00 2022] DELETE /identity/v3/projects/cd401d1a905342f6a45cd1ace678a6a4 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:00.599009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 964/1923] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:00.600947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a6f72-cbdf-4b38-94c6-ec33a2108e41 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:00.601798 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4747d-605b-428c-bcd5-34cc61c95299 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:00.602461 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-d16a6f72-cbdf-4b38-94c6-ec33a2108e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:00.612479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4747d-605b-428c-bcd5-34cc61c95299 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:00.682527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a6f72-cbdf-4b38-94c6-ec33a2108e41 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:00.683012 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb465f98-cf72-46f4-9b67-27ee11106145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:00.684486 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb465f98-cf72-46f4-9b67-27ee11106145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:00.685108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb465f98-cf72-46f4-9b67-27ee11106145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:00.685563 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb465f98-cf72-46f4-9b67-27ee11106145 admin admin] PATH_INFO: `/v3/users/22b5568083a54016a4164dcb8ceeec41` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:00.687478 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb465f98-cf72-46f4-9b67-27ee11106145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22b5568083a54016a4164dcb8ceeec41)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:00.690249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aaa3ca-c3d5-4d5c-9ade-a2d0d842b034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:00.691005 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb465f98-cf72-46f4-9b67-27ee11106145 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:00.691500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aaa3ca-c3d5-4d5c-9ade-a2d0d842b034 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:00.692036 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aaa3ca-c3d5-4d5c-9ade-a2d0d842b034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:00.692604 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aaa3ca-c3d5-4d5c-9ade-a2d0d842b034 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:00.694389 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aaa3ca-c3d5-4d5c-9ade-a2d0d842b034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:00.697745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aaa3ca-c3d5-4d5c-9ade-a2d0d842b034 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:00.721832 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 960/1924] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:00 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:00.722810 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aaa3ca-c3d5-4d5c-9ade-a2d0d842b034 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:00.725534 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-c6aaa3ca-c3d5-4d5c-9ade-a2d0d842b034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:00.737625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aaa3ca-c3d5-4d5c-9ade-a2d0d842b034 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:00.742998 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368acd6c-1b6d-4036-bc12-0780f056b9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:00.743657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368acd6c-1b6d-4036-bc12-0780f056b9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:00.743946 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368acd6c-1b6d-4036-bc12-0780f056b9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:00.744270 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368acd6c-1b6d-4036-bc12-0780f056b9d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:00.744999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368acd6c-1b6d-4036-bc12-0780f056b9d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:00.745312 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368acd6c-1b6d-4036-bc12-0780f056b9d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:00.746344 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-fb465f98-cf72-46f4-9b67-27ee11106145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22b5568083a54016a4164dcb8ceeec41'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:00.746900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368acd6c-1b6d-4036-bc12-0780f056b9d6 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:00.747231 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-fb465f98-cf72-46f4-9b67-27ee11106145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22b5568083a54016a4164dcb8ceeec41'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:00.754280 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-fb465f98-cf72-46f4-9b67-27ee11106145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22b5568083a54016a4164dcb8ceeec41'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:00.760343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 961/1925] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:00.761817 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368acd6c-1b6d-4036-bc12-0780f056b9d6 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:00.768110 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-fb465f98-cf72-46f4-9b67-27ee11106145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22b5568083a54016a4164dcb8ceeec41'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:00.773058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368acd6c-1b6d-4036-bc12-0780f056b9d6 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:00.780376 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a5dc4-8e1a-4b9a-a47b-c47009cac682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:00.781007 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a5dc4-8e1a-4b9a-a47b-c47009cac682 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:00.781295 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a5dc4-8e1a-4b9a-a47b-c47009cac682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:00.781575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a5dc4-8e1a-4b9a-a47b-c47009cac682 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:00.782295 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a5dc4-8e1a-4b9a-a47b-c47009cac682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:00.783157 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-fb465f98-cf72-46f4-9b67-27ee11106145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22b5568083a54016a4164dcb8ceeec41'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:00.783908 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a5dc4-8e1a-4b9a-a47b-c47009cac682 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:00.793496 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 965/1926] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:00 2022] DELETE /identity/v3/users/22b5568083a54016a4164dcb8ceeec41 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:26:00.793496 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb465f98-cf72-46f4-9b67-27ee11106145 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:00.793496 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-fb465f98-cf72-46f4-9b67-27ee11106145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:00.808524 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 962/1927] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:00.809767 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a5dc4-8e1a-4b9a-a47b-c47009cac682 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:00.811485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-c28a5dc4-8e1a-4b9a-a47b-c47009cac682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:00.824685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a5dc4-8e1a-4b9a-a47b-c47009cac682 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:00.881413 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb465f98-cf72-46f4-9b67-27ee11106145 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:00.889152 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b57e5a-591b-4fd9-9c74-411f80e0811d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:00.889978 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b57e5a-591b-4fd9-9c74-411f80e0811d admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:00.890413 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b57e5a-591b-4fd9-9c74-411f80e0811d admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:00.890735 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b57e5a-591b-4fd9-9c74-411f80e0811d admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:00.891439 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b57e5a-591b-4fd9-9c74-411f80e0811d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:00.894684 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b57e5a-591b-4fd9-9c74-411f80e0811d admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:00.923772 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b70c0b-5689-48d3-a9ef-e0331da5dc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:00.924637 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b70c0b-5689-48d3-a9ef-e0331da5dc1b admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:00.924926 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b70c0b-5689-48d3-a9ef-e0331da5dc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:00.925203 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b70c0b-5689-48d3-a9ef-e0331da5dc1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:00.930033 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b70c0b-5689-48d3-a9ef-e0331da5dc1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:00.931651 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b70c0b-5689-48d3-a9ef-e0331da5dc1b admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:00.947877 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 966/1928] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:00 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:00.954456 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b57e5a-591b-4fd9-9c74-411f80e0811d admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:00.975572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 963/1929] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:00.976634 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b70c0b-5689-48d3-a9ef-e0331da5dc1b admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:01.001975 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b70c0b-5689-48d3-a9ef-e0331da5dc1b admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:01.077786 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb4eb3-e0d0-4334-bc76-2fd601cc268b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:01.078969 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb4eb3-e0d0-4334-bc76-2fd601cc268b admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:01.079363 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb4eb3-e0d0-4334-bc76-2fd601cc268b admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:01.079601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb4eb3-e0d0-4334-bc76-2fd601cc268b admin admin] PATH_INFO: `/v3/projects/5df994827477494d9bf518ec38e2c7b3/users/c1e8a4af706247e48a08a872a0c177d9/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:01.107451 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb4eb3-e0d0-4334-bc76-2fd601cc268b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df994827477494d9bf518ec38e2c7b3, user_id=c1e8a4af706247e48a08a872a0c177d9, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:01.113039 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b57e5a-591b-4fd9-9c74-411f80e0811d admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:01.124739 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb4eb3-e0d0-4334-bc76-2fd601cc268b admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:01.125569 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5d4ab-cb77-4a5d-a466-99f646ce6970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:01.126261 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5d4ab-cb77-4a5d-a466-99f646ce6970 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:01.126541 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5d4ab-cb77-4a5d-a466-99f646ce6970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:01.126809 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5d4ab-cb77-4a5d-a466-99f646ce6970 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:01.131054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5d4ab-cb77-4a5d-a466-99f646ce6970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:01.133088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5d4ab-cb77-4a5d-a466-99f646ce6970 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:01.153766 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 964/1930] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:00 2022] PUT /identity/v3/projects/5df994827477494d9bf518ec38e2c7b3/users/c1e8a4af706247e48a08a872a0c177d9/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:01.164615 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ae9fc-7c55-442c-8802-89ea9ac51c5a None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:01.164908 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ae9fc-7c55-442c-8802-89ea9ac51c5a None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:01.165194 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ae9fc-7c55-442c-8802-89ea9ac51c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:01.194967 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 967/1931] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:00 2022] POST /identity/v3/users => generated 288 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:26:01.199795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5d4ab-cb77-4a5d-a466-99f646ce6970 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:01.233484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5d4ab-cb77-4a5d-a466-99f646ce6970 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:01.251146 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-760ae9fc-7c55-442c-8802-89ea9ac51c5a None None] MFA Rules not processed for user `c1e8a4af706247e48a08a872a0c177d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:01.252400 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-760ae9fc-7c55-442c-8802-89ea9ac51c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:01.322146 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7210a-f815-45e0-b11e-c1f8b4acbab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:01.322845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7210a-f815-45e0-b11e-c1f8b4acbab8 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:01.323066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7210a-f815-45e0-b11e-c1f8b4acbab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:01.323338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7210a-f815-45e0-b11e-c1f8b4acbab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:01.324188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7210a-f815-45e0-b11e-c1f8b4acbab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:01.325728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7210a-f815-45e0-b11e-c1f8b4acbab8 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:01.339193 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 968/1932] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:01.346777 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7210a-f815-45e0-b11e-c1f8b4acbab8 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:01.357402 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 965/1933] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:01.358146 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ae9fc-7c55-442c-8802-89ea9ac51c5a None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:01.361150 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7210a-f815-45e0-b11e-c1f8b4acbab8 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:01.367010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-760ae9fc-7c55-442c-8802-89ea9ac51c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:01.374281 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fac2a9-7f94-4aa5-8f17-fbe676f62b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:01.374960 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fac2a9-7f94-4aa5-8f17-fbe676f62b04 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:01.375237 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fac2a9-7f94-4aa5-8f17-fbe676f62b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:01.375505 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fac2a9-7f94-4aa5-8f17-fbe676f62b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:01.376264 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fac2a9-7f94-4aa5-8f17-fbe676f62b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:01.386025 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fac2a9-7f94-4aa5-8f17-fbe676f62b04 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:01.392264 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ae9fc-7c55-442c-8802-89ea9ac51c5a None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:01.397873 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df94b0-64f3-4e39-a8d5-d52987ecf466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:01.398854 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df94b0-64f3-4e39-a8d5-d52987ecf466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:01.399118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df94b0-64f3-4e39-a8d5-d52987ecf466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:01.399459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df94b0-64f3-4e39-a8d5-d52987ecf466 admin admin] PATH_INFO: `/v3/projects/030200e535244ab99fb02da8c736ab44` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:01.400785 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 969/1934] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:01.401404 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fac2a9-7f94-4aa5-8f17-fbe676f62b04 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:01.403862 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df94b0-64f3-4e39-a8d5-d52987ecf466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=030200e535244ab99fb02da8c736ab44)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:01.405887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df94b0-64f3-4e39-a8d5-d52987ecf466 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:01.414112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fac2a9-7f94-4aa5-8f17-fbe676f62b04 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:01.418891 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318443f2-c32e-4c7d-aa2e-2ab49b1cdf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:01.419588 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318443f2-c32e-4c7d-aa2e-2ab49b1cdf54 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:01.420136 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318443f2-c32e-4c7d-aa2e-2ab49b1cdf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:01.420403 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318443f2-c32e-4c7d-aa2e-2ab49b1cdf54 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:01.421076 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318443f2-c32e-4c7d-aa2e-2ab49b1cdf54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:01.423013 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318443f2-c32e-4c7d-aa2e-2ab49b1cdf54 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:01.451274 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 970/1935] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:01 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:01.452096 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318443f2-c32e-4c7d-aa2e-2ab49b1cdf54 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:01.458331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-88df94b0-64f3-4e39-a8d5-d52987ecf466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '030200e535244ab99fb02da8c736ab44', 'request_id': 'req-88df94b0-64f3-4e39-a8d5-d52987ecf466'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:01.465073 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-88df94b0-64f3-4e39-a8d5-d52987ecf466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '030200e535244ab99fb02da8c736ab44', 'request_id': 'req-88df94b0-64f3-4e39-a8d5-d52987ecf466'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:01.474924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-88df94b0-64f3-4e39-a8d5-d52987ecf466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '030200e535244ab99fb02da8c736ab44', 'request_id': 'req-88df94b0-64f3-4e39-a8d5-d52987ecf466'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:01.486470 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-88df94b0-64f3-4e39-a8d5-d52987ecf466 admin admin] The token cache is being invalidate because project 030200e535244ab99fb02da8c736ab44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:01.486768 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-88df94b0-64f3-4e39-a8d5-d52987ecf466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:01.487438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-88df94b0-64f3-4e39-a8d5-d52987ecf466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:01.489783 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 966/1936] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:01 2022] DELETE /identity/v3/projects/030200e535244ab99fb02da8c736ab44 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:01.490881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df94b0-64f3-4e39-a8d5-d52987ecf466 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:01.492192 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-88df94b0-64f3-4e39-a8d5-d52987ecf466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:01.518379 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318443f2-c32e-4c7d-aa2e-2ab49b1cdf54 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:01.524145 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3f2f7-2709-48ec-90ec-80acf8e47c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:01.525072 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3f2f7-2709-48ec-90ec-80acf8e47c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:01.525444 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3f2f7-2709-48ec-90ec-80acf8e47c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:01.525723 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3f2f7-2709-48ec-90ec-80acf8e47c1f admin admin] PATH_INFO: `/v3/projects/c676953f22ba4ec2961739021099bd91/users/c7763d12953d4e3ea746911368024c6a/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:01.541238 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3f2f7-2709-48ec-90ec-80acf8e47c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c676953f22ba4ec2961739021099bd91, user_id=c7763d12953d4e3ea746911368024c6a, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:01.543891 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3f2f7-2709-48ec-90ec-80acf8e47c1f admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:01.557398 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df94b0-64f3-4e39-a8d5-d52987ecf466 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:01.557772 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 971/1937] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:01 2022] PUT /identity/v3/projects/c676953f22ba4ec2961739021099bd91/users/c7763d12953d4e3ea746911368024c6a/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:01.559117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b7806-1e8a-4377-b526-2da7777e07f1 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:01.559410 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b7806-1e8a-4377-b526-2da7777e07f1 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:01.559692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b7806-1e8a-4377-b526-2da7777e07f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:01.579397 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-da5b7806-1e8a-4377-b526-2da7777e07f1 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:01.580960 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-da5b7806-1e8a-4377-b526-2da7777e07f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:01.624813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71184448-45fd-4866-9582-5975ec744574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:01.625588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71184448-45fd-4866-9582-5975ec744574 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:01.628195 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71184448-45fd-4866-9582-5975ec744574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:01.628195 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71184448-45fd-4866-9582-5975ec744574 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:01.628195 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71184448-45fd-4866-9582-5975ec744574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:01.628983 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71184448-45fd-4866-9582-5975ec744574 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:01.652140 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 972/1939] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:01.652435 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 967/1939] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:01 2022] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:01.653865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05120d5a-1ed3-4f2e-b4a5-4100a25a1455 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:01.654149 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05120d5a-1ed3-4f2e-b4a5-4100a25a1455 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:01.654421 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05120d5a-1ed3-4f2e-b4a5-4100a25a1455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:01.657773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71184448-45fd-4866-9582-5975ec744574 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:01.670857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71184448-45fd-4866-9582-5975ec744574 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:01.677088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b3441-cab2-480f-9b39-17d84c1165d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:01.678072 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b3441-cab2-480f-9b39-17d84c1165d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:01.678705 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b3441-cab2-480f-9b39-17d84c1165d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:01.678844 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b3441-cab2-480f-9b39-17d84c1165d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:01.679482 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b3441-cab2-480f-9b39-17d84c1165d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:01.681156 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b3441-cab2-480f-9b39-17d84c1165d5 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:01.683589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-05120d5a-1ed3-4f2e-b4a5-4100a25a1455 None None] MFA Rules not processed for user `c7763d12953d4e3ea746911368024c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:01.684976 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-05120d5a-1ed3-4f2e-b4a5-4100a25a1455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:01.696892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 968/1940] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:26:01.696892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9820a-c1ff-40bf-a322-3be8a1757af1 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:01.696892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9820a-c1ff-40bf-a322-3be8a1757af1 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:01.696892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9820a-c1ff-40bf-a322-3be8a1757af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:01.715880 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-35c9820a-c1ff-40bf-a322-3be8a1757af1 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:01.717142 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-35c9820a-c1ff-40bf-a322-3be8a1757af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:01.726917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 969/1941] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:01.727819 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9820a-c1ff-40bf-a322-3be8a1757af1 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:01.737449 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9820a-c1ff-40bf-a322-3be8a1757af1 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:01.743282 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dd5db-ca9e-4841-9b41-0742af256cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:01.744235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dd5db-ca9e-4841-9b41-0742af256cf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:01.744538 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dd5db-ca9e-4841-9b41-0742af256cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:01.744821 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dd5db-ca9e-4841-9b41-0742af256cf7 admin admin] PATH_INFO: `/v3/projects/7cf615b0ab344b459f89499f5f9a5d9a/users/6b14968ad84848d9909ec948a0236395/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:01.761706 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 973/1942] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:01.763181 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05120d5a-1ed3-4f2e-b4a5-4100a25a1455 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:01.766510 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3dd5db-ca9e-4841-9b41-0742af256cf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf615b0ab344b459f89499f5f9a5d9a, user_id=6b14968ad84848d9909ec948a0236395, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:01.770797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3dd5db-ca9e-4841-9b41-0742af256cf7 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:01.775090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05120d5a-1ed3-4f2e-b4a5-4100a25a1455 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:01.780076 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be5c58-ec9b-4a77-8f93-c5faeb7322c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:01.780909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be5c58-ec9b-4a77-8f93-c5faeb7322c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:01.781224 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be5c58-ec9b-4a77-8f93-c5faeb7322c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:01.781576 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be5c58-ec9b-4a77-8f93-c5faeb7322c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:01.782514 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be5c58-ec9b-4a77-8f93-c5faeb7322c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:01.782885 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be5c58-ec9b-4a77-8f93-c5faeb7322c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:01.784591 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be5c58-ec9b-4a77-8f93-c5faeb7322c5 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:01.786868 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 970/1943] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:01 2022] PUT /identity/v3/projects/7cf615b0ab344b459f89499f5f9a5d9a/users/6b14968ad84848d9909ec948a0236395/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:01.787683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dd5db-ca9e-4841-9b41-0742af256cf7 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:01.789302 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-ed3dd5db-ca9e-4841-9b41-0742af256cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:01.800572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 974/1944] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:01.801362 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be5c58-ec9b-4a77-8f93-c5faeb7322c5 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:01.811938 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be5c58-ec9b-4a77-8f93-c5faeb7322c5 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:01.900192 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dd5db-ca9e-4841-9b41-0742af256cf7 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:01.907850 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44cdf8-4cb2-40cc-aff5-77228d908bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:01.908757 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44cdf8-4cb2-40cc-aff5-77228d908bbb admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:01.911955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44cdf8-4cb2-40cc-aff5-77228d908bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:01.912388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44cdf8-4cb2-40cc-aff5-77228d908bbb admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:01.913262 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44cdf8-4cb2-40cc-aff5-77228d908bbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:01.915646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44cdf8-4cb2-40cc-aff5-77228d908bbb admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:01.953847 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 971/1945] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:01 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:01.953847 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44cdf8-4cb2-40cc-aff5-77228d908bbb admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:02.029181 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44cdf8-4cb2-40cc-aff5-77228d908bbb admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:02.030751 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2887875-525c-4fb7-8dc0-5b212edfc976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:02.031589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2887875-525c-4fb7-8dc0-5b212edfc976 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:02.031867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2887875-525c-4fb7-8dc0-5b212edfc976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:02.032305 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2887875-525c-4fb7-8dc0-5b212edfc976 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:02.033039 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2887875-525c-4fb7-8dc0-5b212edfc976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:02.034692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2887875-525c-4fb7-8dc0-5b212edfc976 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:02.035448 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6334f06-2253-4798-ac45-c20a5bb0ae05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:02.037258 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6334f06-2253-4798-ac45-c20a5bb0ae05 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:02.038092 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6334f06-2253-4798-ac45-c20a5bb0ae05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:02.038457 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6334f06-2253-4798-ac45-c20a5bb0ae05 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:02.039308 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6334f06-2253-4798-ac45-c20a5bb0ae05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:02.042067 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6334f06-2253-4798-ac45-c20a5bb0ae05 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:02.046991 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 975/1946] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:02.047896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2887875-525c-4fb7-8dc0-5b212edfc976 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:02.059629 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2887875-525c-4fb7-8dc0-5b212edfc976 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:02.065528 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71163ad3-8b8a-458e-a23f-53a3795a9507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:02.066115 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71163ad3-8b8a-458e-a23f-53a3795a9507 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:02.066396 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71163ad3-8b8a-458e-a23f-53a3795a9507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:02.066706 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71163ad3-8b8a-458e-a23f-53a3795a9507 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:02.067733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71163ad3-8b8a-458e-a23f-53a3795a9507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:02.070122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71163ad3-8b8a-458e-a23f-53a3795a9507 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:02.078295 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 972/1947] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:01 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:02.079248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6334f06-2253-4798-ac45-c20a5bb0ae05 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:02.102736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 976/1948] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:02 2022] POST /identity/v3/users => generated 294 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:02.104258 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71163ad3-8b8a-458e-a23f-53a3795a9507 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:02.117465 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71163ad3-8b8a-458e-a23f-53a3795a9507 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:02.171795 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6334f06-2253-4798-ac45-c20a5bb0ae05 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:02.187059 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7ec66-22ed-4934-93f0-3a41a389ce59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:02.188197 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7ec66-22ed-4934-93f0-3a41a389ce59 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:02.188579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7ec66-22ed-4934-93f0-3a41a389ce59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:02.189122 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7ec66-22ed-4934-93f0-3a41a389ce59 admin admin] PATH_INFO: `/v3/projects/7cf615b0ab344b459f89499f5f9a5d9a/users/6b14968ad84848d9909ec948a0236395/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:02.194397 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7ec66-22ed-4934-93f0-3a41a389ce59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf615b0ab344b459f89499f5f9a5d9a, user_id=6b14968ad84848d9909ec948a0236395, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:02.197999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7ec66-22ed-4934-93f0-3a41a389ce59 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:02.220895 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 973/1949] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:02 2022] PUT /identity/v3/projects/7cf615b0ab344b459f89499f5f9a5d9a/users/6b14968ad84848d9909ec948a0236395/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:02.226205 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7ec66-22ed-4934-93f0-3a41a389ce59 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:02.243350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87a110-e183-4187-980d-05bf1392fdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:02.244647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87a110-e183-4187-980d-05bf1392fdca admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:02.244647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87a110-e183-4187-980d-05bf1392fdca admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:02.244918 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87a110-e183-4187-980d-05bf1392fdca admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:02.245748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87a110-e183-4187-980d-05bf1392fdca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:02.248163 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87a110-e183-4187-980d-05bf1392fdca admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:02.284417 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 977/1950] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:02 2022] POST /identity/v3/users => generated 291 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:02.286828 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82aee8-27d7-479e-a261-ba2c132446c2 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:02.287132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82aee8-27d7-479e-a261-ba2c132446c2 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:02.287558 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82aee8-27d7-479e-a261-ba2c132446c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:02.326417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7ec66-22ed-4934-93f0-3a41a389ce59 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:02.332256 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-7b82aee8-27d7-479e-a261-ba2c132446c2 None None] MFA Rules not processed for user `6b14968ad84848d9909ec948a0236395`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:02.335234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e5643-f212-448a-914d-f7026118c19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:02.335515 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-7b82aee8-27d7-479e-a261-ba2c132446c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:02.336215 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e5643-f212-448a-914d-f7026118c19d admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:02.336644 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e5643-f212-448a-914d-f7026118c19d admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:02.337040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e5643-f212-448a-914d-f7026118c19d admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:02.338003 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e5643-f212-448a-914d-f7026118c19d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:02.339727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e5643-f212-448a-914d-f7026118c19d admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:02.360905 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 974/1951] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:02.362087 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e5643-f212-448a-914d-f7026118c19d admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:02.376619 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e5643-f212-448a-914d-f7026118c19d admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:02.387448 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e673a9-c23d-4469-9fe3-c71b94a26989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:02.387818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e673a9-c23d-4469-9fe3-c71b94a26989 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:02.388282 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e673a9-c23d-4469-9fe3-c71b94a26989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:02.397117 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e673a9-c23d-4469-9fe3-c71b94a26989 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:02.397956 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e673a9-c23d-4469-9fe3-c71b94a26989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:02.400894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e673a9-c23d-4469-9fe3-c71b94a26989 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:02.427773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 975/1952] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:02.429013 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e673a9-c23d-4469-9fe3-c71b94a26989 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:02.443950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e673a9-c23d-4469-9fe3-c71b94a26989 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:02.454991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b0149-2fab-4eb6-ae04-1996548aa572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:02.460836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b0149-2fab-4eb6-ae04-1996548aa572 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:02.461678 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b0149-2fab-4eb6-ae04-1996548aa572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:02.462181 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b0149-2fab-4eb6-ae04-1996548aa572 admin admin] PATH_INFO: `/v3/projects/504bbaff78be4e12a44fd85a0ce4834f/users/c840b1c1b77c4e5ca73c3ff72638bd39/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:02.493409 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 978/1953] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:02.500720 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b0149-2fab-4eb6-ae04-1996548aa572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=504bbaff78be4e12a44fd85a0ce4834f, user_id=c840b1c1b77c4e5ca73c3ff72638bd39, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:02.504341 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b0149-2fab-4eb6-ae04-1996548aa572 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:02.504514 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82aee8-27d7-479e-a261-ba2c132446c2 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:02.527106 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82aee8-27d7-479e-a261-ba2c132446c2 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:02.530090 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 976/1954] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:02 2022] PUT /identity/v3/projects/504bbaff78be4e12a44fd85a0ce4834f/users/c840b1c1b77c4e5ca73c3ff72638bd39/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:02.530941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b0149-2fab-4eb6-ae04-1996548aa572 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:02.536689 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-7e0b0149-2fab-4eb6-ae04-1996548aa572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:02.627343 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c9621-9375-4561-a96d-677cdc57ad9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:02.628187 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c9621-9375-4561-a96d-677cdc57ad9c admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:02.628497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c9621-9375-4561-a96d-677cdc57ad9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:02.628849 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c9621-9375-4561-a96d-677cdc57ad9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:02.629359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b0149-2fab-4eb6-ae04-1996548aa572 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:02.630284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c9621-9375-4561-a96d-677cdc57ad9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:02.632039 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c9621-9375-4561-a96d-677cdc57ad9c admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:02.635542 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b84f0-8637-4d60-808e-ec95af84f674 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:02.636446 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b84f0-8637-4d60-808e-ec95af84f674 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:02.636671 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b84f0-8637-4d60-808e-ec95af84f674 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:02.636948 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b84f0-8637-4d60-808e-ec95af84f674 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:02.651400 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 979/1955] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:02.651400 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c9621-9375-4561-a96d-677cdc57ad9c admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:02.665598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c9621-9375-4561-a96d-677cdc57ad9c admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:02.673081 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e430c11-410f-475d-a96d-386c46adc19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:02.674717 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e430c11-410f-475d-a96d-386c46adc19e admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:02.674717 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e430c11-410f-475d-a96d-386c46adc19e admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:02.674894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e430c11-410f-475d-a96d-386c46adc19e admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:02.676394 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e430c11-410f-475d-a96d-386c46adc19e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:02.678969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e430c11-410f-475d-a96d-386c46adc19e admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:02.695277 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 980/1956] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:02.696951 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e430c11-410f-475d-a96d-386c46adc19e admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:02.709942 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e430c11-410f-475d-a96d-386c46adc19e admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:02.715608 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10807cda-95bb-4b8c-96ad-02774d3d693a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:02.717057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10807cda-95bb-4b8c-96ad-02774d3d693a admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:02.717466 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10807cda-95bb-4b8c-96ad-02774d3d693a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:02.718008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10807cda-95bb-4b8c-96ad-02774d3d693a admin admin] PATH_INFO: `/v3/projects/2308a36c5b28419eb6722cb21200f13a/users/425cc0d0943146d0bded44db49df51a9/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:02.740995 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b84f0-8637-4d60-808e-ec95af84f674 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:02.742657 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10807cda-95bb-4b8c-96ad-02774d3d693a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2308a36c5b28419eb6722cb21200f13a, user_id=425cc0d0943146d0bded44db49df51a9, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:02.746241 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b84f0-8637-4d60-808e-ec95af84f674 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:02.752057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10807cda-95bb-4b8c-96ad-02774d3d693a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:02.776014 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 977/1957] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:02.788502 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 981/1958] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:02 2022] PUT /identity/v3/projects/2308a36c5b28419eb6722cb21200f13a/users/425cc0d0943146d0bded44db49df51a9/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:02.789902 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10807cda-95bb-4b8c-96ad-02774d3d693a admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:02.800286 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc36cab-54e9-45e9-9e31-845ddb566aa4 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:02.800600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc36cab-54e9-45e9-9e31-845ddb566aa4 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:02.803862 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc36cab-54e9-45e9-9e31-845ddb566aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:02.869963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-8bc36cab-54e9-45e9-9e31-845ddb566aa4 None None] MFA Rules not processed for user `425cc0d0943146d0bded44db49df51a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:02.871495 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-8bc36cab-54e9-45e9-9e31-845ddb566aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:02.940642 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10807cda-95bb-4b8c-96ad-02774d3d693a admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:02.947506 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4579251-4a7d-46ea-9051-5b332a068dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:02.948432 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4579251-4a7d-46ea-9051-5b332a068dce admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:02.948886 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4579251-4a7d-46ea-9051-5b332a068dce admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:02.949168 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4579251-4a7d-46ea-9051-5b332a068dce admin admin] PATH_INFO: `/v3/projects/504bbaff78be4e12a44fd85a0ce4834f/users/c840b1c1b77c4e5ca73c3ff72638bd39/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:02.953567 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4579251-4a7d-46ea-9051-5b332a068dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=504bbaff78be4e12a44fd85a0ce4834f, user_id=c840b1c1b77c4e5ca73c3ff72638bd39, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:02.955568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4579251-4a7d-46ea-9051-5b332a068dce admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:02.966163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 978/1959] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:02.967175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc36cab-54e9-45e9-9e31-845ddb566aa4 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:02.973115 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 982/1960] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:02 2022] PUT /identity/v3/projects/504bbaff78be4e12a44fd85a0ce4834f/users/c840b1c1b77c4e5ca73c3ff72638bd39/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:02.984014 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4579251-4a7d-46ea-9051-5b332a068dce admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:03.068008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4579251-4a7d-46ea-9051-5b332a068dce admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:03.073876 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ea921-7b21-4ace-98de-96c723d53f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:03.074547 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ea921-7b21-4ace-98de-96c723d53f57 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:03.074825 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ea921-7b21-4ace-98de-96c723d53f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:03.075092 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ea921-7b21-4ace-98de-96c723d53f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:03.075783 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ea921-7b21-4ace-98de-96c723d53f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:03.077738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ea921-7b21-4ace-98de-96c723d53f57 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:03.079973 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc36cab-54e9-45e9-9e31-845ddb566aa4 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:03.108960 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 983/1961] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:02 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:03.110338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5d489-f8c2-48c3-b53a-d683397bed7b None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:03.110627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5d489-f8c2-48c3-b53a-d683397bed7b None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:03.110944 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5d489-f8c2-48c3-b53a-d683397bed7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:03.158804 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-f4d5d489-f8c2-48c3-b53a-d683397bed7b None None] MFA Rules not processed for user `c840b1c1b77c4e5ca73c3ff72638bd39`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:03.161077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f4d5d489-f8c2-48c3-b53a-d683397bed7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:03.163113 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c264cef-f497-4f7d-b143-007f31b74c09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:03.164789 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c264cef-f497-4f7d-b143-007f31b74c09 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:03.165149 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c264cef-f497-4f7d-b143-007f31b74c09 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:03.165429 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c264cef-f497-4f7d-b143-007f31b74c09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:03.167858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-1c264cef-f497-4f7d-b143-007f31b74c09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:03.269650 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 984/1962] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:03.271276 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5d489-f8c2-48c3-b53a-d683397bed7b None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:03.298875 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c264cef-f497-4f7d-b143-007f31b74c09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:03.301123 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c264cef-f497-4f7d-b143-007f31b74c09 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:03.311427 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 979/1963] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:03.339666 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c264cef-f497-4f7d-b143-007f31b74c09 service cinder] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:03.349588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c264cef-f497-4f7d-b143-007f31b74c09 service cinder] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:03.354599 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5d489-f8c2-48c3-b53a-d683397bed7b None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:03.360889 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccfaf6-a34d-4f7e-9b8a-82d2259f5b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:03.361557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccfaf6-a34d-4f7e-9b8a-82d2259f5b9a admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:03.361832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccfaf6-a34d-4f7e-9b8a-82d2259f5b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:03.362491 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccfaf6-a34d-4f7e-9b8a-82d2259f5b9a admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:03.362785 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccfaf6-a34d-4f7e-9b8a-82d2259f5b9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:03.364875 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccfaf6-a34d-4f7e-9b8a-82d2259f5b9a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:03.386117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 985/1964] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:03 2022] POST /identity/v3/users => generated 297 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:03.390140 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccfaf6-a34d-4f7e-9b8a-82d2259f5b9a admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:03.403494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccfaf6-a34d-4f7e-9b8a-82d2259f5b9a admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:03.409743 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ffa40-0c1f-44ad-b799-0e5e273ea140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:03.410226 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03bf4f-7533-4196-9094-ba748507e79a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:03.410550 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ffa40-0c1f-44ad-b799-0e5e273ea140 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:03.410935 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ffa40-0c1f-44ad-b799-0e5e273ea140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:03.411679 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03bf4f-7533-4196-9094-ba748507e79a service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:03.411939 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ffa40-0c1f-44ad-b799-0e5e273ea140 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:03.412144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03bf4f-7533-4196-9094-ba748507e79a service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:03.412503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03bf4f-7533-4196-9094-ba748507e79a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:03.412824 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ffa40-0c1f-44ad-b799-0e5e273ea140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:03.414653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ffa40-0c1f-44ad-b799-0e5e273ea140 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:03.429092 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 986/1965] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:26:03.433518 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ffa40-0c1f-44ad-b799-0e5e273ea140 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:03.445198 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ffa40-0c1f-44ad-b799-0e5e273ea140 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:03.450695 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca9582-f293-4c55-871c-7397f9fcfef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:03.451622 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca9582-f293-4c55-871c-7397f9fcfef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:03.451905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca9582-f293-4c55-871c-7397f9fcfef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:03.452196 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca9582-f293-4c55-871c-7397f9fcfef7 admin admin] PATH_INFO: `/v3/projects/87333ebdd1e0403baf0928b1db49eaac/users/92615d0395fd4966b3c80dba3419c4bc/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:03.475273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca9582-f293-4c55-871c-7397f9fcfef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87333ebdd1e0403baf0928b1db49eaac, user_id=92615d0395fd4966b3c80dba3419c4bc, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:03.478426 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca9582-f293-4c55-871c-7397f9fcfef7 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:03.485076 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03bf4f-7533-4196-9094-ba748507e79a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:03.486230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03bf4f-7533-4196-9094-ba748507e79a service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:03.498688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 980/1967] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:26:03.500252 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 987/1967] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:03 2022] PUT /identity/v3/projects/87333ebdd1e0403baf0928b1db49eaac/users/92615d0395fd4966b3c80dba3419c4bc/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:03.502354 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03bf4f-7533-4196-9094-ba748507e79a service cinder] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:03.514067 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03bf4f-7533-4196-9094-ba748507e79a service cinder] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:03.581171 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb226a57-4117-4e8e-85f0-2c8cfc9bda22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:03.581859 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb226a57-4117-4e8e-85f0-2c8cfc9bda22 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:03.582132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb226a57-4117-4e8e-85f0-2c8cfc9bda22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:03.582414 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb226a57-4117-4e8e-85f0-2c8cfc9bda22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:03.584305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb226a57-4117-4e8e-85f0-2c8cfc9bda22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:03.585528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb226a57-4117-4e8e-85f0-2c8cfc9bda22 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:03.596259 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 981/1968] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:26:03.601163 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca9582-f293-4c55-871c-7397f9fcfef7 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:03.613032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca9582-f293-4c55-871c-7397f9fcfef7 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:03.622745 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646705f-bebb-4066-9e26-b579c5955ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:03.627062 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646705f-bebb-4066-9e26-b579c5955ace admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:03.627531 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646705f-bebb-4066-9e26-b579c5955ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:03.628190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646705f-bebb-4066-9e26-b579c5955ace admin admin] PATH_INFO: `/v3/projects/87333ebdd1e0403baf0928b1db49eaac/users/92615d0395fd4966b3c80dba3419c4bc/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:03.633738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646705f-bebb-4066-9e26-b579c5955ace admin admin] RBAC: Authorizing `identity:create_grant(project_id=87333ebdd1e0403baf0928b1db49eaac, user_id=92615d0395fd4966b3c80dba3419c4bc, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:03.642065 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646705f-bebb-4066-9e26-b579c5955ace admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:03.685798 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 988/1969] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:03 2022] PUT /identity/v3/projects/87333ebdd1e0403baf0928b1db49eaac/users/92615d0395fd4966b3c80dba3419c4bc/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:03.698525 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59423618-a271-4b92-8ee5-f62406ab2e63 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:03.699557 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59423618-a271-4b92-8ee5-f62406ab2e63 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:03.699828 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59423618-a271-4b92-8ee5-f62406ab2e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:03.746607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-59423618-a271-4b92-8ee5-f62406ab2e63 None None] MFA Rules not processed for user `92615d0395fd4966b3c80dba3419c4bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:03.747852 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-59423618-a271-4b92-8ee5-f62406ab2e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:03.839315 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 982/1970] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:03.929661 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646705f-bebb-4066-9e26-b579c5955ace admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:03.932190 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8646705f-bebb-4066-9e26-b579c5955ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:04.045476 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646705f-bebb-4066-9e26-b579c5955ace admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:04.049917 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7faba-f875-4647-ab46-c65e8dbb49c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:04.050930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7faba-f875-4647-ab46-c65e8dbb49c1 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:04.051276 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7faba-f875-4647-ab46-c65e8dbb49c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:04.052179 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7faba-f875-4647-ab46-c65e8dbb49c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:04.064434 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7faba-f875-4647-ab46-c65e8dbb49c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:04.066027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7faba-f875-4647-ab46-c65e8dbb49c1 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:04.090648 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 989/1971] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:04.192724 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59423618-a271-4b92-8ee5-f62406ab2e63 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:04.211808 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59423618-a271-4b92-8ee5-f62406ab2e63 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:04.218544 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290f878-ab7c-4bf5-a2e5-3ae72c37a897 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:04.219334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290f878-ab7c-4bf5-a2e5-3ae72c37a897 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:04.219624 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290f878-ab7c-4bf5-a2e5-3ae72c37a897 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:04.219905 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290f878-ab7c-4bf5-a2e5-3ae72c37a897 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:04.334939 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290f878-ab7c-4bf5-a2e5-3ae72c37a897 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:04.336590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290f878-ab7c-4bf5-a2e5-3ae72c37a897 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:04.350951 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 983/1972] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:04.707957 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7faba-f875-4647-ab46-c65e8dbb49c1 service cinder] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:04.786705 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7faba-f875-4647-ab46-c65e8dbb49c1 service cinder] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:04.791682 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690478b5-092f-4030-9074-312772646ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:04.792745 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690478b5-092f-4030-9074-312772646ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:04.793024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690478b5-092f-4030-9074-312772646ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:04.793363 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690478b5-092f-4030-9074-312772646ca5 admin admin] PATH_INFO: `/v3/users/425cc0d0943146d0bded44db49df51a9` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:04.794613 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690478b5-092f-4030-9074-312772646ca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=425cc0d0943146d0bded44db49df51a9)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:04.796868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690478b5-092f-4030-9074-312772646ca5 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:04.865388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-690478b5-092f-4030-9074-312772646ca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '425cc0d0943146d0bded44db49df51a9'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:04.869538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-690478b5-092f-4030-9074-312772646ca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '425cc0d0943146d0bded44db49df51a9'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:04.877482 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-690478b5-092f-4030-9074-312772646ca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '425cc0d0943146d0bded44db49df51a9'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:04.887503 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-690478b5-092f-4030-9074-312772646ca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '425cc0d0943146d0bded44db49df51a9'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:04.909430 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-690478b5-092f-4030-9074-312772646ca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '425cc0d0943146d0bded44db49df51a9'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:04.926191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 990/1973] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:04 2022] DELETE /identity/v3/users/425cc0d0943146d0bded44db49df51a9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:04.927595 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495827a6-10b3-45f7-9a58-a04b3970e07a None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:04.928200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495827a6-10b3-45f7-9a58-a04b3970e07a None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:04.928285 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495827a6-10b3-45f7-9a58-a04b3970e07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:04.957061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-495827a6-10b3-45f7-9a58-a04b3970e07a None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:04.961058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-495827a6-10b3-45f7-9a58-a04b3970e07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:05.092019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 984/1974] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:05.104453 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690478b5-092f-4030-9074-312772646ca5 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:05.106823 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-690478b5-092f-4030-9074-312772646ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:05.212204 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690478b5-092f-4030-9074-312772646ca5 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:05.221861 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03880ce-e45b-43d1-b6b2-d666378367fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:05.222556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03880ce-e45b-43d1-b6b2-d666378367fc service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:05.222842 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03880ce-e45b-43d1-b6b2-d666378367fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:05.223133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03880ce-e45b-43d1-b6b2-d666378367fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:05.264049 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03880ce-e45b-43d1-b6b2-d666378367fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:05.265753 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03880ce-e45b-43d1-b6b2-d666378367fc service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:05.288219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 991/1975] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:05.715377 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495827a6-10b3-45f7-9a58-a04b3970e07a None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:05.717400 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-495827a6-10b3-45f7-9a58-a04b3970e07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:05.747213 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495827a6-10b3-45f7-9a58-a04b3970e07a None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:05.753475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c7db5-234e-4558-ab31-8cdd50f8a643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:05.754590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c7db5-234e-4558-ab31-8cdd50f8a643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:05.754962 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c7db5-234e-4558-ab31-8cdd50f8a643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:05.755318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c7db5-234e-4558-ab31-8cdd50f8a643 admin admin] PATH_INFO: `/v3/projects/2308a36c5b28419eb6722cb21200f13a` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:05.757994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c7db5-234e-4558-ab31-8cdd50f8a643 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2308a36c5b28419eb6722cb21200f13a)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:05.760043 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c7db5-234e-4558-ab31-8cdd50f8a643 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:05.835816 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-e92c7db5-234e-4558-ab31-8cdd50f8a643 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2308a36c5b28419eb6722cb21200f13a', 'request_id': 'req-e92c7db5-234e-4558-ab31-8cdd50f8a643'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:05.841870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-e92c7db5-234e-4558-ab31-8cdd50f8a643 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2308a36c5b28419eb6722cb21200f13a', 'request_id': 'req-e92c7db5-234e-4558-ab31-8cdd50f8a643'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:05.852419 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-e92c7db5-234e-4558-ab31-8cdd50f8a643 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2308a36c5b28419eb6722cb21200f13a', 'request_id': 'req-e92c7db5-234e-4558-ab31-8cdd50f8a643'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:05.869264 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-e92c7db5-234e-4558-ab31-8cdd50f8a643 admin admin] The token cache is being invalidate because project 2308a36c5b28419eb6722cb21200f13a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:05.870066 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-e92c7db5-234e-4558-ab31-8cdd50f8a643 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:05.870925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-e92c7db5-234e-4558-ab31-8cdd50f8a643 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:05.873775 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 985/1976] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:05 2022] DELETE /identity/v3/projects/2308a36c5b28419eb6722cb21200f13a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:05.877329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03880ce-e45b-43d1-b6b2-d666378367fc service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:05.887493 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03880ce-e45b-43d1-b6b2-d666378367fc service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:05.961924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498abd65-63f4-494a-889f-7abb1321d220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:05.963180 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498abd65-63f4-494a-889f-7abb1321d220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:05.963698 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498abd65-63f4-494a-889f-7abb1321d220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:05.964132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498abd65-63f4-494a-889f-7abb1321d220 admin admin] PATH_INFO: `/v3/users/92615d0395fd4966b3c80dba3419c4bc` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:05.965576 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498abd65-63f4-494a-889f-7abb1321d220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92615d0395fd4966b3c80dba3419c4bc)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:05.967994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498abd65-63f4-494a-889f-7abb1321d220 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:06.034349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-498abd65-63f4-494a-889f-7abb1321d220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92615d0395fd4966b3c80dba3419c4bc'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:06.034739 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-498abd65-63f4-494a-889f-7abb1321d220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92615d0395fd4966b3c80dba3419c4bc'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:06.043434 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-498abd65-63f4-494a-889f-7abb1321d220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92615d0395fd4966b3c80dba3419c4bc'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:06.052604 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-498abd65-63f4-494a-889f-7abb1321d220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92615d0395fd4966b3c80dba3419c4bc'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:06.066300 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-498abd65-63f4-494a-889f-7abb1321d220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92615d0395fd4966b3c80dba3419c4bc'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:06.073140 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 992/1977] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:05 2022] DELETE /identity/v3/users/92615d0395fd4966b3c80dba3419c4bc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:06.581310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c7db5-234e-4558-ab31-8cdd50f8a643 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:06.586291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-e92c7db5-234e-4558-ab31-8cdd50f8a643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:06.630761 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c7db5-234e-4558-ab31-8cdd50f8a643 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:06.637928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498abd65-63f4-494a-889f-7abb1321d220 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:06.639693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-498abd65-63f4-494a-889f-7abb1321d220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:06.727672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a4e5b-591b-4f60-819c-865a6be7cb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:06.728971 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a4e5b-591b-4f60-819c-865a6be7cb9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:06.729256 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a4e5b-591b-4f60-819c-865a6be7cb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:06.729531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a4e5b-591b-4f60-819c-865a6be7cb9f admin admin] PATH_INFO: `/v3/projects/87333ebdd1e0403baf0928b1db49eaac` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:06.731569 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a4e5b-591b-4f60-819c-865a6be7cb9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=87333ebdd1e0403baf0928b1db49eaac)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:06.733850 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a4e5b-591b-4f60-819c-865a6be7cb9f admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:06.747370 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498abd65-63f4-494a-889f-7abb1321d220 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:06.756497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7816f-0ca5-48b5-9a75-808e58eb8abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:06.757662 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7816f-0ca5-48b5-9a75-808e58eb8abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:06.758099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7816f-0ca5-48b5-9a75-808e58eb8abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:06.758515 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7816f-0ca5-48b5-9a75-808e58eb8abf admin admin] PATH_INFO: `/v3/users/c7763d12953d4e3ea746911368024c6a` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:06.761095 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7816f-0ca5-48b5-9a75-808e58eb8abf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7763d12953d4e3ea746911368024c6a)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:06.764392 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7816f-0ca5-48b5-9a75-808e58eb8abf admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:06.808003 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-3a2a4e5b-591b-4f60-819c-865a6be7cb9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87333ebdd1e0403baf0928b1db49eaac', 'request_id': 'req-3a2a4e5b-591b-4f60-819c-865a6be7cb9f'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:06.816005 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-3a2a4e5b-591b-4f60-819c-865a6be7cb9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87333ebdd1e0403baf0928b1db49eaac', 'request_id': 'req-3a2a4e5b-591b-4f60-819c-865a6be7cb9f'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:06.827221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-3a2a4e5b-591b-4f60-819c-865a6be7cb9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87333ebdd1e0403baf0928b1db49eaac', 'request_id': 'req-3a2a4e5b-591b-4f60-819c-865a6be7cb9f'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:06.846530 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-c6f7816f-0ca5-48b5-9a75-808e58eb8abf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7763d12953d4e3ea746911368024c6a'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:06.846530 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-c6f7816f-0ca5-48b5-9a75-808e58eb8abf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7763d12953d4e3ea746911368024c6a'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:06.846752 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-3a2a4e5b-591b-4f60-819c-865a6be7cb9f admin admin] The token cache is being invalidate because project 87333ebdd1e0403baf0928b1db49eaac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:06.846752 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-3a2a4e5b-591b-4f60-819c-865a6be7cb9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:06.846752 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-3a2a4e5b-591b-4f60-819c-865a6be7cb9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:06.869080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 986/1978] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:06 2022] DELETE /identity/v3/projects/87333ebdd1e0403baf0928b1db49eaac => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:06.871010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319b4e6-dff4-4497-9785-352856625c89 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:06.871787 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319b4e6-dff4-4497-9785-352856625c89 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:06.872065 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319b4e6-dff4-4497-9785-352856625c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:06.880251 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-c6f7816f-0ca5-48b5-9a75-808e58eb8abf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7763d12953d4e3ea746911368024c6a'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:06.901381 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-c6f7816f-0ca5-48b5-9a75-808e58eb8abf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7763d12953d4e3ea746911368024c6a'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:06.910147 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-0319b4e6-dff4-4497-9785-352856625c89 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:06.911824 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-0319b4e6-dff4-4497-9785-352856625c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:06.923912 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-c6f7816f-0ca5-48b5-9a75-808e58eb8abf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7763d12953d4e3ea746911368024c6a'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:06.936469 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 993/1979] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:06 2022] DELETE /identity/v3/users/c7763d12953d4e3ea746911368024c6a => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:06.938169 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76863aa-6697-4e21-8a48-788d642e35a8 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:06.938562 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76863aa-6697-4e21-8a48-788d642e35a8 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:06.940449 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76863aa-6697-4e21-8a48-788d642e35a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:06.965332 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-b76863aa-6697-4e21-8a48-788d642e35a8 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:06.966987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-b76863aa-6697-4e21-8a48-788d642e35a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:07.011924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 987/1980] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:26:07.011924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319b4e6-dff4-4497-9785-352856625c89 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:07.011924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-0319b4e6-dff4-4497-9785-352856625c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:07.024794 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319b4e6-dff4-4497-9785-352856625c89 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:07.044129 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 994/1981] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:07.050700 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d061845-25e7-4002-83f6-1141cb95660d None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:07.050700 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d061845-25e7-4002-83f6-1141cb95660d None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:07.050700 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d061845-25e7-4002-83f6-1141cb95660d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:07.070590 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-5d061845-25e7-4002-83f6-1141cb95660d None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:07.071784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-5d061845-25e7-4002-83f6-1141cb95660d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:07.082167 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 995/1982] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:07.083664 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d061845-25e7-4002-83f6-1141cb95660d None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:07.085100 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-5d061845-25e7-4002-83f6-1141cb95660d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:07.095151 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9abc3-6e89-48da-aef4-c7750a61af64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:07.096496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9abc3-6e89-48da-aef4-c7750a61af64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:07.096813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9abc3-6e89-48da-aef4-c7750a61af64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:07.097091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9abc3-6e89-48da-aef4-c7750a61af64 admin admin] PATH_INFO: `/v3/users/9723109f371e4d0faa073162d7124db2` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:07.098854 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9abc3-6e89-48da-aef4-c7750a61af64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9723109f371e4d0faa073162d7124db2)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:07.100701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9abc3-6e89-48da-aef4-c7750a61af64 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:07.155701 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d061845-25e7-4002-83f6-1141cb95660d None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:07.157310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-a6d9abc3-6e89-48da-aef4-c7750a61af64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9723109f371e4d0faa073162d7124db2'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:07.160363 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3611d31-39a9-4500-a1f6-6b46e4579e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:07.161077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3611d31-39a9-4500-a1f6-6b46e4579e5c service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:07.161726 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3611d31-39a9-4500-a1f6-6b46e4579e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:07.161989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3611d31-39a9-4500-a1f6-6b46e4579e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:07.171452 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3611d31-39a9-4500-a1f6-6b46e4579e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:07.171960 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-a6d9abc3-6e89-48da-aef4-c7750a61af64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9723109f371e4d0faa073162d7124db2'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:07.173050 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3611d31-39a9-4500-a1f6-6b46e4579e5c service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:07.181481 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-a6d9abc3-6e89-48da-aef4-c7750a61af64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9723109f371e4d0faa073162d7124db2'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:07.182338 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-a6d9abc3-6e89-48da-aef4-c7750a61af64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9723109f371e4d0faa073162d7124db2'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:07.185414 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 996/1983] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:07.186472 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3611d31-39a9-4500-a1f6-6b46e4579e5c service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:07.197853 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-a6d9abc3-6e89-48da-aef4-c7750a61af64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9723109f371e4d0faa073162d7124db2'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:07.201161 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3611d31-39a9-4500-a1f6-6b46e4579e5c service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:07.207285 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 988/1984] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:07 2022] DELETE /identity/v3/users/9723109f371e4d0faa073162d7124db2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:07.211224 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c6de0-a843-46a4-bdd8-5dacacf928a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:07.211224 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c6de0-a843-46a4-bdd8-5dacacf928a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:07.211224 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c6de0-a843-46a4-bdd8-5dacacf928a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:07.211224 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c6de0-a843-46a4-bdd8-5dacacf928a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:07.211756 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c6de0-a843-46a4-bdd8-5dacacf928a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:07.212130 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c6de0-a843-46a4-bdd8-5dacacf928a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:07.213138 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2af18-1249-44e0-ae82-f92ad5a96c21 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:07.213566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2af18-1249-44e0-ae82-f92ad5a96c21 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:07.214324 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c6de0-a843-46a4-bdd8-5dacacf928a8 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:07.214492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2af18-1249-44e0-ae82-f92ad5a96c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:07.235389 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 997/1985] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:07.241248 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c6de0-a843-46a4-bdd8-5dacacf928a8 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:07.242805 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-daa2af18-1249-44e0-ae82-f92ad5a96c21 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:07.243291 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-2d1c6de0-a843-46a4-bdd8-5dacacf928a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:07.244844 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-daa2af18-1249-44e0-ae82-f92ad5a96c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:07.284969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c6de0-a843-46a4-bdd8-5dacacf928a8 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:07.334722 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 989/1986] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:07.349646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2af18-1249-44e0-ae82-f92ad5a96c21 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:07.351495 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-daa2af18-1249-44e0-ae82-f92ad5a96c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:07.368534 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b963a6a-d6a2-4efb-bce1-7f94cb7f0a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:07.369321 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b963a6a-d6a2-4efb-bce1-7f94cb7f0a1e admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:07.369608 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b963a6a-d6a2-4efb-bce1-7f94cb7f0a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:07.369888 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b963a6a-d6a2-4efb-bce1-7f94cb7f0a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:07.370586 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b963a6a-d6a2-4efb-bce1-7f94cb7f0a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:07.372715 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b963a6a-d6a2-4efb-bce1-7f94cb7f0a1e admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:07.404458 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 998/1987] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:07 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:07.409041 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b963a6a-d6a2-4efb-bce1-7f94cb7f0a1e admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:07.441116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2af18-1249-44e0-ae82-f92ad5a96c21 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:07.485902 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b963a6a-d6a2-4efb-bce1-7f94cb7f0a1e admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:07.495469 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60d37a-a946-4461-b633-573d8ee2b141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:07.495924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad800f-c307-495f-8ccf-5ea6d91ef676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:07.496495 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60d37a-a946-4461-b633-573d8ee2b141 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:07.496686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60d37a-a946-4461-b633-573d8ee2b141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:07.496801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad800f-c307-495f-8ccf-5ea6d91ef676 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:07.497122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60d37a-a946-4461-b633-573d8ee2b141 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:07.497261 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad800f-c307-495f-8ccf-5ea6d91ef676 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:07.497633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad800f-c307-495f-8ccf-5ea6d91ef676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:07.497821 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60d37a-a946-4461-b633-573d8ee2b141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:07.500300 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60d37a-a946-4461-b633-573d8ee2b141 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:07.507964 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad800f-c307-495f-8ccf-5ea6d91ef676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:07.509740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad800f-c307-495f-8ccf-5ea6d91ef676 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:07.523306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 990/1988] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:07.526503 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 999/1989] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:07 2022] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:07.530912 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad800f-c307-495f-8ccf-5ea6d91ef676 service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:07.546470 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad800f-c307-495f-8ccf-5ea6d91ef676 service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:07.552192 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cc3fe-dca3-4040-8d2b-79f54d708f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:07.553198 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cc3fe-dca3-4040-8d2b-79f54d708f73 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:07.553483 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cc3fe-dca3-4040-8d2b-79f54d708f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:07.553759 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cc3fe-dca3-4040-8d2b-79f54d708f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:07.554477 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101cc3fe-dca3-4040-8d2b-79f54d708f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:07.556207 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101cc3fe-dca3-4040-8d2b-79f54d708f73 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:07.571432 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 991/1990] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:07.572680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60d37a-a946-4461-b633-573d8ee2b141 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:07.584596 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60d37a-a946-4461-b633-573d8ee2b141 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:07.590034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078c118-f552-4d5b-956f-14ddd0d22d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:07.590812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078c118-f552-4d5b-956f-14ddd0d22d26 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:07.591092 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078c118-f552-4d5b-956f-14ddd0d22d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:07.591437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078c118-f552-4d5b-956f-14ddd0d22d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:07.592177 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078c118-f552-4d5b-956f-14ddd0d22d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:07.593965 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078c118-f552-4d5b-956f-14ddd0d22d26 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:07.605155 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1000/1991] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:07.609084 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cc3fe-dca3-4040-8d2b-79f54d708f73 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:07.621094 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cc3fe-dca3-4040-8d2b-79f54d708f73 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:07.626279 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83839ff6-304b-4c3c-a64d-18ba523da345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:07.627248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83839ff6-304b-4c3c-a64d-18ba523da345 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:07.627597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83839ff6-304b-4c3c-a64d-18ba523da345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:07.627939 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83839ff6-304b-4c3c-a64d-18ba523da345 admin admin] PATH_INFO: `/v3/projects/29baa5601f7e43f99997da22c6cb4fc5/users/c639318c883e434889aff426163be5b8/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:07.648178 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83839ff6-304b-4c3c-a64d-18ba523da345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29baa5601f7e43f99997da22c6cb4fc5, user_id=c639318c883e434889aff426163be5b8, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:07.651083 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83839ff6-304b-4c3c-a64d-18ba523da345 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:07.673988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 992/1992] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:07 2022] PUT /identity/v3/projects/29baa5601f7e43f99997da22c6cb4fc5/users/c639318c883e434889aff426163be5b8/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:26:07.685949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a8492-8954-4201-a131-f804c813d240 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:07.686481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a8492-8954-4201-a131-f804c813d240 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:07.686481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a8492-8954-4201-a131-f804c813d240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:07.723340 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-5d3a8492-8954-4201-a131-f804c813d240 None None] MFA Rules not processed for user `c639318c883e434889aff426163be5b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:07.724093 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-5d3a8492-8954-4201-a131-f804c813d240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:07.789441 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83839ff6-304b-4c3c-a64d-18ba523da345 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:07.791502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-83839ff6-304b-4c3c-a64d-18ba523da345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:07.842978 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1001/1993] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:07.858422 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a8492-8954-4201-a131-f804c813d240 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:07.859991 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-5d3a8492-8954-4201-a131-f804c813d240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:07.914512 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83839ff6-304b-4c3c-a64d-18ba523da345 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:07.925077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bddcd6-35de-4bb0-aae3-c047f38a3cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:07.928129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bddcd6-35de-4bb0-aae3-c047f38a3cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:07.928871 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bddcd6-35de-4bb0-aae3-c047f38a3cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:07.931526 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bddcd6-35de-4bb0-aae3-c047f38a3cf9 admin admin] PATH_INFO: `/v3/users/b79eb5f38c4b4fb7991e2a49e53f4d94` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:07.933273 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bddcd6-35de-4bb0-aae3-c047f38a3cf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b79eb5f38c4b4fb7991e2a49e53f4d94)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:07.936857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bddcd6-35de-4bb0-aae3-c047f38a3cf9 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:07.966621 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a8492-8954-4201-a131-f804c813d240 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:07.971951 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade1a6d-73c5-4eb5-9bcb-b509434cebe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:07.972989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade1a6d-73c5-4eb5-9bcb-b509434cebe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:07.973878 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade1a6d-73c5-4eb5-9bcb-b509434cebe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:07.974285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade1a6d-73c5-4eb5-9bcb-b509434cebe6 admin admin] PATH_INFO: `/v3/users/1cdec0bf6f014f86a61bf4dcfb6d8c2a` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:07.975999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade1a6d-73c5-4eb5-9bcb-b509434cebe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cdec0bf6f014f86a61bf4dcfb6d8c2a)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:07.978182 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade1a6d-73c5-4eb5-9bcb-b509434cebe6 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:08.000076 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-62bddcd6-35de-4bb0-aae3-c047f38a3cf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b79eb5f38c4b4fb7991e2a49e53f4d94'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.018262 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-62bddcd6-35de-4bb0-aae3-c047f38a3cf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b79eb5f38c4b4fb7991e2a49e53f4d94'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.031698 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-62bddcd6-35de-4bb0-aae3-c047f38a3cf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b79eb5f38c4b4fb7991e2a49e53f4d94'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.032490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-62bddcd6-35de-4bb0-aae3-c047f38a3cf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b79eb5f38c4b4fb7991e2a49e53f4d94'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.042165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-62bddcd6-35de-4bb0-aae3-c047f38a3cf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b79eb5f38c4b4fb7991e2a49e53f4d94'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.051032 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 993/1994] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:07 2022] DELETE /identity/v3/users/b79eb5f38c4b4fb7991e2a49e53f4d94 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:08.052920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-dade1a6d-73c5-4eb5-9bcb-b509434cebe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cdec0bf6f014f86a61bf4dcfb6d8c2a'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.053802 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-dade1a6d-73c5-4eb5-9bcb-b509434cebe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cdec0bf6f014f86a61bf4dcfb6d8c2a'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.063469 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-dade1a6d-73c5-4eb5-9bcb-b509434cebe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cdec0bf6f014f86a61bf4dcfb6d8c2a'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.065189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bddcd6-35de-4bb0-aae3-c047f38a3cf9 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:08.069225 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-62bddcd6-35de-4bb0-aae3-c047f38a3cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:08.076017 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-dade1a6d-73c5-4eb5-9bcb-b509434cebe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cdec0bf6f014f86a61bf4dcfb6d8c2a'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.092973 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-dade1a6d-73c5-4eb5-9bcb-b509434cebe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cdec0bf6f014f86a61bf4dcfb6d8c2a'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.103200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1002/1995] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:07 2022] DELETE /identity/v3/users/1cdec0bf6f014f86a61bf4dcfb6d8c2a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:08.104413 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade1a6d-73c5-4eb5-9bcb-b509434cebe6 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:08.107149 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-dade1a6d-73c5-4eb5-9bcb-b509434cebe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:08.145058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bddcd6-35de-4bb0-aae3-c047f38a3cf9 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:08.206969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade1a6d-73c5-4eb5-9bcb-b509434cebe6 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:08.211533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe07af-62cc-46c2-a371-188826065d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:08.212806 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe07af-62cc-46c2-a371-188826065d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:08.213097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe07af-62cc-46c2-a371-188826065d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:08.213592 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe07af-62cc-46c2-a371-188826065d32 admin admin] PATH_INFO: `/v3/projects/c676953f22ba4ec2961739021099bd91` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:08.214281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7f68b-e921-4a4f-8cef-bca956183e54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:08.215241 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7f68b-e921-4a4f-8cef-bca956183e54 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:08.215359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe07af-62cc-46c2-a371-188826065d32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c676953f22ba4ec2961739021099bd91)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:08.215813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7f68b-e921-4a4f-8cef-bca956183e54 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:08.216303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7f68b-e921-4a4f-8cef-bca956183e54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:08.218170 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe07af-62cc-46c2-a371-188826065d32 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:08.221615 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-0fb7f68b-e921-4a4f-8cef-bca956183e54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:08.298363 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-4cfe07af-62cc-46c2-a371-188826065d32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c676953f22ba4ec2961739021099bd91', 'request_id': 'req-4cfe07af-62cc-46c2-a371-188826065d32'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.309839 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-4cfe07af-62cc-46c2-a371-188826065d32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c676953f22ba4ec2961739021099bd91', 'request_id': 'req-4cfe07af-62cc-46c2-a371-188826065d32'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.321154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-4cfe07af-62cc-46c2-a371-188826065d32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c676953f22ba4ec2961739021099bd91', 'request_id': 'req-4cfe07af-62cc-46c2-a371-188826065d32'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.334889 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7f68b-e921-4a4f-8cef-bca956183e54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:08.336564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7f68b-e921-4a4f-8cef-bca956183e54 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:08.350445 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 994/1996] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:08.351234 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-4cfe07af-62cc-46c2-a371-188826065d32 admin admin] The token cache is being invalidate because project c676953f22ba4ec2961739021099bd91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:08.351375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7f68b-e921-4a4f-8cef-bca956183e54 service cinder] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:08.352796 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-4cfe07af-62cc-46c2-a371-188826065d32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.353358 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-0fb7f68b-e921-4a4f-8cef-bca956183e54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:08.355451 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-4cfe07af-62cc-46c2-a371-188826065d32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.363595 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1003/1997] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:08 2022] DELETE /identity/v3/projects/c676953f22ba4ec2961739021099bd91 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:08.366166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe07af-62cc-46c2-a371-188826065d32 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:08.371713 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-4cfe07af-62cc-46c2-a371-188826065d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:08.377230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7f68b-e921-4a4f-8cef-bca956183e54 service cinder] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:08.455855 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899838d-6754-41f3-8dfc-820381bfef3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:08.458443 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899838d-6754-41f3-8dfc-820381bfef3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:08.458788 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899838d-6754-41f3-8dfc-820381bfef3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:08.459204 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899838d-6754-41f3-8dfc-820381bfef3f admin admin] PATH_INFO: `/v3/projects/fde24d86db3d4abda01df90f54997dac` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:08.464470 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899838d-6754-41f3-8dfc-820381bfef3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fde24d86db3d4abda01df90f54997dac)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:08.467216 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899838d-6754-41f3-8dfc-820381bfef3f admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:08.493033 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe07af-62cc-46c2-a371-188826065d32 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:08.498721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b7b98-ceff-4140-b6c3-bdb1a7a779c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:08.499581 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b7b98-ceff-4140-b6c3-bdb1a7a779c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:08.499997 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b7b98-ceff-4140-b6c3-bdb1a7a779c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:08.500303 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b7b98-ceff-4140-b6c3-bdb1a7a779c4 admin admin] PATH_INFO: `/v3/projects/d7d461e051b3410b943d22095ecac469` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:08.501615 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b7b98-ceff-4140-b6c3-bdb1a7a779c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7d461e051b3410b943d22095ecac469)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:08.503569 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b7b98-ceff-4140-b6c3-bdb1a7a779c4 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:08.515716 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-4899838d-6754-41f3-8dfc-820381bfef3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fde24d86db3d4abda01df90f54997dac', 'request_id': 'req-4899838d-6754-41f3-8dfc-820381bfef3f'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.521833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-4899838d-6754-41f3-8dfc-820381bfef3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fde24d86db3d4abda01df90f54997dac', 'request_id': 'req-4899838d-6754-41f3-8dfc-820381bfef3f'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.529411 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-4899838d-6754-41f3-8dfc-820381bfef3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fde24d86db3d4abda01df90f54997dac', 'request_id': 'req-4899838d-6754-41f3-8dfc-820381bfef3f'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.542068 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-4899838d-6754-41f3-8dfc-820381bfef3f admin admin] The token cache is being invalidate because project fde24d86db3d4abda01df90f54997dac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:08.542352 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-4899838d-6754-41f3-8dfc-820381bfef3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.543019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-4899838d-6754-41f3-8dfc-820381bfef3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.544631 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 995/1998] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:08 2022] DELETE /identity/v3/projects/fde24d86db3d4abda01df90f54997dac => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:08.547472 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899838d-6754-41f3-8dfc-820381bfef3f admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:08.547472 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-4899838d-6754-41f3-8dfc-820381bfef3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:08.553667 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-755b7b98-ceff-4140-b6c3-bdb1a7a779c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7d461e051b3410b943d22095ecac469', 'request_id': 'req-755b7b98-ceff-4140-b6c3-bdb1a7a779c4'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.561134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-755b7b98-ceff-4140-b6c3-bdb1a7a779c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7d461e051b3410b943d22095ecac469', 'request_id': 'req-755b7b98-ceff-4140-b6c3-bdb1a7a779c4'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.567380 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-755b7b98-ceff-4140-b6c3-bdb1a7a779c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7d461e051b3410b943d22095ecac469', 'request_id': 'req-755b7b98-ceff-4140-b6c3-bdb1a7a779c4'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.577670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-755b7b98-ceff-4140-b6c3-bdb1a7a779c4 admin admin] The token cache is being invalidate because project d7d461e051b3410b943d22095ecac469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:08.578219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-755b7b98-ceff-4140-b6c3-bdb1a7a779c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.578875 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-755b7b98-ceff-4140-b6c3-bdb1a7a779c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.580460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1004/1999] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:08 2022] DELETE /identity/v3/projects/d7d461e051b3410b943d22095ecac469 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:08.581293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b7b98-ceff-4140-b6c3-bdb1a7a779c4 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:08.583166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-755b7b98-ceff-4140-b6c3-bdb1a7a779c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:08.612235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899838d-6754-41f3-8dfc-820381bfef3f admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:08.646667 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b7b98-ceff-4140-b6c3-bdb1a7a779c4 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:08.651519 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb729fd4-993a-4192-a52d-ea341fc2ebd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:08.652413 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb729fd4-993a-4192-a52d-ea341fc2ebd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:08.652697 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb729fd4-993a-4192-a52d-ea341fc2ebd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:08.652966 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb729fd4-993a-4192-a52d-ea341fc2ebd8 admin admin] PATH_INFO: `/v3/users/c639318c883e434889aff426163be5b8` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:08.654150 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb729fd4-993a-4192-a52d-ea341fc2ebd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c639318c883e434889aff426163be5b8)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:08.656091 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb729fd4-993a-4192-a52d-ea341fc2ebd8 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:08.669412 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0565b-612a-4c20-ba88-5b16f4d9b990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:08.670288 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0565b-612a-4c20-ba88-5b16f4d9b990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:08.670565 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0565b-612a-4c20-ba88-5b16f4d9b990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:08.670834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0565b-612a-4c20-ba88-5b16f4d9b990 admin admin] PATH_INFO: `/v3/users/c840b1c1b77c4e5ca73c3ff72638bd39` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:08.672009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0565b-612a-4c20-ba88-5b16f4d9b990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c840b1c1b77c4e5ca73c3ff72638bd39)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:08.674375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0565b-612a-4c20-ba88-5b16f4d9b990 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:08.705488 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-fb729fd4-993a-4192-a52d-ea341fc2ebd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c639318c883e434889aff426163be5b8'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.706235 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-fb729fd4-993a-4192-a52d-ea341fc2ebd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c639318c883e434889aff426163be5b8'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.714130 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-fb729fd4-993a-4192-a52d-ea341fc2ebd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c639318c883e434889aff426163be5b8'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.720998 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-fb729fd4-993a-4192-a52d-ea341fc2ebd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c639318c883e434889aff426163be5b8'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.724318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c2e0565b-612a-4c20-ba88-5b16f4d9b990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c840b1c1b77c4e5ca73c3ff72638bd39'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.732768 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-fb729fd4-993a-4192-a52d-ea341fc2ebd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c639318c883e434889aff426163be5b8'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.735627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c2e0565b-612a-4c20-ba88-5b16f4d9b990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c840b1c1b77c4e5ca73c3ff72638bd39'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.738994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1005/2000] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:08 2022] DELETE /identity/v3/users/c639318c883e434889aff426163be5b8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:08.739872 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb729fd4-993a-4192-a52d-ea341fc2ebd8 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:08.741319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-fb729fd4-993a-4192-a52d-ea341fc2ebd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:08.756288 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c2e0565b-612a-4c20-ba88-5b16f4d9b990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c840b1c1b77c4e5ca73c3ff72638bd39'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.757206 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c2e0565b-612a-4c20-ba88-5b16f4d9b990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c840b1c1b77c4e5ca73c3ff72638bd39'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.766284 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c2e0565b-612a-4c20-ba88-5b16f4d9b990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c840b1c1b77c4e5ca73c3ff72638bd39'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.777523 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 996/2001] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:08 2022] DELETE /identity/v3/users/c840b1c1b77c4e5ca73c3ff72638bd39 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:08.780610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0565b-612a-4c20-ba88-5b16f4d9b990 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:08.780610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-c2e0565b-612a-4c20-ba88-5b16f4d9b990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:08.813801 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb729fd4-993a-4192-a52d-ea341fc2ebd8 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:08.872794 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0565b-612a-4c20-ba88-5b16f4d9b990 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:08.878404 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4081608-97a2-43c0-a43f-1952738c7c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:08.879723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4081608-97a2-43c0-a43f-1952738c7c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:08.880027 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4081608-97a2-43c0-a43f-1952738c7c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:08.880354 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4081608-97a2-43c0-a43f-1952738c7c33 admin admin] PATH_INFO: `/v3/users/c1e8a4af706247e48a08a872a0c177d9` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:08.882081 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4081608-97a2-43c0-a43f-1952738c7c33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1e8a4af706247e48a08a872a0c177d9)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:08.883738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67011631-e47b-447c-b510-7d6d9deedbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:08.884227 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4081608-97a2-43c0-a43f-1952738c7c33 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:08.884637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67011631-e47b-447c-b510-7d6d9deedbed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:08.885499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67011631-e47b-447c-b510-7d6d9deedbed admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:08.885499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67011631-e47b-447c-b510-7d6d9deedbed admin admin] PATH_INFO: `/v3/projects/70e5f751aa784a26babc8a35ae2c194a` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:08.887149 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67011631-e47b-447c-b510-7d6d9deedbed admin admin] RBAC: Authorizing `identity:delete_project(project_id=70e5f751aa784a26babc8a35ae2c194a)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:08.890186 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67011631-e47b-447c-b510-7d6d9deedbed admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:08.948472 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-b4081608-97a2-43c0-a43f-1952738c7c33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1e8a4af706247e48a08a872a0c177d9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.955461 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-67011631-e47b-447c-b510-7d6d9deedbed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70e5f751aa784a26babc8a35ae2c194a', 'request_id': 'req-67011631-e47b-447c-b510-7d6d9deedbed'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.963040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-b4081608-97a2-43c0-a43f-1952738c7c33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1e8a4af706247e48a08a872a0c177d9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.964353 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-67011631-e47b-447c-b510-7d6d9deedbed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70e5f751aa784a26babc8a35ae2c194a', 'request_id': 'req-67011631-e47b-447c-b510-7d6d9deedbed'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.970055 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-b4081608-97a2-43c0-a43f-1952738c7c33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1e8a4af706247e48a08a872a0c177d9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.970788 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-b4081608-97a2-43c0-a43f-1952738c7c33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1e8a4af706247e48a08a872a0c177d9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.971991 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-67011631-e47b-447c-b510-7d6d9deedbed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70e5f751aa784a26babc8a35ae2c194a', 'request_id': 'req-67011631-e47b-447c-b510-7d6d9deedbed'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.980109 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-b4081608-97a2-43c0-a43f-1952738c7c33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1e8a4af706247e48a08a872a0c177d9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.983360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-67011631-e47b-447c-b510-7d6d9deedbed admin admin] The token cache is being invalidate because project 70e5f751aa784a26babc8a35ae2c194a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:08.983719 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-67011631-e47b-447c-b510-7d6d9deedbed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.984418 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-67011631-e47b-447c-b510-7d6d9deedbed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:08.986262 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1006/2002] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:08 2022] DELETE /identity/v3/projects/70e5f751aa784a26babc8a35ae2c194a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:08.987389 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8e285-74ad-4c9d-ba11-74827aeac82d None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:08.987679 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8e285-74ad-4c9d-ba11-74827aeac82d None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:08.987955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8e285-74ad-4c9d-ba11-74827aeac82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:08.991958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 997/2003] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:08 2022] DELETE /identity/v3/users/c1e8a4af706247e48a08a872a0c177d9 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:08.993386 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4542184-02ce-47fb-8288-cd66423ac290 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:08.993674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4542184-02ce-47fb-8288-cd66423ac290 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:08.994048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4542184-02ce-47fb-8288-cd66423ac290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:09.013346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-e4542184-02ce-47fb-8288-cd66423ac290 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:09.014565 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-e4542184-02ce-47fb-8288-cd66423ac290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:09.024007 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-ddf8e285-74ad-4c9d-ba11-74827aeac82d None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:09.025340 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-ddf8e285-74ad-4c9d-ba11-74827aeac82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:09.110098 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 998/2004] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:09.111721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4542184-02ce-47fb-8288-cd66423ac290 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:09.114764 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-e4542184-02ce-47fb-8288-cd66423ac290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:09.127996 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4542184-02ce-47fb-8288-cd66423ac290 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:09.133548 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79569473-cb76-451f-803c-6c93cc059252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:09.135039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79569473-cb76-451f-803c-6c93cc059252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:09.135431 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79569473-cb76-451f-803c-6c93cc059252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:09.135700 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79569473-cb76-451f-803c-6c93cc059252 admin admin] PATH_INFO: `/v3/users/e78d215f5fd44b85ae7ba60132788f86` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:09.136478 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1007/2005] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:09.137640 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8e285-74ad-4c9d-ba11-74827aeac82d None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:09.143327 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79569473-cb76-451f-803c-6c93cc059252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e78d215f5fd44b85ae7ba60132788f86)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:09.144121 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-ddf8e285-74ad-4c9d-ba11-74827aeac82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:09.146667 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79569473-cb76-451f-803c-6c93cc059252 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:09.160037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8e285-74ad-4c9d-ba11-74827aeac82d None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:09.168508 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3b8f0-60ca-4798-86b8-dff1ba2ff2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:09.169578 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3b8f0-60ca-4798-86b8-dff1ba2ff2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:09.170002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3b8f0-60ca-4798-86b8-dff1ba2ff2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:09.170882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3b8f0-60ca-4798-86b8-dff1ba2ff2a5 admin admin] PATH_INFO: `/v3/projects/504bbaff78be4e12a44fd85a0ce4834f` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:09.172924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3b8f0-60ca-4798-86b8-dff1ba2ff2a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=504bbaff78be4e12a44fd85a0ce4834f)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:09.176113 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3b8f0-60ca-4798-86b8-dff1ba2ff2a5 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:09.205498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-79569473-cb76-451f-803c-6c93cc059252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e78d215f5fd44b85ae7ba60132788f86'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:09.221501 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-79569473-cb76-451f-803c-6c93cc059252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e78d215f5fd44b85ae7ba60132788f86'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:09.233361 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-79569473-cb76-451f-803c-6c93cc059252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e78d215f5fd44b85ae7ba60132788f86'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:09.234671 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-79569473-cb76-451f-803c-6c93cc059252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e78d215f5fd44b85ae7ba60132788f86'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:09.245227 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-79569473-cb76-451f-803c-6c93cc059252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e78d215f5fd44b85ae7ba60132788f86'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:09.252731 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 999/2006] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:09 2022] DELETE /identity/v3/users/e78d215f5fd44b85ae7ba60132788f86 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:09.255817 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e8f3b8f0-60ca-4798-86b8-dff1ba2ff2a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '504bbaff78be4e12a44fd85a0ce4834f', 'request_id': 'req-e8f3b8f0-60ca-4798-86b8-dff1ba2ff2a5'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:09.256000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79569473-cb76-451f-803c-6c93cc059252 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:09.256000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-79569473-cb76-451f-803c-6c93cc059252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:09.264682 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e8f3b8f0-60ca-4798-86b8-dff1ba2ff2a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '504bbaff78be4e12a44fd85a0ce4834f', 'request_id': 'req-e8f3b8f0-60ca-4798-86b8-dff1ba2ff2a5'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:09.274642 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e8f3b8f0-60ca-4798-86b8-dff1ba2ff2a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '504bbaff78be4e12a44fd85a0ce4834f', 'request_id': 'req-e8f3b8f0-60ca-4798-86b8-dff1ba2ff2a5'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:09.294205 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e8f3b8f0-60ca-4798-86b8-dff1ba2ff2a5 admin admin] The token cache is being invalidate because project 504bbaff78be4e12a44fd85a0ce4834f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:09.294547 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e8f3b8f0-60ca-4798-86b8-dff1ba2ff2a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:09.295211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e8f3b8f0-60ca-4798-86b8-dff1ba2ff2a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:09.298376 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1008/2007] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:09 2022] DELETE /identity/v3/projects/504bbaff78be4e12a44fd85a0ce4834f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:09.301546 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1b188-1386-4af1-95f3-eded255b6bef None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:09.301546 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1b188-1386-4af1-95f3-eded255b6bef None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:09.301546 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1b188-1386-4af1-95f3-eded255b6bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:09.321953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-34c1b188-1386-4af1-95f3-eded255b6bef None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:09.323192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-34c1b188-1386-4af1-95f3-eded255b6bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:09.350833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79569473-cb76-451f-803c-6c93cc059252 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:09.355305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2a400-0e5f-4162-8535-2efdfa203e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:09.356529 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2a400-0e5f-4162-8535-2efdfa203e50 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:09.356994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2a400-0e5f-4162-8535-2efdfa203e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:09.357597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2a400-0e5f-4162-8535-2efdfa203e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:09.359638 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-cfd2a400-0e5f-4162-8535-2efdfa203e50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:09.411422 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1009/2008] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:09.413617 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f5a8c-9b9e-46fb-b345-1fc5eb6df0fa None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:09.413905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f5a8c-9b9e-46fb-b345-1fc5eb6df0fa None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:09.414349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f5a8c-9b9e-46fb-b345-1fc5eb6df0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:09.433576 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-d79f5a8c-9b9e-46fb-b345-1fc5eb6df0fa None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:09.434887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-d79f5a8c-9b9e-46fb-b345-1fc5eb6df0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:09.444016 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1010/2009] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:09.444756 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f5a8c-9b9e-46fb-b345-1fc5eb6df0fa None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:09.451831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2a400-0e5f-4162-8535-2efdfa203e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:09.453723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2a400-0e5f-4162-8535-2efdfa203e50 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:09.456018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f5a8c-9b9e-46fb-b345-1fc5eb6df0fa None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:09.461924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fff063-5b5b-46b9-8ed0-155ef1a92190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:09.462778 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fff063-5b5b-46b9-8ed0-155ef1a92190 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:09.463059 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fff063-5b5b-46b9-8ed0-155ef1a92190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:09.463333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fff063-5b5b-46b9-8ed0-155ef1a92190 admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:09.464268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fff063-5b5b-46b9-8ed0-155ef1a92190 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:09.464578 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fff063-5b5b-46b9-8ed0-155ef1a92190 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:09.466111 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1000/2010] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:09.466251 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fff063-5b5b-46b9-8ed0-155ef1a92190 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:09.467509 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608ea80-ec82-4bfc-a886-e07a50e248be None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:09.467810 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608ea80-ec82-4bfc-a886-e07a50e248be None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:09.468088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608ea80-ec82-4bfc-a886-e07a50e248be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:09.480633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1011/2011] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:09.485725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fff063-5b5b-46b9-8ed0-155ef1a92190 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:09.487879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-a608ea80-ec82-4bfc-a886-e07a50e248be None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:09.490374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-a608ea80-ec82-4bfc-a886-e07a50e248be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:09.496834 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fff063-5b5b-46b9-8ed0-155ef1a92190 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:09.499189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1001/2012] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:09.502976 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608ea80-ec82-4bfc-a886-e07a50e248be None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:09.504750 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c28395-0543-46e9-8bc1-b154ceebbd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:09.505423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c28395-0543-46e9-8bc1-b154ceebbd6e admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:09.505737 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c28395-0543-46e9-8bc1-b154ceebbd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:09.505998 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c28395-0543-46e9-8bc1-b154ceebbd6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:09.506690 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c28395-0543-46e9-8bc1-b154ceebbd6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:09.508637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c28395-0543-46e9-8bc1-b154ceebbd6e admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:09.512968 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608ea80-ec82-4bfc-a886-e07a50e248be None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:09.517710 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4601a3-26b8-491c-b73a-066aec4905cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:09.518737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4601a3-26b8-491c-b73a-066aec4905cb admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:09.519438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4601a3-26b8-491c-b73a-066aec4905cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:09.519438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4601a3-26b8-491c-b73a-066aec4905cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:09.520258 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4601a3-26b8-491c-b73a-066aec4905cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:09.520864 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4601a3-26b8-491c-b73a-066aec4905cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:09.523043 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4601a3-26b8-491c-b73a-066aec4905cb admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:09.539234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1002/2013] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:09.540199 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1012/2014] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:09 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:26:09.544183 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4601a3-26b8-491c-b73a-066aec4905cb admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:09.544718 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c28395-0543-46e9-8bc1-b154ceebbd6e admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:09.555762 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4601a3-26b8-491c-b73a-066aec4905cb admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:09.613124 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c28395-0543-46e9-8bc1-b154ceebbd6e admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:09.617934 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120d0a2-7b81-4f21-97d3-dab7d223ffd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:09.618845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120d0a2-7b81-4f21-97d3-dab7d223ffd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:09.619084 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120d0a2-7b81-4f21-97d3-dab7d223ffd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:09.619406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120d0a2-7b81-4f21-97d3-dab7d223ffd0 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:09.620042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120d0a2-7b81-4f21-97d3-dab7d223ffd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:09.620197 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8e52b-10db-4e54-a790-6750039aa3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:09.620961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8e52b-10db-4e54-a790-6750039aa3de admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:09.621242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8e52b-10db-4e54-a790-6750039aa3de admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:09.621517 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8e52b-10db-4e54-a790-6750039aa3de admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:09.622144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120d0a2-7b81-4f21-97d3-dab7d223ffd0 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:09.622277 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8e52b-10db-4e54-a790-6750039aa3de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:09.624637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8e52b-10db-4e54-a790-6750039aa3de admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:09.649437 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1003/2015] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:09 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:09.651076 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120d0a2-7b81-4f21-97d3-dab7d223ffd0 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:09.659225 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1013/2016] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:09 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:09.664689 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8e52b-10db-4e54-a790-6750039aa3de admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:09.668917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120d0a2-7b81-4f21-97d3-dab7d223ffd0 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:09.735914 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b1e95-e441-48d2-9579-83717c6d6ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:09.736557 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b1e95-e441-48d2-9579-83717c6d6ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:09.736840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b1e95-e441-48d2-9579-83717c6d6ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:09.737114 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b1e95-e441-48d2-9579-83717c6d6ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:09.738126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b1e95-e441-48d2-9579-83717c6d6ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:09.749255 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b1e95-e441-48d2-9579-83717c6d6ff7 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:09.757067 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1004/2017] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:09.758138 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b1e95-e441-48d2-9579-83717c6d6ff7 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:09.760661 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-ec8b1e95-e441-48d2-9579-83717c6d6ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:09.764890 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8e52b-10db-4e54-a790-6750039aa3de admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:09.772528 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2766f35-bd87-4c2d-bbd7-94c4c871f09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:09.773185 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2766f35-bd87-4c2d-bbd7-94c4c871f09e admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:09.773461 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2766f35-bd87-4c2d-bbd7-94c4c871f09e admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:09.774114 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2766f35-bd87-4c2d-bbd7-94c4c871f09e admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:09.774471 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2766f35-bd87-4c2d-bbd7-94c4c871f09e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:09.776521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2766f35-bd87-4c2d-bbd7-94c4c871f09e admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:09.782759 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b1e95-e441-48d2-9579-83717c6d6ff7 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:09.806806 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1014/2018] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:09 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:26:09.807001 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f509429-b5c1-4ecb-97f2-50345be7fc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:09.807001 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f509429-b5c1-4ecb-97f2-50345be7fc7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:09.807001 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f509429-b5c1-4ecb-97f2-50345be7fc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:09.807001 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f509429-b5c1-4ecb-97f2-50345be7fc7f admin admin] PATH_INFO: `/v3/projects/5df994827477494d9bf518ec38e2c7b3` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:09.807343 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2766f35-bd87-4c2d-bbd7-94c4c871f09e admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:09.808624 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f509429-b5c1-4ecb-97f2-50345be7fc7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5df994827477494d9bf518ec38e2c7b3)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:09.810661 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f509429-b5c1-4ecb-97f2-50345be7fc7f admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:09.817999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2766f35-bd87-4c2d-bbd7-94c4c871f09e admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:09.823603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655e034-82b2-42a6-8ddb-c830b371a284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:09.824305 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655e034-82b2-42a6-8ddb-c830b371a284 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:09.824716 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655e034-82b2-42a6-8ddb-c830b371a284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:09.824988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655e034-82b2-42a6-8ddb-c830b371a284 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:09.828229 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655e034-82b2-42a6-8ddb-c830b371a284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:09.828229 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655e034-82b2-42a6-8ddb-c830b371a284 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:09.844614 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1015/2019] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:09.845623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655e034-82b2-42a6-8ddb-c830b371a284 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:09.858920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655e034-82b2-42a6-8ddb-c830b371a284 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:09.873734 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-7f509429-b5c1-4ecb-97f2-50345be7fc7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5df994827477494d9bf518ec38e2c7b3', 'request_id': 'req-7f509429-b5c1-4ecb-97f2-50345be7fc7f'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:09.880887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-7f509429-b5c1-4ecb-97f2-50345be7fc7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5df994827477494d9bf518ec38e2c7b3', 'request_id': 'req-7f509429-b5c1-4ecb-97f2-50345be7fc7f'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:09.891694 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-7f509429-b5c1-4ecb-97f2-50345be7fc7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5df994827477494d9bf518ec38e2c7b3', 'request_id': 'req-7f509429-b5c1-4ecb-97f2-50345be7fc7f'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:09.908884 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-7f509429-b5c1-4ecb-97f2-50345be7fc7f admin admin] The token cache is being invalidate because project 5df994827477494d9bf518ec38e2c7b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:09.909280 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-7f509429-b5c1-4ecb-97f2-50345be7fc7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:09.910157 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-7f509429-b5c1-4ecb-97f2-50345be7fc7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:09.912492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1005/2020] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:09 2022] DELETE /identity/v3/projects/5df994827477494d9bf518ec38e2c7b3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:09.913628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f509429-b5c1-4ecb-97f2-50345be7fc7f admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:09.915765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-7f509429-b5c1-4ecb-97f2-50345be7fc7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:09.951974 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60186e-af1c-46cf-91c6-541740dd9c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:09.952900 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60186e-af1c-46cf-91c6-541740dd9c69 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:09.953245 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60186e-af1c-46cf-91c6-541740dd9c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:09.953584 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60186e-af1c-46cf-91c6-541740dd9c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:09.954444 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60186e-af1c-46cf-91c6-541740dd9c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:09.956302 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60186e-af1c-46cf-91c6-541740dd9c69 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:09.971068 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1016/2021] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:09.971068 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60186e-af1c-46cf-91c6-541740dd9c69 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:09.971371 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-7e60186e-af1c-46cf-91c6-541740dd9c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:09.984186 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60186e-af1c-46cf-91c6-541740dd9c69 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:09.990264 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06631b2-c736-4122-89a7-94a40e9001cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:09.991185 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06631b2-c736-4122-89a7-94a40e9001cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:09.991535 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06631b2-c736-4122-89a7-94a40e9001cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:09.991872 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06631b2-c736-4122-89a7-94a40e9001cb admin admin] PATH_INFO: `/v3/projects/4a02478ba1f0406488476a4ece702be5/users/dab09f6a1e3b4854912147027bced1cf/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:09.993218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f509429-b5c1-4ecb-97f2-50345be7fc7f admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:09.998462 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c99516-7045-41a1-af57-a69218580e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:09.999337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c99516-7045-41a1-af57-a69218580e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:09.999655 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c99516-7045-41a1-af57-a69218580e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:09.999943 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c99516-7045-41a1-af57-a69218580e93 admin admin] PATH_INFO: `/v3/projects/f386e50522fe4837bbada29befbcd7c4` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:10.001220 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c99516-7045-41a1-af57-a69218580e93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f386e50522fe4837bbada29befbcd7c4)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:10.003382 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c99516-7045-41a1-af57-a69218580e93 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:10.009894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06631b2-c736-4122-89a7-94a40e9001cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a02478ba1f0406488476a4ece702be5, user_id=dab09f6a1e3b4854912147027bced1cf, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:10.015471 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06631b2-c736-4122-89a7-94a40e9001cb admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:10.041789 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1017/2022] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:09 2022] PUT /identity/v3/projects/4a02478ba1f0406488476a4ece702be5/users/dab09f6a1e3b4854912147027bced1cf/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:10.043519 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06631b2-c736-4122-89a7-94a40e9001cb admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:10.045263 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f06631b2-c736-4122-89a7-94a40e9001cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:10.058502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-b0c99516-7045-41a1-af57-a69218580e93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f386e50522fe4837bbada29befbcd7c4', 'request_id': 'req-b0c99516-7045-41a1-af57-a69218580e93'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:10.063827 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-b0c99516-7045-41a1-af57-a69218580e93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f386e50522fe4837bbada29befbcd7c4', 'request_id': 'req-b0c99516-7045-41a1-af57-a69218580e93'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:10.071514 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-b0c99516-7045-41a1-af57-a69218580e93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f386e50522fe4837bbada29befbcd7c4', 'request_id': 'req-b0c99516-7045-41a1-af57-a69218580e93'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:10.083629 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-b0c99516-7045-41a1-af57-a69218580e93 admin admin] The token cache is being invalidate because project f386e50522fe4837bbada29befbcd7c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:10.083938 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-b0c99516-7045-41a1-af57-a69218580e93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:10.085231 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-b0c99516-7045-41a1-af57-a69218580e93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:10.087093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1006/2023] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:09 2022] DELETE /identity/v3/projects/f386e50522fe4837bbada29befbcd7c4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:10.087894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c99516-7045-41a1-af57-a69218580e93 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:10.089288 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-b0c99516-7045-41a1-af57-a69218580e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:10.109313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06631b2-c736-4122-89a7-94a40e9001cb admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:10.158914 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c99516-7045-41a1-af57-a69218580e93 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:10.164395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db760d24-4f54-403b-8e6f-f299d186572a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:10.165069 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db760d24-4f54-403b-8e6f-f299d186572a admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:10.165382 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db760d24-4f54-403b-8e6f-f299d186572a admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:10.165661 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db760d24-4f54-403b-8e6f-f299d186572a admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:10.166386 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db760d24-4f54-403b-8e6f-f299d186572a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:10.167282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd89c46-0792-488f-93b9-a026a1c87b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:10.167995 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db760d24-4f54-403b-8e6f-f299d186572a admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:10.168279 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd89c46-0792-488f-93b9-a026a1c87b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:10.168560 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd89c46-0792-488f-93b9-a026a1c87b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:10.168829 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd89c46-0792-488f-93b9-a026a1c87b7d admin admin] PATH_INFO: `/v3/users/6b14968ad84848d9909ec948a0236395` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:10.170013 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd89c46-0792-488f-93b9-a026a1c87b7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b14968ad84848d9909ec948a0236395)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:10.171898 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd89c46-0792-488f-93b9-a026a1c87b7d admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:10.178977 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1007/2024] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:10.182710 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db760d24-4f54-403b-8e6f-f299d186572a admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:10.184402 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-db760d24-4f54-403b-8e6f-f299d186572a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:10.197678 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db760d24-4f54-403b-8e6f-f299d186572a admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:10.202669 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9addc-7f9e-4e09-a640-54e6ca9d68dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:10.203549 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9addc-7f9e-4e09-a640-54e6ca9d68dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:10.203891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9addc-7f9e-4e09-a640-54e6ca9d68dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:10.204236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9addc-7f9e-4e09-a640-54e6ca9d68dd admin admin] PATH_INFO: `/v3/projects/29baa5601f7e43f99997da22c6cb4fc5` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:10.208977 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9addc-7f9e-4e09-a640-54e6ca9d68dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=29baa5601f7e43f99997da22c6cb4fc5)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:10.211109 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9addc-7f9e-4e09-a640-54e6ca9d68dd admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:10.219032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-1bd89c46-0792-488f-93b9-a026a1c87b7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b14968ad84848d9909ec948a0236395'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:10.219694 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-1bd89c46-0792-488f-93b9-a026a1c87b7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b14968ad84848d9909ec948a0236395'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:10.227241 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-1bd89c46-0792-488f-93b9-a026a1c87b7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b14968ad84848d9909ec948a0236395'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:10.241896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-1bd89c46-0792-488f-93b9-a026a1c87b7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b14968ad84848d9909ec948a0236395'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:10.255342 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-1bd89c46-0792-488f-93b9-a026a1c87b7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b14968ad84848d9909ec948a0236395'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:10.260241 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-cda9addc-7f9e-4e09-a640-54e6ca9d68dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29baa5601f7e43f99997da22c6cb4fc5', 'request_id': 'req-cda9addc-7f9e-4e09-a640-54e6ca9d68dd'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:10.261437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1018/2025] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:10 2022] DELETE /identity/v3/users/6b14968ad84848d9909ec948a0236395 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:10.262805 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9648db-dd12-45c9-91e4-3416073b7b4b None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:10.263217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9648db-dd12-45c9-91e4-3416073b7b4b None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:10.263556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9648db-dd12-45c9-91e4-3416073b7b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:10.266445 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-cda9addc-7f9e-4e09-a640-54e6ca9d68dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29baa5601f7e43f99997da22c6cb4fc5', 'request_id': 'req-cda9addc-7f9e-4e09-a640-54e6ca9d68dd'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:10.275297 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-cda9addc-7f9e-4e09-a640-54e6ca9d68dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29baa5601f7e43f99997da22c6cb4fc5', 'request_id': 'req-cda9addc-7f9e-4e09-a640-54e6ca9d68dd'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:10.289695 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-cda9addc-7f9e-4e09-a640-54e6ca9d68dd admin admin] The token cache is being invalidate because project 29baa5601f7e43f99997da22c6cb4fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:10.289996 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-cda9addc-7f9e-4e09-a640-54e6ca9d68dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:10.290669 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-cda9addc-7f9e-4e09-a640-54e6ca9d68dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:10.292565 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1008/2026] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:10 2022] DELETE /identity/v3/projects/29baa5601f7e43f99997da22c6cb4fc5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:10.296511 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-fd9648db-dd12-45c9-91e4-3416073b7b4b None None] MFA Rules not processed for user `dab09f6a1e3b4854912147027bced1cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:10.296915 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e222f-c65b-44f5-b102-911944f159a2 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:10.297209 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e222f-c65b-44f5-b102-911944f159a2 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:10.297494 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e222f-c65b-44f5-b102-911944f159a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:10.297930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-fd9648db-dd12-45c9-91e4-3416073b7b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:10.316891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-782e222f-c65b-44f5-b102-911944f159a2 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:10.318899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-782e222f-c65b-44f5-b102-911944f159a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:10.381112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1019/2027] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:10.385795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9648db-dd12-45c9-91e4-3416073b7b4b None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:10.386738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-fd9648db-dd12-45c9-91e4-3416073b7b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:10.387211 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1009/2028] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:10.388694 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724731b-1308-40d9-b75a-b4fba5cba9d8 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:10.388986 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724731b-1308-40d9-b75a-b4fba5cba9d8 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:10.389261 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724731b-1308-40d9-b75a-b4fba5cba9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:10.406104 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9648db-dd12-45c9-91e4-3416073b7b4b None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:10.413620 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfb40c-1839-4e53-8dd9-52e0e9d2a9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:10.414522 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfb40c-1839-4e53-8dd9-52e0e9d2a9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:10.414802 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfb40c-1839-4e53-8dd9-52e0e9d2a9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:10.415071 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfb40c-1839-4e53-8dd9-52e0e9d2a9c4 admin admin] PATH_INFO: `/v3/projects/162bb1b8d5724cebbe8ecba68983a993/users/02f6d04d398f4322a24bff718bc41527/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:10.420384 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-1724731b-1308-40d9-b75a-b4fba5cba9d8 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:10.421707 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-1724731b-1308-40d9-b75a-b4fba5cba9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:10.433198 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1010/2029] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:10.433933 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbfb40c-1839-4e53-8dd9-52e0e9d2a9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=162bb1b8d5724cebbe8ecba68983a993, user_id=02f6d04d398f4322a24bff718bc41527, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:10.434212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724731b-1308-40d9-b75a-b4fba5cba9d8 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:10.436809 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbfb40c-1839-4e53-8dd9-52e0e9d2a9c4 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:10.441252 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-1724731b-1308-40d9-b75a-b4fba5cba9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:10.452931 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1020/2030] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:10 2022] PUT /identity/v3/projects/162bb1b8d5724cebbe8ecba68983a993/users/02f6d04d398f4322a24bff718bc41527/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:10.455625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724731b-1308-40d9-b75a-b4fba5cba9d8 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:10.458123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d39b7-37b3-4633-b72b-2bfdb31008a3 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:10.460583 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d39b7-37b3-4633-b72b-2bfdb31008a3 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:10.461850 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d39b7-37b3-4633-b72b-2bfdb31008a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:10.482340 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-953d39b7-37b3-4633-b72b-2bfdb31008a3 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:10.483661 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-953d39b7-37b3-4633-b72b-2bfdb31008a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:10.517337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcc9d0-1f94-4ef1-a877-da795a606f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:10.518046 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcc9d0-1f94-4ef1-a877-da795a606f30 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:10.518345 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcc9d0-1f94-4ef1-a877-da795a606f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:10.518855 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcc9d0-1f94-4ef1-a877-da795a606f30 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:10.519543 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fcc9d0-1f94-4ef1-a877-da795a606f30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:10.521607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fcc9d0-1f94-4ef1-a877-da795a606f30 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:10.549145 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1021/2031] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:10.550597 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761f35a-725c-4dc2-ae10-3a2235ac2862 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:10.550918 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761f35a-725c-4dc2-ae10-3a2235ac2862 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:10.551263 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761f35a-725c-4dc2-ae10-3a2235ac2862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:10.556818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1011/2032] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:10 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:10.556818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f215ab-e080-42ff-8ee5-f601d00d88fe None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:10.556818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f215ab-e080-42ff-8ee5-f601d00d88fe None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:10.556818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f215ab-e080-42ff-8ee5-f601d00d88fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:10.574455 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-e761f35a-725c-4dc2-ae10-3a2235ac2862 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:10.575793 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-e761f35a-725c-4dc2-ae10-3a2235ac2862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:10.589177 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-10f215ab-e080-42ff-8ee5-f601d00d88fe None None] MFA Rules not processed for user `02f6d04d398f4322a24bff718bc41527`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:10.590711 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-10f215ab-e080-42ff-8ee5-f601d00d88fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:10.636128 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1022/2033] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:10.639371 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761f35a-725c-4dc2-ae10-3a2235ac2862 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:10.647498 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761f35a-725c-4dc2-ae10-3a2235ac2862 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:10.652732 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4db5c-924f-49d1-8910-cd2682ce217d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:10.653410 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4db5c-924f-49d1-8910-cd2682ce217d admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:10.653685 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4db5c-924f-49d1-8910-cd2682ce217d admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:10.653952 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4db5c-924f-49d1-8910-cd2682ce217d admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:10.654671 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4db5c-924f-49d1-8910-cd2682ce217d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:10.654977 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4db5c-924f-49d1-8910-cd2682ce217d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:10.656622 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4db5c-924f-49d1-8910-cd2682ce217d admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:10.657228 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1012/2034] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:10.658226 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f215ab-e080-42ff-8ee5-f601d00d88fe None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:10.673188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1023/2035] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:10.673188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4db5c-924f-49d1-8910-cd2682ce217d admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:10.673446 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f215ab-e080-42ff-8ee5-f601d00d88fe None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:10.673538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-34a4db5c-924f-49d1-8910-cd2682ce217d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:10.675737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e323f-7f01-4716-8eae-55cbbc4307ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:10.676684 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e323f-7f01-4716-8eae-55cbbc4307ec admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:10.677411 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e323f-7f01-4716-8eae-55cbbc4307ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:10.677411 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e323f-7f01-4716-8eae-55cbbc4307ec admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:10.677909 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e323f-7f01-4716-8eae-55cbbc4307ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:10.679819 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e323f-7f01-4716-8eae-55cbbc4307ec admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:10.685317 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4db5c-924f-49d1-8910-cd2682ce217d admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:10.689813 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746fe95-85dd-47a5-88b6-f91a500a378e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:10.690646 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746fe95-85dd-47a5-88b6-f91a500a378e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:10.690919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746fe95-85dd-47a5-88b6-f91a500a378e admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:10.691304 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746fe95-85dd-47a5-88b6-f91a500a378e admin admin] PATH_INFO: `/v3/projects/7cf615b0ab344b459f89499f5f9a5d9a` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:10.692721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746fe95-85dd-47a5-88b6-f91a500a378e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cf615b0ab344b459f89499f5f9a5d9a)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:10.694757 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746fe95-85dd-47a5-88b6-f91a500a378e admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:10.703393 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1013/2036] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:10 2022] POST /identity/v3/users => generated 297 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:10.703393 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e323f-7f01-4716-8eae-55cbbc4307ec admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:10.711579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e323f-7f01-4716-8eae-55cbbc4307ec admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:10.716346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b963124-0844-43c1-8405-1354abfcd5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:10.717328 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b963124-0844-43c1-8405-1354abfcd5ce admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:10.717584 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b963124-0844-43c1-8405-1354abfcd5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:10.717858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b963124-0844-43c1-8405-1354abfcd5ce admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:10.718577 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b963124-0844-43c1-8405-1354abfcd5ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:10.718883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b963124-0844-43c1-8405-1354abfcd5ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:10.720734 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b963124-0844-43c1-8405-1354abfcd5ce admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:10.735698 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1014/2037] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:10.736648 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b963124-0844-43c1-8405-1354abfcd5ce admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:10.738391 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-6b963124-0844-43c1-8405-1354abfcd5ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:10.741293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-2746fe95-85dd-47a5-88b6-f91a500a378e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cf615b0ab344b459f89499f5f9a5d9a', 'request_id': 'req-2746fe95-85dd-47a5-88b6-f91a500a378e'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:10.748860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-2746fe95-85dd-47a5-88b6-f91a500a378e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cf615b0ab344b459f89499f5f9a5d9a', 'request_id': 'req-2746fe95-85dd-47a5-88b6-f91a500a378e'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:10.756588 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-2746fe95-85dd-47a5-88b6-f91a500a378e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cf615b0ab344b459f89499f5f9a5d9a', 'request_id': 'req-2746fe95-85dd-47a5-88b6-f91a500a378e'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:10.768927 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-2746fe95-85dd-47a5-88b6-f91a500a378e admin admin] The token cache is being invalidate because project 7cf615b0ab344b459f89499f5f9a5d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:10.769554 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-2746fe95-85dd-47a5-88b6-f91a500a378e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:10.770471 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-2746fe95-85dd-47a5-88b6-f91a500a378e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:10.772641 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1024/2038] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:10 2022] DELETE /identity/v3/projects/7cf615b0ab344b459f89499f5f9a5d9a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:10.776885 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746fe95-85dd-47a5-88b6-f91a500a378e admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:10.776885 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-2746fe95-85dd-47a5-88b6-f91a500a378e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:10.801805 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b963124-0844-43c1-8405-1354abfcd5ce admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:10.855063 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746fe95-85dd-47a5-88b6-f91a500a378e admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:10.859783 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03304dc6-f170-45e6-a8fe-a1fc533d8e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:10.860471 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03304dc6-f170-45e6-a8fe-a1fc533d8e62 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:10.860747 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03304dc6-f170-45e6-a8fe-a1fc533d8e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:10.861005 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03304dc6-f170-45e6-a8fe-a1fc533d8e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:10.861649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed08dd-6e71-44dd-80d6-5ff868c85d2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:10.861774 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03304dc6-f170-45e6-a8fe-a1fc533d8e62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:10.862302 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed08dd-6e71-44dd-80d6-5ff868c85d2b service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:10.862581 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed08dd-6e71-44dd-80d6-5ff868c85d2b service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:10.862995 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed08dd-6e71-44dd-80d6-5ff868c85d2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:10.863579 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03304dc6-f170-45e6-a8fe-a1fc533d8e62 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:10.865499 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-94ed08dd-6e71-44dd-80d6-5ff868c85d2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:10.893784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1025/2039] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:10 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:10.895469 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03304dc6-f170-45e6-a8fe-a1fc533d8e62 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:10.899883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-03304dc6-f170-45e6-a8fe-a1fc533d8e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:10.940731 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed08dd-6e71-44dd-80d6-5ff868c85d2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:10.942449 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed08dd-6e71-44dd-80d6-5ff868c85d2b service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:10.953109 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1015/2040] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:10.953935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed08dd-6e71-44dd-80d6-5ff868c85d2b service cinder] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:10.955307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-94ed08dd-6e71-44dd-80d6-5ff868c85d2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:10.982117 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed08dd-6e71-44dd-80d6-5ff868c85d2b service cinder] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:10.983365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03304dc6-f170-45e6-a8fe-a1fc533d8e62 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:10.987439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8613f9-9944-4a55-b1ce-1fc3de10cffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:10.988085 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8613f9-9944-4a55-b1ce-1fc3de10cffd admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:10.988513 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8613f9-9944-4a55-b1ce-1fc3de10cffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:10.989451 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8613f9-9944-4a55-b1ce-1fc3de10cffd admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:10.990217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b30912-5526-4681-9914-7ff05247d603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:10.990344 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8613f9-9944-4a55-b1ce-1fc3de10cffd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:10.991000 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b30912-5526-4681-9914-7ff05247d603 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:10.991284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b30912-5526-4681-9914-7ff05247d603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:10.991648 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b30912-5526-4681-9914-7ff05247d603 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:10.992279 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8613f9-9944-4a55-b1ce-1fc3de10cffd admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:10.992386 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b30912-5526-4681-9914-7ff05247d603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:10.994296 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b30912-5526-4681-9914-7ff05247d603 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:11.007835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1026/2041] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:11.009334 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8d364-b8bb-4f39-b569-243c9517dc48 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:11.009625 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8d364-b8bb-4f39-b569-243c9517dc48 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:11.009901 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8d364-b8bb-4f39-b569-243c9517dc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:11.023640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1016/2042] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:10 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:11.025119 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8613f9-9944-4a55-b1ce-1fc3de10cffd admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:11.031880 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-56f8d364-b8bb-4f39-b569-243c9517dc48 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:11.033109 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-56f8d364-b8bb-4f39-b569-243c9517dc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:11.096494 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8613f9-9944-4a55-b1ce-1fc3de10cffd admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:11.104256 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1027/2043] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:11.105112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8d364-b8bb-4f39-b569-243c9517dc48 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:11.106201 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb135a-ca18-4c8e-a6ff-da62e73c1a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:11.107051 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb135a-ca18-4c8e-a6ff-da62e73c1a50 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:11.107572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb135a-ca18-4c8e-a6ff-da62e73c1a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:11.108022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb135a-ca18-4c8e-a6ff-da62e73c1a50 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:11.108991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb135a-ca18-4c8e-a6ff-da62e73c1a50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:11.111088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb135a-ca18-4c8e-a6ff-da62e73c1a50 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:11.121175 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8d364-b8bb-4f39-b569-243c9517dc48 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:11.130243 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531dd49-e746-4bd7-82cc-114f70b79e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:11.131461 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531dd49-e746-4bd7-82cc-114f70b79e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:11.131972 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531dd49-e746-4bd7-82cc-114f70b79e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:11.132404 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531dd49-e746-4bd7-82cc-114f70b79e2c admin admin] PATH_INFO: `/v3/projects/56b37ae1234a4eb29ecf46f51e4780dc/users/3060bd3c160c442bb7f8aa5e4b01a22e/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:11.138645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1017/2044] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:11 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:11.138645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb135a-ca18-4c8e-a6ff-da62e73c1a50 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:11.150248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb135a-ca18-4c8e-a6ff-da62e73c1a50 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:11.153456 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531dd49-e746-4bd7-82cc-114f70b79e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b37ae1234a4eb29ecf46f51e4780dc, user_id=3060bd3c160c442bb7f8aa5e4b01a22e, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:11.155641 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59b288-da5a-4eee-9568-c878c0265f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:11.156523 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531dd49-e746-4bd7-82cc-114f70b79e2c admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:11.156677 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59b288-da5a-4eee-9568-c878c0265f6b admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:11.156958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59b288-da5a-4eee-9568-c878c0265f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:11.157308 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59b288-da5a-4eee-9568-c878c0265f6b admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:11.158131 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59b288-da5a-4eee-9568-c878c0265f6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:11.160417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59b288-da5a-4eee-9568-c878c0265f6b admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:11.170313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1028/2045] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:11 2022] PUT /identity/v3/projects/56b37ae1234a4eb29ecf46f51e4780dc/users/3060bd3c160c442bb7f8aa5e4b01a22e/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:11.171673 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af3d26-8102-4559-b6e0-bac83da075e1 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:11.171957 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af3d26-8102-4559-b6e0-bac83da075e1 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:11.172250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af3d26-8102-4559-b6e0-bac83da075e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:11.188391 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1018/2046] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:11 2022] POST /identity/v3/users => generated 285 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:11.189685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59b288-da5a-4eee-9568-c878c0265f6b admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:11.190967 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-55af3d26-8102-4559-b6e0-bac83da075e1 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:11.192791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-55af3d26-8102-4559-b6e0-bac83da075e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:11.204099 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59b288-da5a-4eee-9568-c878c0265f6b admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:11.287043 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1029/2047] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:11.290253 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af3d26-8102-4559-b6e0-bac83da075e1 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:11.292907 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e5b35-fa1d-479c-9061-dfeeb532124e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:11.293970 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e5b35-fa1d-479c-9061-dfeeb532124e admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:11.294254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e5b35-fa1d-479c-9061-dfeeb532124e admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:11.294645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e5b35-fa1d-479c-9061-dfeeb532124e admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:11.295757 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e5b35-fa1d-479c-9061-dfeeb532124e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:11.298283 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e5b35-fa1d-479c-9061-dfeeb532124e admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:11.298959 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af3d26-8102-4559-b6e0-bac83da075e1 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:11.313961 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1019/2048] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:11.313961 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e5b35-fa1d-479c-9061-dfeeb532124e admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:11.316829 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93c231-4999-4482-9360-c5a703c5a9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:11.317610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93c231-4999-4482-9360-c5a703c5a9dd admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:11.318383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93c231-4999-4482-9360-c5a703c5a9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:11.318660 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93c231-4999-4482-9360-c5a703c5a9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:11.319405 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93c231-4999-4482-9360-c5a703c5a9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:11.321093 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93c231-4999-4482-9360-c5a703c5a9dd admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:11.328545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e5b35-fa1d-479c-9061-dfeeb532124e admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:11.336546 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1030/2049] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:11.336749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3494483-e440-4b45-bcc0-0a6ad57dddd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:11.336865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93c231-4999-4482-9360-c5a703c5a9dd admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:11.336974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3494483-e440-4b45-bcc0-0a6ad57dddd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:11.336974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3494483-e440-4b45-bcc0-0a6ad57dddd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:11.336974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3494483-e440-4b45-bcc0-0a6ad57dddd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:11.336974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3494483-e440-4b45-bcc0-0a6ad57dddd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:11.337952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3494483-e440-4b45-bcc0-0a6ad57dddd3 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:11.344714 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93c231-4999-4482-9360-c5a703c5a9dd admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:11.350371 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a367f4-49af-4136-910b-74e95d1cd104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:11.351025 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a367f4-49af-4136-910b-74e95d1cd104 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:11.351288 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a367f4-49af-4136-910b-74e95d1cd104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:11.351564 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a367f4-49af-4136-910b-74e95d1cd104 admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:11.352319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a367f4-49af-4136-910b-74e95d1cd104 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:11.352638 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a367f4-49af-4136-910b-74e95d1cd104 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:11.353547 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1020/2050] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:11.354176 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3494483-e440-4b45-bcc0-0a6ad57dddd3 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:11.354767 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a367f4-49af-4136-910b-74e95d1cd104 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:11.365690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3494483-e440-4b45-bcc0-0a6ad57dddd3 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:11.369899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1031/2051] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:11.370613 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a367f4-49af-4136-910b-74e95d1cd104 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:11.370817 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba0f2e-24f1-499f-99a8-36b54c572188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:11.371500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba0f2e-24f1-499f-99a8-36b54c572188 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:11.371795 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba0f2e-24f1-499f-99a8-36b54c572188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:11.372072 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba0f2e-24f1-499f-99a8-36b54c572188 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:11.372840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba0f2e-24f1-499f-99a8-36b54c572188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:11.374882 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba0f2e-24f1-499f-99a8-36b54c572188 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:11.383857 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a367f4-49af-4136-910b-74e95d1cd104 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:11.390416 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1021/2052] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:11.390416 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba0f2e-24f1-499f-99a8-36b54c572188 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:11.392670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167d7a6-6435-4d80-9c99-7b2a8486fde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:11.393807 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167d7a6-6435-4d80-9c99-7b2a8486fde0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:11.394075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167d7a6-6435-4d80-9c99-7b2a8486fde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:11.394344 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167d7a6-6435-4d80-9c99-7b2a8486fde0 admin admin] PATH_INFO: `/v3/projects/56b37ae1234a4eb29ecf46f51e4780dc/users/3060bd3c160c442bb7f8aa5e4b01a22e/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:11.396743 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167d7a6-6435-4d80-9c99-7b2a8486fde0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b37ae1234a4eb29ecf46f51e4780dc, user_id=3060bd3c160c442bb7f8aa5e4b01a22e, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:11.398475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba0f2e-24f1-499f-99a8-36b54c572188 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:11.399521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167d7a6-6435-4d80-9c99-7b2a8486fde0 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:11.403831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fea5e-4a8f-4e68-b585-a7a0c95b2c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:11.404528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fea5e-4a8f-4e68-b585-a7a0c95b2c69 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:11.404823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fea5e-4a8f-4e68-b585-a7a0c95b2c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:11.405084 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fea5e-4a8f-4e68-b585-a7a0c95b2c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:11.405814 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fea5e-4a8f-4e68-b585-a7a0c95b2c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:11.407402 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fea5e-4a8f-4e68-b585-a7a0c95b2c69 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:11.411845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1032/2053] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:11 2022] PUT /identity/v3/projects/56b37ae1234a4eb29ecf46f51e4780dc/users/3060bd3c160c442bb7f8aa5e4b01a22e/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:11.413277 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167d7a6-6435-4d80-9c99-7b2a8486fde0 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:11.420185 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1022/2054] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:11.420185 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fea5e-4a8f-4e68-b585-a7a0c95b2c69 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:11.430818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fea5e-4a8f-4e68-b585-a7a0c95b2c69 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:11.481491 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167d7a6-6435-4d80-9c99-7b2a8486fde0 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:11.485500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682f319-d5a9-4117-a77b-300ab4dd8d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:11.486389 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682f319-d5a9-4117-a77b-300ab4dd8d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:11.486671 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682f319-d5a9-4117-a77b-300ab4dd8d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:11.486870 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46ee28-6bdd-4898-a61b-72a6b3411c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:11.486989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682f319-d5a9-4117-a77b-300ab4dd8d0b admin admin] PATH_INFO: `/v3/projects/f0b56debbc154bf4a13e91cd7ea8dbf2/users/e679173a8a6947be97076a82de8003e9/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:11.488073 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46ee28-6bdd-4898-a61b-72a6b3411c4e admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:11.488396 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46ee28-6bdd-4898-a61b-72a6b3411c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:11.489170 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46ee28-6bdd-4898-a61b-72a6b3411c4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:11.490237 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46ee28-6bdd-4898-a61b-72a6b3411c4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:11.492308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46ee28-6bdd-4898-a61b-72a6b3411c4e admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:11.501784 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682f319-d5a9-4117-a77b-300ab4dd8d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b56debbc154bf4a13e91cd7ea8dbf2, user_id=e679173a8a6947be97076a82de8003e9, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:11.505013 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682f319-d5a9-4117-a77b-300ab4dd8d0b admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:11.519322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1023/2055] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:11 2022] PUT /identity/v3/projects/f0b56debbc154bf4a13e91cd7ea8dbf2/users/e679173a8a6947be97076a82de8003e9/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:11.519587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1033/2056] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:11 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:11.520348 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682f319-d5a9-4117-a77b-300ab4dd8d0b admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:11.522089 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91844c-786a-4a55-b338-543387addb57 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:11.522510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91844c-786a-4a55-b338-543387addb57 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:11.522919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91844c-786a-4a55-b338-543387addb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:11.548560 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-db91844c-786a-4a55-b338-543387addb57 None None] MFA Rules not processed for user `3060bd3c160c442bb7f8aa5e4b01a22e`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:11.549803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-db91844c-786a-4a55-b338-543387addb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:11.588951 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682f319-d5a9-4117-a77b-300ab4dd8d0b admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:11.621489 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1034/2057] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:11.622730 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91844c-786a-4a55-b338-543387addb57 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:11.649796 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e437f-4fd3-4f86-a754-719dd9396ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:11.651622 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e437f-4fd3-4f86-a754-719dd9396ac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:11.651622 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e437f-4fd3-4f86-a754-719dd9396ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:11.651622 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e437f-4fd3-4f86-a754-719dd9396ac8 admin admin] PATH_INFO: `/v3/projects/c98a05cfa3bf4f5aa5a22eb7c50c1c1b/users/9b5da81b394b46cca63d907ee90d6710/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:11.668037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e437f-4fd3-4f86-a754-719dd9396ac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c98a05cfa3bf4f5aa5a22eb7c50c1c1b, user_id=9b5da81b394b46cca63d907ee90d6710, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:11.670943 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e437f-4fd3-4f86-a754-719dd9396ac8 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:11.684835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1024/2058] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:11 2022] PUT /identity/v3/projects/c98a05cfa3bf4f5aa5a22eb7c50c1c1b/users/9b5da81b394b46cca63d907ee90d6710/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:11.686140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae39da-24e2-4bd0-a339-5ac1b427401e None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:11.686430 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae39da-24e2-4bd0-a339-5ac1b427401e None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:11.686707 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae39da-24e2-4bd0-a339-5ac1b427401e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:11.693784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91844c-786a-4a55-b338-543387addb57 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:11.716716 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-d4ae39da-24e2-4bd0-a339-5ac1b427401e None None] MFA Rules not processed for user `e679173a8a6947be97076a82de8003e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:11.717942 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-d4ae39da-24e2-4bd0-a339-5ac1b427401e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:11.749753 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5eb36b-5cb7-4dfc-ac1a-fd3c1aa383c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:11.750430 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5eb36b-5cb7-4dfc-ac1a-fd3c1aa383c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:11.750711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5eb36b-5cb7-4dfc-ac1a-fd3c1aa383c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:11.750985 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5eb36b-5cb7-4dfc-ac1a-fd3c1aa383c3 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:11.751675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5eb36b-5cb7-4dfc-ac1a-fd3c1aa383c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:11.753680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5eb36b-5cb7-4dfc-ac1a-fd3c1aa383c3 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:11.775262 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1035/2059] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:11 2022] POST /identity/v3/users => generated 294 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:11.776005 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5eb36b-5cb7-4dfc-ac1a-fd3c1aa383c3 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:11.777645 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-db5eb36b-5cb7-4dfc-ac1a-fd3c1aa383c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:11.784445 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1025/2060] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:11.789229 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a1d6d-e217-4955-b64e-044cd5ac230c None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:11.789229 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a1d6d-e217-4955-b64e-044cd5ac230c None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:11.789229 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a1d6d-e217-4955-b64e-044cd5ac230c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:11.816547 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-a05a1d6d-e217-4955-b64e-044cd5ac230c None None] MFA Rules not processed for user `9b5da81b394b46cca63d907ee90d6710`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:11.817966 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-a05a1d6d-e217-4955-b64e-044cd5ac230c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:11.837553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5eb36b-5cb7-4dfc-ac1a-fd3c1aa383c3 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:11.841260 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd20bc-7b42-475b-90ea-012401fb8bb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:11.841905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd20bc-7b42-475b-90ea-012401fb8bb8 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:11.842191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd20bc-7b42-475b-90ea-012401fb8bb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:11.843105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd20bc-7b42-475b-90ea-012401fb8bb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:11.883837 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1026/2061] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:11.884831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a1d6d-e217-4955-b64e-044cd5ac230c None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:11.897893 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a1d6d-e217-4955-b64e-044cd5ac230c None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:11.902812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22598a8-51dd-4f89-a9e5-ad43da0af5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:11.903470 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22598a8-51dd-4f89-a9e5-ad43da0af5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:11.903749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22598a8-51dd-4f89-a9e5-ad43da0af5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:11.904023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22598a8-51dd-4f89-a9e5-ad43da0af5f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:11.904849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22598a8-51dd-4f89-a9e5-ad43da0af5f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:11.906438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22598a8-51dd-4f89-a9e5-ad43da0af5f3 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:11.915602 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd20bc-7b42-475b-90ea-012401fb8bb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:11.917085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd20bc-7b42-475b-90ea-012401fb8bb8 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:11.917197 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1027/2062] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:11.917928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22598a8-51dd-4f89-a9e5-ad43da0af5f3 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:11.919504 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f22598a8-51dd-4f89-a9e5-ad43da0af5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:11.927430 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1036/2063] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:11.928330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd20bc-7b42-475b-90ea-012401fb8bb8 service cinder] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:11.930357 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-fbdd20bc-7b42-475b-90ea-012401fb8bb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:11.933205 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22598a8-51dd-4f89-a9e5-ad43da0af5f3 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:11.937916 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771daec6-5a57-4675-ba52-8a94e4d42bc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:11.939728 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771daec6-5a57-4675-ba52-8a94e4d42bc1 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:11.940014 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771daec6-5a57-4675-ba52-8a94e4d42bc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:11.940325 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771daec6-5a57-4675-ba52-8a94e4d42bc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:11.952103 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771daec6-5a57-4675-ba52-8a94e4d42bc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:11.954253 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771daec6-5a57-4675-ba52-8a94e4d42bc1 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:11.966819 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1028/2064] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:11.967735 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771daec6-5a57-4675-ba52-8a94e4d42bc1 service cinder] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:11.984455 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771daec6-5a57-4675-ba52-8a94e4d42bc1 service cinder] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:11.994625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3552683-8313-4c75-9de1-0ac6b7dcf4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:11.995452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3552683-8313-4c75-9de1-0ac6b7dcf4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:11.995742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3552683-8313-4c75-9de1-0ac6b7dcf4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:11.996018 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3552683-8313-4c75-9de1-0ac6b7dcf4e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:11.997398 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3552683-8313-4c75-9de1-0ac6b7dcf4e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:11.999446 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3552683-8313-4c75-9de1-0ac6b7dcf4e3 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:12.008823 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd20bc-7b42-475b-90ea-012401fb8bb8 service cinder] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:12.013565 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5aec3a-a331-4912-a4d5-9a5cae6018e1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62c3f9351a4181a4fc2930570171b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:12.014417 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5aec3a-a331-4912-a4d5-9a5cae6018e1 service glance] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:12.014550 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1029/2065] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:12.014975 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5aec3a-a331-4912-a4d5-9a5cae6018e1 service glance] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:12.015307 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5aec3a-a331-4912-a4d5-9a5cae6018e1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:12.015736 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3552683-8313-4c75-9de1-0ac6b7dcf4e3 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:12.026371 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5aec3a-a331-4912-a4d5-9a5cae6018e1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:12.027759 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5aec3a-a331-4912-a4d5-9a5cae6018e1 service glance] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:12.029030 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3552683-8313-4c75-9de1-0ac6b7dcf4e3 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:12.034574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb20ce0-f2ee-4b3a-b1f1-f850826293fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:12.037153 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb20ce0-f2ee-4b3a-b1f1-f850826293fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:12.037571 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb20ce0-f2ee-4b3a-b1f1-f850826293fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:12.038126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb20ce0-f2ee-4b3a-b1f1-f850826293fa admin admin] PATH_INFO: `/v3/users/e679173a8a6947be97076a82de8003e9` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:12.038729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1037/2066] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:11 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:12.039571 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5aec3a-a331-4912-a4d5-9a5cae6018e1 service glance] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:12.042599 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb20ce0-f2ee-4b3a-b1f1-f850826293fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e679173a8a6947be97076a82de8003e9)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:12.048585 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb20ce0-f2ee-4b3a-b1f1-f850826293fa admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:12.057656 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5aec3a-a331-4912-a4d5-9a5cae6018e1 service glance] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:12.075568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22057e5-b176-4202-8763-268423020a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:12.077050 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22057e5-b176-4202-8763-268423020a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:12.077538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22057e5-b176-4202-8763-268423020a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:12.077991 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22057e5-b176-4202-8763-268423020a2a admin admin] PATH_INFO: `/v3/projects/d63c78821beb464faaa13ba04711ce09/users/0e191a316a754c46aac3cadc4336cf2e/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:12.100483 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22057e5-b176-4202-8763-268423020a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63c78821beb464faaa13ba04711ce09, user_id=0e191a316a754c46aac3cadc4336cf2e, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:12.103338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22057e5-b176-4202-8763-268423020a2a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:12.131668 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1038/2067] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:12 2022] PUT /identity/v3/projects/d63c78821beb464faaa13ba04711ce09/users/0e191a316a754c46aac3cadc4336cf2e/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:12.131668 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22057e5-b176-4202-8763-268423020a2a admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:12.156821 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-3bb20ce0-f2ee-4b3a-b1f1-f850826293fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e679173a8a6947be97076a82de8003e9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:12.173334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-3bb20ce0-f2ee-4b3a-b1f1-f850826293fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e679173a8a6947be97076a82de8003e9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:12.182097 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-3bb20ce0-f2ee-4b3a-b1f1-f850826293fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e679173a8a6947be97076a82de8003e9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:12.183098 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-3bb20ce0-f2ee-4b3a-b1f1-f850826293fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e679173a8a6947be97076a82de8003e9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:12.191719 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-3bb20ce0-f2ee-4b3a-b1f1-f850826293fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e679173a8a6947be97076a82de8003e9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:12.194444 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22057e5-b176-4202-8763-268423020a2a admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:12.198851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538afa7-cbc4-4071-ba69-7972f0f25680 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:12.199489 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538afa7-cbc4-4071-ba69-7972f0f25680 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:12.199768 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538afa7-cbc4-4071-ba69-7972f0f25680 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:12.200221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1030/2068] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:12 2022] DELETE /identity/v3/users/e679173a8a6947be97076a82de8003e9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:12.200334 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538afa7-cbc4-4071-ba69-7972f0f25680 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:12.201505 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e51522-8f0b-46ca-8488-163f6e95269f None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:12.201794 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e51522-8f0b-46ca-8488-163f6e95269f None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:12.202068 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e51522-8f0b-46ca-8488-163f6e95269f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:12.205406 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-b538afa7-cbc4-4071-ba69-7972f0f25680 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:12.233097 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-51e51522-8f0b-46ca-8488-163f6e95269f None None] MFA Rules not processed for user `0e191a316a754c46aac3cadc4336cf2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:12.234038 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-51e51522-8f0b-46ca-8488-163f6e95269f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:12.272910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538afa7-cbc4-4071-ba69-7972f0f25680 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:12.274365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538afa7-cbc4-4071-ba69-7972f0f25680 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:12.284640 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1039/2069] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:12.286061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30af87a-e507-4b3c-b40b-7a45d0b433ca None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:12.286061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30af87a-e507-4b3c-b40b-7a45d0b433ca None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:12.286682 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30af87a-e507-4b3c-b40b-7a45d0b433ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:12.309080 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-b30af87a-e507-4b3c-b40b-7a45d0b433ca None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:12.310346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-b30af87a-e507-4b3c-b40b-7a45d0b433ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:12.313763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1031/2070] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:12.319698 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e51522-8f0b-46ca-8488-163f6e95269f None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:12.322790 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-51e51522-8f0b-46ca-8488-163f6e95269f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:12.408244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1040/2071] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:12.408454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e51522-8f0b-46ca-8488-163f6e95269f None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:12.413578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e6586-1c37-454d-b324-88182b12da7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:12.414664 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e6586-1c37-454d-b324-88182b12da7d admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:12.414664 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e6586-1c37-454d-b324-88182b12da7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:12.415382 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e6586-1c37-454d-b324-88182b12da7d admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:12.416308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30af87a-e507-4b3c-b40b-7a45d0b433ca None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:12.416434 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e6586-1c37-454d-b324-88182b12da7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:12.417871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-b30af87a-e507-4b3c-b40b-7a45d0b433ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:12.418805 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e6586-1c37-454d-b324-88182b12da7d admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:12.456042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1032/2072] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:12 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:12.462599 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e6586-1c37-454d-b324-88182b12da7d admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:12.487724 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30af87a-e507-4b3c-b40b-7a45d0b433ca None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:12.556022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01253f39-587a-4849-9c09-12982029a022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:12.556447 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01253f39-587a-4849-9c09-12982029a022 service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:12.556748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01253f39-587a-4849-9c09-12982029a022 service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:12.558550 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01253f39-587a-4849-9c09-12982029a022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:12.564417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e6586-1c37-454d-b324-88182b12da7d admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:12.567766 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01253f39-587a-4849-9c09-12982029a022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:12.569244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01253f39-587a-4849-9c09-12982029a022 service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:12.570300 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd0766-e87d-4b83-9df0-de5f620780e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:12.571376 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd0766-e87d-4b83-9df0-de5f620780e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:12.571694 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd0766-e87d-4b83-9df0-de5f620780e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:12.572189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd0766-e87d-4b83-9df0-de5f620780e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:12.573209 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd0766-e87d-4b83-9df0-de5f620780e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:12.575446 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd0766-e87d-4b83-9df0-de5f620780e4 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:12.580233 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1041/2073] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:26:12.608247 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1033/2074] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:12 2022] POST /identity/v3/users => generated 300 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:12.620771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01253f39-587a-4849-9c09-12982029a022 service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:12.641871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01253f39-587a-4849-9c09-12982029a022 service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:12.650445 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ef1ed-f04e-4322-a38b-dd7fb1de5386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:12.651176 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ef1ed-f04e-4322-a38b-dd7fb1de5386 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:12.651495 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ef1ed-f04e-4322-a38b-dd7fb1de5386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:12.651769 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ef1ed-f04e-4322-a38b-dd7fb1de5386 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:12.652577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ef1ed-f04e-4322-a38b-dd7fb1de5386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:12.654181 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ef1ed-f04e-4322-a38b-dd7fb1de5386 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:12.668168 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1042/2075] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:12.673321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd0766-e87d-4b83-9df0-de5f620780e4 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:12.685458 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd0766-e87d-4b83-9df0-de5f620780e4 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:12.698523 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16557907-0f9b-41b2-ace1-dcb88eba5227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:12.699679 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16557907-0f9b-41b2-ace1-dcb88eba5227 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:12.700084 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16557907-0f9b-41b2-ace1-dcb88eba5227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:12.700466 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16557907-0f9b-41b2-ace1-dcb88eba5227 admin admin] PATH_INFO: `/v3/projects/87578fdf1fd94b85856789ede085a68b/users/b9e2eb18a7444ea18dacf91539eb6824/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:12.729402 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16557907-0f9b-41b2-ace1-dcb88eba5227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87578fdf1fd94b85856789ede085a68b, user_id=b9e2eb18a7444ea18dacf91539eb6824, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:12.732517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16557907-0f9b-41b2-ace1-dcb88eba5227 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:12.751361 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1034/2076] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:12 2022] PUT /identity/v3/projects/87578fdf1fd94b85856789ede085a68b/users/b9e2eb18a7444ea18dacf91539eb6824/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:12.756983 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ef1ed-f04e-4322-a38b-dd7fb1de5386 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:12.771552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ef1ed-f04e-4322-a38b-dd7fb1de5386 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:12.840057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d2172-14b6-415d-b0ca-5388f8abe549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:12.840813 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d2172-14b6-415d-b0ca-5388f8abe549 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:12.841060 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d2172-14b6-415d-b0ca-5388f8abe549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:12.841329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d2172-14b6-415d-b0ca-5388f8abe549 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:12.842078 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d2172-14b6-415d-b0ca-5388f8abe549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:12.843726 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d2172-14b6-415d-b0ca-5388f8abe549 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:12.854410 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1043/2077] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:12.858664 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16557907-0f9b-41b2-ace1-dcb88eba5227 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:12.869295 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16557907-0f9b-41b2-ace1-dcb88eba5227 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:12.874012 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799d2d3-dd50-491a-8c55-38acaab12aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:12.874903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799d2d3-dd50-491a-8c55-38acaab12aad admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:12.875186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799d2d3-dd50-491a-8c55-38acaab12aad admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:12.875463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799d2d3-dd50-491a-8c55-38acaab12aad admin admin] PATH_INFO: `/v3/projects/87578fdf1fd94b85856789ede085a68b/users/b9e2eb18a7444ea18dacf91539eb6824/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:12.877510 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799d2d3-dd50-491a-8c55-38acaab12aad admin admin] RBAC: Authorizing `identity:create_grant(project_id=87578fdf1fd94b85856789ede085a68b, user_id=b9e2eb18a7444ea18dacf91539eb6824, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:12.880251 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799d2d3-dd50-491a-8c55-38acaab12aad admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:12.890623 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1035/2078] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:12 2022] PUT /identity/v3/projects/87578fdf1fd94b85856789ede085a68b/users/b9e2eb18a7444ea18dacf91539eb6824/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:12.902617 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911bb40-8a91-4474-ac86-28fe000105f4 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:12.902905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911bb40-8a91-4474-ac86-28fe000105f4 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:12.903184 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911bb40-8a91-4474-ac86-28fe000105f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:12.936600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799d2d3-dd50-491a-8c55-38acaab12aad admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:12.938868 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-2799d2d3-dd50-491a-8c55-38acaab12aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:12.941089 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-a911bb40-8a91-4474-ac86-28fe000105f4 None None] MFA Rules not processed for user `b9e2eb18a7444ea18dacf91539eb6824`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:12.948203 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-a911bb40-8a91-4474-ac86-28fe000105f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:13.030007 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799d2d3-dd50-491a-8c55-38acaab12aad admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:13.033412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1044/2079] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:13.034991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190141d9-60e5-492d-a804-8b60a1fed8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:13.036471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190141d9-60e5-492d-a804-8b60a1fed8cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:13.036759 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190141d9-60e5-492d-a804-8b60a1fed8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:13.037125 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190141d9-60e5-492d-a804-8b60a1fed8cb admin admin] PATH_INFO: `/v3/projects/f0b56debbc154bf4a13e91cd7ea8dbf2` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:13.038470 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190141d9-60e5-492d-a804-8b60a1fed8cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b56debbc154bf4a13e91cd7ea8dbf2)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:13.040435 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190141d9-60e5-492d-a804-8b60a1fed8cb admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:13.048976 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911bb40-8a91-4474-ac86-28fe000105f4 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:13.050505 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-a911bb40-8a91-4474-ac86-28fe000105f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:13.095047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-190141d9-60e5-492d-a804-8b60a1fed8cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b56debbc154bf4a13e91cd7ea8dbf2', 'request_id': 'req-190141d9-60e5-492d-a804-8b60a1fed8cb'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:13.101677 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-190141d9-60e5-492d-a804-8b60a1fed8cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b56debbc154bf4a13e91cd7ea8dbf2', 'request_id': 'req-190141d9-60e5-492d-a804-8b60a1fed8cb'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:13.115435 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-190141d9-60e5-492d-a804-8b60a1fed8cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b56debbc154bf4a13e91cd7ea8dbf2', 'request_id': 'req-190141d9-60e5-492d-a804-8b60a1fed8cb'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:13.117885 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911bb40-8a91-4474-ac86-28fe000105f4 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:13.128201 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-190141d9-60e5-492d-a804-8b60a1fed8cb admin admin] The token cache is being invalidate because project f0b56debbc154bf4a13e91cd7ea8dbf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:13.129341 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-190141d9-60e5-492d-a804-8b60a1fed8cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:13.129341 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-190141d9-60e5-492d-a804-8b60a1fed8cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:13.132413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1036/2080] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:12 2022] DELETE /identity/v3/projects/f0b56debbc154bf4a13e91cd7ea8dbf2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:26:13.138803 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a208713-394f-40a1-a283-f7eeb2e896a4 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:13.139321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a208713-394f-40a1-a283-f7eeb2e896a4 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:13.139718 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a208713-394f-40a1-a283-f7eeb2e896a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:13.173450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-0a208713-394f-40a1-a283-f7eeb2e896a4 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:13.174937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-0a208713-394f-40a1-a283-f7eeb2e896a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:13.186606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9806e44-e848-4173-9167-c27f22132dc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:13.187245 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9806e44-e848-4173-9167-c27f22132dc6 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:13.187525 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9806e44-e848-4173-9167-c27f22132dc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:13.187799 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9806e44-e848-4173-9167-c27f22132dc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:13.189683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c9806e44-e848-4173-9167-c27f22132dc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:13.284678 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1037/2081] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:13.288815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9806e44-e848-4173-9167-c27f22132dc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:13.290393 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9806e44-e848-4173-9167-c27f22132dc6 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:13.293319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e70a5-7289-4d84-be51-6f24c964b1ea None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:13.293687 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e70a5-7289-4d84-be51-6f24c964b1ea None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:13.294022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e70a5-7289-4d84-be51-6f24c964b1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:13.302504 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1045/2082] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:13.313956 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-8c8e70a5-7289-4d84-be51-6f24c964b1ea None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:13.315187 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-8c8e70a5-7289-4d84-be51-6f24c964b1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:13.323709 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1038/2083] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:26:13.328688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9806e44-e848-4173-9167-c27f22132dc6 service cinder] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:13.339902 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9806e44-e848-4173-9167-c27f22132dc6 service cinder] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:13.346458 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d694a27-a4b7-4ca0-9d39-3a4f1c730ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:13.347115 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d694a27-a4b7-4ca0-9d39-3a4f1c730ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:13.347419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d694a27-a4b7-4ca0-9d39-3a4f1c730ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:13.347671 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d694a27-a4b7-4ca0-9d39-3a4f1c730ed5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:13.349070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d694a27-a4b7-4ca0-9d39-3a4f1c730ed5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:13.349380 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d694a27-a4b7-4ca0-9d39-3a4f1c730ed5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:13.350977 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d694a27-a4b7-4ca0-9d39-3a4f1c730ed5 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:13.364706 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1046/2084] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:13.370218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e70a5-7289-4d84-be51-6f24c964b1ea None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:13.380618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e70a5-7289-4d84-be51-6f24c964b1ea None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:13.385780 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d1e40-b436-4fee-8013-36bcb24092c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:13.386477 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d1e40-b436-4fee-8013-36bcb24092c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:13.386781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d1e40-b436-4fee-8013-36bcb24092c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:13.387055 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d1e40-b436-4fee-8013-36bcb24092c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:13.387750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d1e40-b436-4fee-8013-36bcb24092c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:13.390287 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d1e40-b436-4fee-8013-36bcb24092c0 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:13.422459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1039/2085] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:13 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:13.423629 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d694a27-a4b7-4ca0-9d39-3a4f1c730ed5 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:13.438170 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d694a27-a4b7-4ca0-9d39-3a4f1c730ed5 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:13.499407 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2294e-e9bb-4211-b271-f01e7709d0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:13.500512 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2294e-e9bb-4211-b271-f01e7709d0be admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:13.500694 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2294e-e9bb-4211-b271-f01e7709d0be admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:13.500997 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2294e-e9bb-4211-b271-f01e7709d0be admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:13.502157 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2294e-e9bb-4211-b271-f01e7709d0be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:13.504796 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2294e-e9bb-4211-b271-f01e7709d0be admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:13.528083 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1047/2086] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:13 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:13.532232 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d1e40-b436-4fee-8013-36bcb24092c0 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:13.543824 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d1e40-b436-4fee-8013-36bcb24092c0 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:13.553028 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeedb53c-03bc-41b1-ae8d-2b6cc6f9a449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:13.553028 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedb53c-03bc-41b1-ae8d-2b6cc6f9a449 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:13.553028 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedb53c-03bc-41b1-ae8d-2b6cc6f9a449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:13.553028 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedb53c-03bc-41b1-ae8d-2b6cc6f9a449 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:13.553346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeedb53c-03bc-41b1-ae8d-2b6cc6f9a449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:13.553523 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeedb53c-03bc-41b1-ae8d-2b6cc6f9a449 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:13.564488 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1040/2087] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:26:13.568563 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2294e-e9bb-4211-b271-f01e7709d0be admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:13.578411 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2294e-e9bb-4211-b271-f01e7709d0be admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:13.583704 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6743887-0cc0-4d97-ba1c-5e4c30fe321a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:13.584392 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6743887-0cc0-4d97-ba1c-5e4c30fe321a admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:13.584673 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6743887-0cc0-4d97-ba1c-5e4c30fe321a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:13.584943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6743887-0cc0-4d97-ba1c-5e4c30fe321a admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:13.585671 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6743887-0cc0-4d97-ba1c-5e4c30fe321a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:13.587338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6743887-0cc0-4d97-ba1c-5e4c30fe321a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:13.602315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1048/2088] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:13.603501 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeedb53c-03bc-41b1-ae8d-2b6cc6f9a449 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:13.617503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeedb53c-03bc-41b1-ae8d-2b6cc6f9a449 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:13.642527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d6f33-b27c-4e94-885a-5c68c16cdf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:13.643697 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d6f33-b27c-4e94-885a-5c68c16cdf5a admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:13.644516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d6f33-b27c-4e94-885a-5c68c16cdf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:13.645523 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d6f33-b27c-4e94-885a-5c68c16cdf5a admin admin] PATH_INFO: `/v3/projects/9151f805e5a647beb504f38073404862/users/51e9625a35fd4177a14d560c9696f515/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:13.665151 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d6f33-b27c-4e94-885a-5c68c16cdf5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9151f805e5a647beb504f38073404862, user_id=51e9625a35fd4177a14d560c9696f515, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:13.667885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d6f33-b27c-4e94-885a-5c68c16cdf5a admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:13.694612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1041/2089] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:13 2022] PUT /identity/v3/projects/9151f805e5a647beb504f38073404862/users/51e9625a35fd4177a14d560c9696f515/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:13.705514 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f5d55-4b61-4414-a83a-cf4f33585868 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:13.705804 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f5d55-4b61-4414-a83a-cf4f33585868 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:13.706078 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f5d55-4b61-4414-a83a-cf4f33585868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:13.737228 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-ce1f5d55-4b61-4414-a83a-cf4f33585868 None None] MFA Rules not processed for user `51e9625a35fd4177a14d560c9696f515`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:13.738474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-ce1f5d55-4b61-4414-a83a-cf4f33585868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:13.835794 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d6f33-b27c-4e94-885a-5c68c16cdf5a admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:13.838977 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-0c7d6f33-b27c-4e94-885a-5c68c16cdf5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:13.845243 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1049/2090] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:13.866031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f5d55-4b61-4414-a83a-cf4f33585868 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:13.867531 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-ce1f5d55-4b61-4414-a83a-cf4f33585868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:13.928873 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d6f33-b27c-4e94-885a-5c68c16cdf5a admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:13.937553 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c0a30-36a8-4a9d-94ff-f4191ee88cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:13.938624 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c0a30-36a8-4a9d-94ff-f4191ee88cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:13.938917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c0a30-36a8-4a9d-94ff-f4191ee88cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:13.939198 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c0a30-36a8-4a9d-94ff-f4191ee88cf8 admin admin] PATH_INFO: `/v3/users/02f6d04d398f4322a24bff718bc41527` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:13.940963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c0a30-36a8-4a9d-94ff-f4191ee88cf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f6d04d398f4322a24bff718bc41527)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:13.943869 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c0a30-36a8-4a9d-94ff-f4191ee88cf8 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:13.963650 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f5d55-4b61-4414-a83a-cf4f33585868 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:13.968002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003f148-bc2b-4128-b121-818c7a447abf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:13.968740 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003f148-bc2b-4128-b121-818c7a447abf service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:13.969023 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003f148-bc2b-4128-b121-818c7a447abf service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:13.973761 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003f148-bc2b-4128-b121-818c7a447abf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:13.997051 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003f148-bc2b-4128-b121-818c7a447abf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:13.998559 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003f148-bc2b-4128-b121-818c7a447abf service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:14.019465 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1050/2091] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:26:14.030500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-fc2c0a30-36a8-4a9d-94ff-f4191ee88cf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f6d04d398f4322a24bff718bc41527'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:14.045741 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-fc2c0a30-36a8-4a9d-94ff-f4191ee88cf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f6d04d398f4322a24bff718bc41527'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:14.059821 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-fc2c0a30-36a8-4a9d-94ff-f4191ee88cf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f6d04d398f4322a24bff718bc41527'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:14.060785 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-fc2c0a30-36a8-4a9d-94ff-f4191ee88cf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f6d04d398f4322a24bff718bc41527'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:14.070414 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-fc2c0a30-36a8-4a9d-94ff-f4191ee88cf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f6d04d398f4322a24bff718bc41527'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:14.082871 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1042/2092] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:13 2022] DELETE /identity/v3/users/02f6d04d398f4322a24bff718bc41527 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:14.087008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b086f-e081-4792-9fa9-2fe7d0816c1d None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:14.087289 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b086f-e081-4792-9fa9-2fe7d0816c1d None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:14.087590 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b086f-e081-4792-9fa9-2fe7d0816c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:14.106773 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-d39b086f-e081-4792-9fa9-2fe7d0816c1d None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:14.108138 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-d39b086f-e081-4792-9fa9-2fe7d0816c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:14.161240 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c0a30-36a8-4a9d-94ff-f4191ee88cf8 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:14.163037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-fc2c0a30-36a8-4a9d-94ff-f4191ee88cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:14.180371 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1051/2093] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:14.190584 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b086f-e081-4792-9fa9-2fe7d0816c1d None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:14.192438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-d39b086f-e081-4792-9fa9-2fe7d0816c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:14.257836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c0a30-36a8-4a9d-94ff-f4191ee88cf8 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:14.263584 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5bf28-8524-4e86-9288-41f158d95f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:14.264914 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5bf28-8524-4e86-9288-41f158d95f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:14.265486 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5bf28-8524-4e86-9288-41f158d95f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:14.265895 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5bf28-8524-4e86-9288-41f158d95f4f admin admin] PATH_INFO: `/v3/users/0e191a316a754c46aac3cadc4336cf2e` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:14.267664 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5bf28-8524-4e86-9288-41f158d95f4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e191a316a754c46aac3cadc4336cf2e)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:14.270586 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5bf28-8524-4e86-9288-41f158d95f4f admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:14.276699 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b086f-e081-4792-9fa9-2fe7d0816c1d None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:14.281616 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955673d9-04d0-4065-9ee6-cf972901c29b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:14.282299 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955673d9-04d0-4065-9ee6-cf972901c29b service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:14.282745 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955673d9-04d0-4065-9ee6-cf972901c29b service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:14.283022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955673d9-04d0-4065-9ee6-cf972901c29b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:14.305936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955673d9-04d0-4065-9ee6-cf972901c29b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:14.306158 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955673d9-04d0-4065-9ee6-cf972901c29b service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:14.318931 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1052/2094] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:26:14.336458 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-1cb5bf28-8524-4e86-9288-41f158d95f4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e191a316a754c46aac3cadc4336cf2e'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:14.362162 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-1cb5bf28-8524-4e86-9288-41f158d95f4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e191a316a754c46aac3cadc4336cf2e'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:14.371572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-1cb5bf28-8524-4e86-9288-41f158d95f4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e191a316a754c46aac3cadc4336cf2e'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:14.373298 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-1cb5bf28-8524-4e86-9288-41f158d95f4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e191a316a754c46aac3cadc4336cf2e'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:14.384176 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-1cb5bf28-8524-4e86-9288-41f158d95f4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e191a316a754c46aac3cadc4336cf2e'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:14.397650 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1043/2095] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:14 2022] DELETE /identity/v3/users/0e191a316a754c46aac3cadc4336cf2e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:26:14.399694 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa1c00-a0eb-4be8-9c80-1e94f1807e33 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:14.400004 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa1c00-a0eb-4be8-9c80-1e94f1807e33 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:14.400340 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa1c00-a0eb-4be8-9c80-1e94f1807e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:14.436676 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-4afa1c00-a0eb-4be8-9c80-1e94f1807e33 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:14.439034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-4afa1c00-a0eb-4be8-9c80-1e94f1807e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:14.552513 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1053/2096] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:14.564454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5bf28-8524-4e86-9288-41f158d95f4f admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:14.566529 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-1cb5bf28-8524-4e86-9288-41f158d95f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:14.630727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5bf28-8524-4e86-9288-41f158d95f4f admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:14.634639 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418ee9e-dae5-4afb-bd07-990412cfb834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:14.635406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418ee9e-dae5-4afb-bd07-990412cfb834 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:14.635763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418ee9e-dae5-4afb-bd07-990412cfb834 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:14.636111 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418ee9e-dae5-4afb-bd07-990412cfb834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:14.647756 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b418ee9e-dae5-4afb-bd07-990412cfb834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:14.650465 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b418ee9e-dae5-4afb-bd07-990412cfb834 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:14.666950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1044/2097] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:14.693965 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa1c00-a0eb-4be8-9c80-1e94f1807e33 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:14.695420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-4afa1c00-a0eb-4be8-9c80-1e94f1807e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:14.708436 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa1c00-a0eb-4be8-9c80-1e94f1807e33 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:14.713352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24cfe5-d19e-4fc7-8426-b55e84801752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:14.714222 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24cfe5-d19e-4fc7-8426-b55e84801752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:14.714500 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24cfe5-d19e-4fc7-8426-b55e84801752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:14.715321 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24cfe5-d19e-4fc7-8426-b55e84801752 admin admin] PATH_INFO: `/v3/projects/162bb1b8d5724cebbe8ecba68983a993` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:14.715961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24cfe5-d19e-4fc7-8426-b55e84801752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=162bb1b8d5724cebbe8ecba68983a993)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:14.717931 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24cfe5-d19e-4fc7-8426-b55e84801752 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:14.769586 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-2d24cfe5-d19e-4fc7-8426-b55e84801752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '162bb1b8d5724cebbe8ecba68983a993', 'request_id': 'req-2d24cfe5-d19e-4fc7-8426-b55e84801752'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:14.781340 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-2d24cfe5-d19e-4fc7-8426-b55e84801752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '162bb1b8d5724cebbe8ecba68983a993', 'request_id': 'req-2d24cfe5-d19e-4fc7-8426-b55e84801752'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:14.788463 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-2d24cfe5-d19e-4fc7-8426-b55e84801752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '162bb1b8d5724cebbe8ecba68983a993', 'request_id': 'req-2d24cfe5-d19e-4fc7-8426-b55e84801752'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:14.800050 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-2d24cfe5-d19e-4fc7-8426-b55e84801752 admin admin] The token cache is being invalidate because project 162bb1b8d5724cebbe8ecba68983a993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:14.800380 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-2d24cfe5-d19e-4fc7-8426-b55e84801752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:14.801039 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-2d24cfe5-d19e-4fc7-8426-b55e84801752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:14.803854 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1054/2098] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:14 2022] DELETE /identity/v3/projects/162bb1b8d5724cebbe8ecba68983a993 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:14.808678 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99af80d-d116-485c-9edc-194de1ad729c None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:14.809236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99af80d-d116-485c-9edc-194de1ad729c None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:14.809236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99af80d-d116-485c-9edc-194de1ad729c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:14.833164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-b99af80d-d116-485c-9edc-194de1ad729c None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:14.834780 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-b99af80d-d116-485c-9edc-194de1ad729c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:14.901921 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1045/2099] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:14.909744 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429f84e-49ae-4355-b9c9-b2a4154c8fa5 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:14.910265 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429f84e-49ae-4355-b9c9-b2a4154c8fa5 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:14.910341 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429f84e-49ae-4355-b9c9-b2a4154c8fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:14.930357 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-b429f84e-49ae-4355-b9c9-b2a4154c8fa5 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:14.931590 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-b429f84e-49ae-4355-b9c9-b2a4154c8fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:14.939551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1055/2100] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:14.944432 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99af80d-d116-485c-9edc-194de1ad729c None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:14.955611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99af80d-d116-485c-9edc-194de1ad729c None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:14.961658 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3440aa2-afb7-4212-8935-6c5c934a6760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:14.962347 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3440aa2-afb7-4212-8935-6c5c934a6760 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:14.962640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3440aa2-afb7-4212-8935-6c5c934a6760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:14.962954 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3440aa2-afb7-4212-8935-6c5c934a6760 admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:14.963693 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3440aa2-afb7-4212-8935-6c5c934a6760 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:14.964005 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3440aa2-afb7-4212-8935-6c5c934a6760 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:14.965786 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3440aa2-afb7-4212-8935-6c5c934a6760 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:14.973610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429f84e-49ae-4355-b9c9-b2a4154c8fa5 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:14.976049 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-b429f84e-49ae-4355-b9c9-b2a4154c8fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:14.990602 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1046/2101] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:14.991982 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3440aa2-afb7-4212-8935-6c5c934a6760 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:14.993033 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429f84e-49ae-4355-b9c9-b2a4154c8fa5 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:14.998420 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019c0a2-98e0-485c-837d-0ca6038e4be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:14.999297 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019c0a2-98e0-485c-837d-0ca6038e4be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:14.999705 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019c0a2-98e0-485c-837d-0ca6038e4be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:14.999891 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019c0a2-98e0-485c-837d-0ca6038e4be6 admin admin] PATH_INFO: `/v3/projects/d63c78821beb464faaa13ba04711ce09` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:15.001146 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019c0a2-98e0-485c-837d-0ca6038e4be6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d63c78821beb464faaa13ba04711ce09)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:15.003137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019c0a2-98e0-485c-837d-0ca6038e4be6 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:15.003838 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3440aa2-afb7-4212-8935-6c5c934a6760 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:15.010258 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8334367-f0fa-4484-980d-0a616b158ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:15.010966 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8334367-f0fa-4484-980d-0a616b158ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:15.011243 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8334367-f0fa-4484-980d-0a616b158ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:15.011519 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8334367-f0fa-4484-980d-0a616b158ab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:15.012248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8334367-f0fa-4484-980d-0a616b158ab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:15.014185 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8334367-f0fa-4484-980d-0a616b158ab0 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:15.043266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1047/2102] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:14 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:26:15.047875 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8334367-f0fa-4484-980d-0a616b158ab0 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:15.056061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-7019c0a2-98e0-485c-837d-0ca6038e4be6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd63c78821beb464faaa13ba04711ce09', 'request_id': 'req-7019c0a2-98e0-485c-837d-0ca6038e4be6'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:15.064914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-7019c0a2-98e0-485c-837d-0ca6038e4be6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd63c78821beb464faaa13ba04711ce09', 'request_id': 'req-7019c0a2-98e0-485c-837d-0ca6038e4be6'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:15.074968 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-7019c0a2-98e0-485c-837d-0ca6038e4be6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd63c78821beb464faaa13ba04711ce09', 'request_id': 'req-7019c0a2-98e0-485c-837d-0ca6038e4be6'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:15.085476 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-7019c0a2-98e0-485c-837d-0ca6038e4be6 admin admin] The token cache is being invalidate because project d63c78821beb464faaa13ba04711ce09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:15.085838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-7019c0a2-98e0-485c-837d-0ca6038e4be6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:15.086639 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-7019c0a2-98e0-485c-837d-0ca6038e4be6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:15.088275 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1056/2103] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:14 2022] DELETE /identity/v3/projects/d63c78821beb464faaa13ba04711ce09 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:26:15.092218 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019c0a2-98e0-485c-837d-0ca6038e4be6 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:15.093877 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-7019c0a2-98e0-485c-837d-0ca6038e4be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:15.137505 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8334367-f0fa-4484-980d-0a616b158ab0 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:15.142402 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1249d8-84b2-442f-8ed5-e9b6077d006a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:15.143079 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1249d8-84b2-442f-8ed5-e9b6077d006a admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:15.143720 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1249d8-84b2-442f-8ed5-e9b6077d006a admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:15.143881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1249d8-84b2-442f-8ed5-e9b6077d006a admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:15.144606 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1249d8-84b2-442f-8ed5-e9b6077d006a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:15.147105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1249d8-84b2-442f-8ed5-e9b6077d006a admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:15.171698 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1048/2104] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:15 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:15.173217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019c0a2-98e0-485c-837d-0ca6038e4be6 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:15.176665 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1249d8-84b2-442f-8ed5-e9b6077d006a admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:15.179084 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-2a1249d8-84b2-442f-8ed5-e9b6077d006a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:15.180970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf6c65-ee1d-483b-9d47-f7e75cec9f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:15.181990 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf6c65-ee1d-483b-9d47-f7e75cec9f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:15.182364 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf6c65-ee1d-483b-9d47-f7e75cec9f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:15.182714 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf6c65-ee1d-483b-9d47-f7e75cec9f75 admin admin] PATH_INFO: `/v3/users/b9e2eb18a7444ea18dacf91539eb6824` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:15.184235 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf6c65-ee1d-483b-9d47-f7e75cec9f75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9e2eb18a7444ea18dacf91539eb6824)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:15.186196 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf6c65-ee1d-483b-9d47-f7e75cec9f75 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:15.191334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1249d8-84b2-442f-8ed5-e9b6077d006a admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:15.197652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03894eb7-22df-4dc3-8922-33acf984b8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:15.198569 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03894eb7-22df-4dc3-8922-33acf984b8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:15.198958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03894eb7-22df-4dc3-8922-33acf984b8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:15.199342 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03894eb7-22df-4dc3-8922-33acf984b8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:15.200247 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03894eb7-22df-4dc3-8922-33acf984b8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:15.202385 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03894eb7-22df-4dc3-8922-33acf984b8a2 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:15.213543 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1049/2105] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:26:15.218110 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03894eb7-22df-4dc3-8922-33acf984b8a2 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:15.234769 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03894eb7-22df-4dc3-8922-33acf984b8a2 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:15.243077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039c34a-5709-46ed-a500-b5ccc3c05ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:15.243999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039c34a-5709-46ed-a500-b5ccc3c05ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:15.244421 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039c34a-5709-46ed-a500-b5ccc3c05ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:15.244821 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039c34a-5709-46ed-a500-b5ccc3c05ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:15.245686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039c34a-5709-46ed-a500-b5ccc3c05ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:15.247608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039c34a-5709-46ed-a500-b5ccc3c05ea7 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:15.265384 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1050/2106] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:26:15.266963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039c34a-5709-46ed-a500-b5ccc3c05ea7 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:15.274379 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-aacf6c65-ee1d-483b-9d47-f7e75cec9f75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9e2eb18a7444ea18dacf91539eb6824'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:15.275209 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-aacf6c65-ee1d-483b-9d47-f7e75cec9f75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9e2eb18a7444ea18dacf91539eb6824'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:15.279009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039c34a-5709-46ed-a500-b5ccc3c05ea7 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:15.284824 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-aacf6c65-ee1d-483b-9d47-f7e75cec9f75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9e2eb18a7444ea18dacf91539eb6824'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:15.286585 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d34d9d-6027-4127-a581-950885813d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:15.287710 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d34d9d-6027-4127-a581-950885813d00 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:15.288105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d34d9d-6027-4127-a581-950885813d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:15.288491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d34d9d-6027-4127-a581-950885813d00 admin admin] PATH_INFO: `/v3/projects/0f3171b5220a4131b26f2deb197c5bfe/users/e34d47fa37dd4b969dc61fe8a7c29436/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:15.298003 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-aacf6c65-ee1d-483b-9d47-f7e75cec9f75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9e2eb18a7444ea18dacf91539eb6824'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:15.306471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d34d9d-6027-4127-a581-950885813d00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f3171b5220a4131b26f2deb197c5bfe, user_id=e34d47fa37dd4b969dc61fe8a7c29436, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:15.309168 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d34d9d-6027-4127-a581-950885813d00 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:15.318652 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-aacf6c65-ee1d-483b-9d47-f7e75cec9f75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9e2eb18a7444ea18dacf91539eb6824'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:15.325441 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1051/2107] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:15 2022] PUT /identity/v3/projects/0f3171b5220a4131b26f2deb197c5bfe/users/e34d47fa37dd4b969dc61fe8a7c29436/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:15.331873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1057/2108] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:15 2022] DELETE /identity/v3/users/b9e2eb18a7444ea18dacf91539eb6824 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:26:15.337893 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695fcf6-f115-4fbe-94e7-78632448fd6e None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:15.338596 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695fcf6-f115-4fbe-94e7-78632448fd6e None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:15.339008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695fcf6-f115-4fbe-94e7-78632448fd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:15.388673 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-8695fcf6-f115-4fbe-94e7-78632448fd6e None None] MFA Rules not processed for user `e34d47fa37dd4b969dc61fe8a7c29436`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:15.390075 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-8695fcf6-f115-4fbe-94e7-78632448fd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:15.496715 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1052/2109] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:15.513288 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf6c65-ee1d-483b-9d47-f7e75cec9f75 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:15.515979 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-aacf6c65-ee1d-483b-9d47-f7e75cec9f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:15.600704 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf6c65-ee1d-483b-9d47-f7e75cec9f75 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:15.604940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa70a0-bc83-43e4-ad95-bf1bcb0bc747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:15.605821 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa70a0-bc83-43e4-ad95-bf1bcb0bc747 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:15.606356 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa70a0-bc83-43e4-ad95-bf1bcb0bc747 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:15.608235 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa70a0-bc83-43e4-ad95-bf1bcb0bc747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:15.619032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa70a0-bc83-43e4-ad95-bf1bcb0bc747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:15.625467 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa70a0-bc83-43e4-ad95-bf1bcb0bc747 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:15.646843 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1058/2110] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:26:15.686704 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695fcf6-f115-4fbe-94e7-78632448fd6e None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:15.688364 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-8695fcf6-f115-4fbe-94e7-78632448fd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:15.741063 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa70a0-bc83-43e4-ad95-bf1bcb0bc747 service cinder] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:15.742729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-cefa70a0-bc83-43e4-ad95-bf1bcb0bc747 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:15.804466 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695fcf6-f115-4fbe-94e7-78632448fd6e None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:15.809830 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a3705-1716-4d4c-b907-ba6545ec415c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:15.811640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a3705-1716-4d4c-b907-ba6545ec415c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:15.812017 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a3705-1716-4d4c-b907-ba6545ec415c admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:15.812429 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a3705-1716-4d4c-b907-ba6545ec415c admin admin] PATH_INFO: `/v3/users/e34d47fa37dd4b969dc61fe8a7c29436` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:15.813862 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a3705-1716-4d4c-b907-ba6545ec415c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e34d47fa37dd4b969dc61fe8a7c29436)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:15.816011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a3705-1716-4d4c-b907-ba6545ec415c admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:15.858675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa70a0-bc83-43e4-ad95-bf1bcb0bc747 service cinder] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:15.863960 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2827bb-9953-42d5-8e97-1c86df72773d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:15.865045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2827bb-9953-42d5-8e97-1c86df72773d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:15.865390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2827bb-9953-42d5-8e97-1c86df72773d admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:15.865740 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2827bb-9953-42d5-8e97-1c86df72773d admin admin] PATH_INFO: `/v3/projects/87578fdf1fd94b85856789ede085a68b` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:15.866323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-505a3705-1716-4d4c-b907-ba6545ec415c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e34d47fa37dd4b969dc61fe8a7c29436'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:15.866980 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2827bb-9953-42d5-8e97-1c86df72773d admin admin] RBAC: Authorizing `identity:delete_project(project_id=87578fdf1fd94b85856789ede085a68b)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:15.868943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2827bb-9953-42d5-8e97-1c86df72773d admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:15.878752 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-505a3705-1716-4d4c-b907-ba6545ec415c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e34d47fa37dd4b969dc61fe8a7c29436'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:15.886030 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-505a3705-1716-4d4c-b907-ba6545ec415c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e34d47fa37dd4b969dc61fe8a7c29436'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:15.886762 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-505a3705-1716-4d4c-b907-ba6545ec415c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e34d47fa37dd4b969dc61fe8a7c29436'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:15.894355 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-505a3705-1716-4d4c-b907-ba6545ec415c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e34d47fa37dd4b969dc61fe8a7c29436'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:15.901554 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1053/2111] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:15 2022] DELETE /identity/v3/users/e34d47fa37dd4b969dc61fe8a7c29436 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:15.906032 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c2484-1253-4a14-ae15-b0aefc52a31a None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:15.906376 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c2484-1253-4a14-ae15-b0aefc52a31a None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:15.906661 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c2484-1253-4a14-ae15-b0aefc52a31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:15.918431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-6f2827bb-9953-42d5-8e97-1c86df72773d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87578fdf1fd94b85856789ede085a68b', 'request_id': 'req-6f2827bb-9953-42d5-8e97-1c86df72773d'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:15.924547 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-716c2484-1253-4a14-ae15-b0aefc52a31a None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:15.925906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-716c2484-1253-4a14-ae15-b0aefc52a31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:15.926466 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-6f2827bb-9953-42d5-8e97-1c86df72773d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87578fdf1fd94b85856789ede085a68b', 'request_id': 'req-6f2827bb-9953-42d5-8e97-1c86df72773d'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:15.934073 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-6f2827bb-9953-42d5-8e97-1c86df72773d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87578fdf1fd94b85856789ede085a68b', 'request_id': 'req-6f2827bb-9953-42d5-8e97-1c86df72773d'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:15.944474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-6f2827bb-9953-42d5-8e97-1c86df72773d admin admin] The token cache is being invalidate because project 87578fdf1fd94b85856789ede085a68b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:15.944777 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-6f2827bb-9953-42d5-8e97-1c86df72773d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:15.945454 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-6f2827bb-9953-42d5-8e97-1c86df72773d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:15.947244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1059/2112] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:15 2022] DELETE /identity/v3/projects/87578fdf1fd94b85856789ede085a68b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:26:15.953085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86e641-ff1a-4906-9837-b7cfac864840 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:15.953373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86e641-ff1a-4906-9837-b7cfac864840 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:15.953649 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86e641-ff1a-4906-9837-b7cfac864840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:15.973640 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-ef86e641-ff1a-4906-9837-b7cfac864840 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:15.975056 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-ef86e641-ff1a-4906-9837-b7cfac864840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:15.989876 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1054/2113] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:26:15.999141 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c2484-1253-4a14-ae15-b0aefc52a31a None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:16.000842 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-716c2484-1253-4a14-ae15-b0aefc52a31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:16.033979 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1060/2114] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:26:16.042924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ee9c5-5321-4671-9d11-8be427ca5476 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:16.043210 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ee9c5-5321-4671-9d11-8be427ca5476 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:16.043490 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ee9c5-5321-4671-9d11-8be427ca5476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:16.059873 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c2484-1253-4a14-ae15-b0aefc52a31a None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:16.063763 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-272ee9c5-5321-4671-9d11-8be427ca5476 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:16.063976 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dc85b-3d66-4f2d-ac6d-adaafa55aaeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:16.064701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dc85b-3d66-4f2d-ac6d-adaafa55aaeb service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:16.065063 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-272ee9c5-5321-4671-9d11-8be427ca5476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:16.065161 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dc85b-3d66-4f2d-ac6d-adaafa55aaeb service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:16.065346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dc85b-3d66-4f2d-ac6d-adaafa55aaeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:16.074312 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1061/2115] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:26:16.075456 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dc85b-3d66-4f2d-ac6d-adaafa55aaeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:16.076922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dc85b-3d66-4f2d-ac6d-adaafa55aaeb service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:16.078418 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ee9c5-5321-4671-9d11-8be427ca5476 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:16.087782 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1055/2116] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:26:16.088081 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ee9c5-5321-4671-9d11-8be427ca5476 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:16.095313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dde2b2-c4e2-4a39-a294-3d9e66474496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:16.100966 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dde2b2-c4e2-4a39-a294-3d9e66474496 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:16.101188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dde2b2-c4e2-4a39-a294-3d9e66474496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:16.101465 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dde2b2-c4e2-4a39-a294-3d9e66474496 admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:16.102269 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dde2b2-c4e2-4a39-a294-3d9e66474496 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:16.102642 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dde2b2-c4e2-4a39-a294-3d9e66474496 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:16.104372 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dde2b2-c4e2-4a39-a294-3d9e66474496 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:16.118114 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1062/2117] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:26:16.120950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dc85b-3d66-4f2d-ac6d-adaafa55aaeb service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:16.130435 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dc85b-3d66-4f2d-ac6d-adaafa55aaeb service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:16.135474 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b828d-30a8-4404-b5b1-cda8c7be6a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:16.136129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b828d-30a8-4404-b5b1-cda8c7be6a38 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:16.136448 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b828d-30a8-4404-b5b1-cda8c7be6a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:16.136722 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b828d-30a8-4404-b5b1-cda8c7be6a38 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:16.137416 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b828d-30a8-4404-b5b1-cda8c7be6a38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:16.139308 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b828d-30a8-4404-b5b1-cda8c7be6a38 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:16.170751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1056/2118] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:16 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:26:16.171918 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dde2b2-c4e2-4a39-a294-3d9e66474496 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:16.182463 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dde2b2-c4e2-4a39-a294-3d9e66474496 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:16.250413 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59551939-0844-4658-a30d-664f0e9304b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:16.251446 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59551939-0844-4658-a30d-664f0e9304b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:16.252142 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59551939-0844-4658-a30d-664f0e9304b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:16.252486 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59551939-0844-4658-a30d-664f0e9304b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:16.253337 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59551939-0844-4658-a30d-664f0e9304b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:16.255991 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59551939-0844-4658-a30d-664f0e9304b3 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:16.278371 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1063/2119] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:16 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:16.282582 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b828d-30a8-4404-b5b1-cda8c7be6a38 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:16.293315 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b828d-30a8-4404-b5b1-cda8c7be6a38 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:16.298128 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc188e-687c-4560-8240-3734b919860e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:16.298798 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc188e-687c-4560-8240-3734b919860e admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:16.299080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc188e-687c-4560-8240-3734b919860e admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:16.299361 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc188e-687c-4560-8240-3734b919860e admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:16.300082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc188e-687c-4560-8240-3734b919860e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:16.301758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc188e-687c-4560-8240-3734b919860e admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:16.315651 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1057/2120] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:16.317480 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59551939-0844-4658-a30d-664f0e9304b3 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:16.327493 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59551939-0844-4658-a30d-664f0e9304b3 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:16.333358 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdff53-429e-4323-ad0d-a1862aaa9e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:16.334156 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdff53-429e-4323-ad0d-a1862aaa9e25 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:16.334439 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdff53-429e-4323-ad0d-a1862aaa9e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:16.334818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdff53-429e-4323-ad0d-a1862aaa9e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:16.335547 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcdff53-429e-4323-ad0d-a1862aaa9e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:16.337481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcdff53-429e-4323-ad0d-a1862aaa9e25 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:16.353482 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1064/2121] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:16.357814 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc188e-687c-4560-8240-3734b919860e admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:16.368302 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc188e-687c-4560-8240-3734b919860e admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:16.373069 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46921a-b161-4dd8-808f-39634b11479d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:16.373974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46921a-b161-4dd8-808f-39634b11479d admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:16.374297 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46921a-b161-4dd8-808f-39634b11479d admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:16.374566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46921a-b161-4dd8-808f-39634b11479d admin admin] PATH_INFO: `/v3/projects/3629fc9226c34f9e95e2b75db2f326bb/users/b2b4de595d424c8284614782ab97c08e/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:16.382285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdff53-429e-4323-ad0d-a1862aaa9e25 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:16.384852 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-9fcdff53-429e-4323-ad0d-a1862aaa9e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:16.391628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46921a-b161-4dd8-808f-39634b11479d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3629fc9226c34f9e95e2b75db2f326bb, user_id=b2b4de595d424c8284614782ab97c08e, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:16.394714 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46921a-b161-4dd8-808f-39634b11479d admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:16.409165 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdff53-429e-4323-ad0d-a1862aaa9e25 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:16.414726 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3a9ab-4106-404d-91d0-eba6e0ba774a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:16.415665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3a9ab-4106-404d-91d0-eba6e0ba774a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:16.415901 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3a9ab-4106-404d-91d0-eba6e0ba774a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:16.416454 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3a9ab-4106-404d-91d0-eba6e0ba774a admin admin] PATH_INFO: `/v3/projects/0f3171b5220a4131b26f2deb197c5bfe` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:16.417386 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3a9ab-4106-404d-91d0-eba6e0ba774a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f3171b5220a4131b26f2deb197c5bfe)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:16.419357 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3a9ab-4106-404d-91d0-eba6e0ba774a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:16.424456 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1058/2122] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:16 2022] PUT /identity/v3/projects/3629fc9226c34f9e95e2b75db2f326bb/users/b2b4de595d424c8284614782ab97c08e/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:16.436060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d85bd3-a5f2-4882-beca-b9115c3f4b79 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:16.436375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d85bd3-a5f2-4882-beca-b9115c3f4b79 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:16.436653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d85bd3-a5f2-4882-beca-b9115c3f4b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:16.464881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-67d85bd3-a5f2-4882-beca-b9115c3f4b79 None None] MFA Rules not processed for user `b2b4de595d424c8284614782ab97c08e`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:16.466076 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-67d85bd3-a5f2-4882-beca-b9115c3f4b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:16.473126 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e3a3a9ab-4106-404d-91d0-eba6e0ba774a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f3171b5220a4131b26f2deb197c5bfe', 'request_id': 'req-e3a3a9ab-4106-404d-91d0-eba6e0ba774a'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:16.480753 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e3a3a9ab-4106-404d-91d0-eba6e0ba774a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f3171b5220a4131b26f2deb197c5bfe', 'request_id': 'req-e3a3a9ab-4106-404d-91d0-eba6e0ba774a'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:16.487543 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e3a3a9ab-4106-404d-91d0-eba6e0ba774a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f3171b5220a4131b26f2deb197c5bfe', 'request_id': 'req-e3a3a9ab-4106-404d-91d0-eba6e0ba774a'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:16.498226 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e3a3a9ab-4106-404d-91d0-eba6e0ba774a admin admin] The token cache is being invalidate because project 0f3171b5220a4131b26f2deb197c5bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:16.498512 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e3a3a9ab-4106-404d-91d0-eba6e0ba774a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:16.499177 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e3a3a9ab-4106-404d-91d0-eba6e0ba774a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:16.501027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1065/2123] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:16 2022] DELETE /identity/v3/projects/0f3171b5220a4131b26f2deb197c5bfe => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:26:16.507419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6560f6-e86d-4254-b7c3-7a5ad30d271b None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:16.507725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6560f6-e86d-4254-b7c3-7a5ad30d271b None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:16.508004 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6560f6-e86d-4254-b7c3-7a5ad30d271b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:16.529274 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-2d6560f6-e86d-4254-b7c3-7a5ad30d271b None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:16.531540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-2d6560f6-e86d-4254-b7c3-7a5ad30d271b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:16.532972 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1059/2124] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:26:16.544737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d85bd3-a5f2-4882-beca-b9115c3f4b79 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:16.546104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-67d85bd3-a5f2-4882-beca-b9115c3f4b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:16.592592 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1066/2125] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:16.601949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076f35f-d240-44c1-b2a6-3ca9bc960140 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:16.602244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076f35f-d240-44c1-b2a6-3ca9bc960140 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:16.602526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076f35f-d240-44c1-b2a6-3ca9bc960140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:16.603892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d85bd3-a5f2-4882-beca-b9115c3f4b79 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:16.607539 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafe7c2-6929-4289-bdc0-3e40078d6ff0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:16.608285 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafe7c2-6929-4289-bdc0-3e40078d6ff0 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:16.608507 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafe7c2-6929-4289-bdc0-3e40078d6ff0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:16.608780 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafe7c2-6929-4289-bdc0-3e40078d6ff0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:16.617866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafe7c2-6929-4289-bdc0-3e40078d6ff0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:16.619348 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafe7c2-6929-4289-bdc0-3e40078d6ff0 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:16.620983 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-7076f35f-d240-44c1-b2a6-3ca9bc960140 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:16.622176 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-7076f35f-d240-44c1-b2a6-3ca9bc960140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:16.628099 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1060/2126] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:26:16.630680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1067/2127] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:26:16.634741 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafe7c2-6929-4289-bdc0-3e40078d6ff0 service cinder] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:16.645212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafe7c2-6929-4289-bdc0-3e40078d6ff0 service cinder] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:16.649776 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5224fc-32a6-42d2-b214-6fd0e857064a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:16.650424 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5224fc-32a6-42d2-b214-6fd0e857064a admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:16.650720 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5224fc-32a6-42d2-b214-6fd0e857064a admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:16.650997 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5224fc-32a6-42d2-b214-6fd0e857064a admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:16.651745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5224fc-32a6-42d2-b214-6fd0e857064a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:16.652046 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5224fc-32a6-42d2-b214-6fd0e857064a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:16.653669 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5224fc-32a6-42d2-b214-6fd0e857064a admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:16.665931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1061/2128] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:16.675223 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076f35f-d240-44c1-b2a6-3ca9bc960140 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:16.685187 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076f35f-d240-44c1-b2a6-3ca9bc960140 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:16.689997 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4931ab-8b12-40a0-8f3b-79b0291c0cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:16.690648 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4931ab-8b12-40a0-8f3b-79b0291c0cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:16.690930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4931ab-8b12-40a0-8f3b-79b0291c0cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:16.691205 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4931ab-8b12-40a0-8f3b-79b0291c0cc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:16.692475 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4931ab-8b12-40a0-8f3b-79b0291c0cc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:16.694483 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4931ab-8b12-40a0-8f3b-79b0291c0cc2 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:16.719920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1068/2129] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:16 2022] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:16.724686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5224fc-32a6-42d2-b214-6fd0e857064a admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:16.734399 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5224fc-32a6-42d2-b214-6fd0e857064a admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:16.794225 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ff5ae-3496-4043-b40b-aae849025e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:16.794994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ff5ae-3496-4043-b40b-aae849025e60 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:16.795319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ff5ae-3496-4043-b40b-aae849025e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:16.795644 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ff5ae-3496-4043-b40b-aae849025e60 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:16.796345 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ff5ae-3496-4043-b40b-aae849025e60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:16.798260 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ff5ae-3496-4043-b40b-aae849025e60 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:16.819235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1062/2130] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:16 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:16.823279 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4931ab-8b12-40a0-8f3b-79b0291c0cc2 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:16.834388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4931ab-8b12-40a0-8f3b-79b0291c0cc2 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:16.840688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeea26-6b25-4a0c-9a29-84924db7c8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:16.841603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeea26-6b25-4a0c-9a29-84924db7c8df admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:16.841774 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeea26-6b25-4a0c-9a29-84924db7c8df admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:16.842676 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeea26-6b25-4a0c-9a29-84924db7c8df admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:16.844236 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eeea26-6b25-4a0c-9a29-84924db7c8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:16.845408 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eeea26-6b25-4a0c-9a29-84924db7c8df admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:16.859460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1069/2131] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:26:16.863487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ff5ae-3496-4043-b40b-aae849025e60 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:16.876108 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ff5ae-3496-4043-b40b-aae849025e60 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:16.886838 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f0978-d376-4257-8d5b-e687f07b5aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:16.887737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f0978-d376-4257-8d5b-e687f07b5aeb admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:16.888179 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f0978-d376-4257-8d5b-e687f07b5aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:16.889602 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f0978-d376-4257-8d5b-e687f07b5aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:16.889602 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f0978-d376-4257-8d5b-e687f07b5aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:16.891293 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f0978-d376-4257-8d5b-e687f07b5aeb admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:16.909317 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeea26-6b25-4a0c-9a29-84924db7c8df admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:16.916401 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1063/2132] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:16.928771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeea26-6b25-4a0c-9a29-84924db7c8df admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:16.937176 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da5f9d-06ab-46c8-8873-3f006beefeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:16.938419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da5f9d-06ab-46c8-8873-3f006beefeba admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:16.939182 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da5f9d-06ab-46c8-8873-3f006beefeba admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:16.939681 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da5f9d-06ab-46c8-8873-3f006beefeba admin admin] PATH_INFO: `/v3/projects/342a1d8a441940e1b8142d7f16533b95/users/67d78d0333654cdc8095b6b275df1f0c/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:16.972004 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da5f9d-06ab-46c8-8873-3f006beefeba admin admin] RBAC: Authorizing `identity:create_grant(project_id=342a1d8a441940e1b8142d7f16533b95, user_id=67d78d0333654cdc8095b6b275df1f0c, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:16.975641 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da5f9d-06ab-46c8-8873-3f006beefeba admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:16.996243 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1070/2133] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:16 2022] PUT /identity/v3/projects/342a1d8a441940e1b8142d7f16533b95/users/67d78d0333654cdc8095b6b275df1f0c/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:17.005565 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cab97-ab62-4e99-aa2c-203688dc1998 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:17.006124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cab97-ab62-4e99-aa2c-203688dc1998 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:17.006594 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cab97-ab62-4e99-aa2c-203688dc1998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:17.040222 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-9d1cab97-ab62-4e99-aa2c-203688dc1998 None None] MFA Rules not processed for user `67d78d0333654cdc8095b6b275df1f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:17.042488 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-9d1cab97-ab62-4e99-aa2c-203688dc1998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:17.110236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1064/2134] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:17.121599 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da5f9d-06ab-46c8-8873-3f006beefeba admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:17.123287 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-44da5f9d-06ab-46c8-8873-3f006beefeba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:17.180879 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da5f9d-06ab-46c8-8873-3f006beefeba admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:17.184603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e205cdd-80e1-40e1-a247-a107b85a04a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:17.185259 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e205cdd-80e1-40e1-a247-a107b85a04a8 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:17.185537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e205cdd-80e1-40e1-a247-a107b85a04a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:17.185808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e205cdd-80e1-40e1-a247-a107b85a04a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:17.195823 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e205cdd-80e1-40e1-a247-a107b85a04a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:17.197375 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e205cdd-80e1-40e1-a247-a107b85a04a8 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:17.206394 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1071/2135] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:34.095274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1cab97-ab62-4e99-aa2c-203688dc1998 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:34.098925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-9d1cab97-ab62-4e99-aa2c-203688dc1998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:34.143573 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e205cdd-80e1-40e1-a247-a107b85a04a8 service cinder] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:34.145716 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-1e205cdd-80e1-40e1-a247-a107b85a04a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:34.185136 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1cab97-ab62-4e99-aa2c-203688dc1998 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:34.190560 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae260c-f420-4f9a-8e54-1a6da49910f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:34.192101 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae260c-f420-4f9a-8e54-1a6da49910f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:34.192328 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae260c-f420-4f9a-8e54-1a6da49910f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:34.192603 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae260c-f420-4f9a-8e54-1a6da49910f1 admin admin] PATH_INFO: `/v3/users/51e9625a35fd4177a14d560c9696f515` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:34.193919 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae260c-f420-4f9a-8e54-1a6da49910f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51e9625a35fd4177a14d560c9696f515)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:34.195848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae260c-f420-4f9a-8e54-1a6da49910f1 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:34.227071 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e205cdd-80e1-40e1-a247-a107b85a04a8 service cinder] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:34.238028 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f07cb-0447-4ae2-95f2-3f4c4a0bbf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:34.238954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f07cb-0447-4ae2-95f2-3f4c4a0bbf15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:34.239269 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f07cb-0447-4ae2-95f2-3f4c4a0bbf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:34.239558 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f07cb-0447-4ae2-95f2-3f4c4a0bbf15 admin admin] PATH_INFO: `/v3/users/dab09f6a1e3b4854912147027bced1cf` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:34.240904 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f07cb-0447-4ae2-95f2-3f4c4a0bbf15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab09f6a1e3b4854912147027bced1cf)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:34.242804 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f07cb-0447-4ae2-95f2-3f4c4a0bbf15 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:34.262421 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-68ae260c-f420-4f9a-8e54-1a6da49910f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51e9625a35fd4177a14d560c9696f515'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:34.277442 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-68ae260c-f420-4f9a-8e54-1a6da49910f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51e9625a35fd4177a14d560c9696f515'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:34.285504 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-68ae260c-f420-4f9a-8e54-1a6da49910f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51e9625a35fd4177a14d560c9696f515'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:34.286648 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-68ae260c-f420-4f9a-8e54-1a6da49910f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51e9625a35fd4177a14d560c9696f515'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:34.295789 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-68ae260c-f420-4f9a-8e54-1a6da49910f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51e9625a35fd4177a14d560c9696f515'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:34.299189 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-537f07cb-0447-4ae2-95f2-3f4c4a0bbf15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab09f6a1e3b4854912147027bced1cf'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:34.300059 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-537f07cb-0447-4ae2-95f2-3f4c4a0bbf15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab09f6a1e3b4854912147027bced1cf'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:34.303365 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1065/2136] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:34 2022] DELETE /identity/v3/users/51e9625a35fd4177a14d560c9696f515 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:34.307831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-537f07cb-0447-4ae2-95f2-3f4c4a0bbf15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab09f6a1e3b4854912147027bced1cf'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:34.308930 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e6af6-d9bc-45cf-9829-0b1f43213aa2 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:34.309517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e6af6-d9bc-45cf-9829-0b1f43213aa2 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:34.309635 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e6af6-d9bc-45cf-9829-0b1f43213aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:34.317475 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-537f07cb-0447-4ae2-95f2-3f4c4a0bbf15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab09f6a1e3b4854912147027bced1cf'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:34.329357 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-118e6af6-d9bc-45cf-9829-0b1f43213aa2 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:34.330643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-118e6af6-d9bc-45cf-9829-0b1f43213aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:34.331693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-537f07cb-0447-4ae2-95f2-3f4c4a0bbf15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab09f6a1e3b4854912147027bced1cf'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:34.338626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1072/2137] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:34 2022] DELETE /identity/v3/users/dab09f6a1e3b4854912147027bced1cf => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:34.346172 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0709b-f53c-449c-a057-87af1b8626c3 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:34.346591 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0709b-f53c-449c-a057-87af1b8626c3 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:34.347002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0709b-f53c-449c-a057-87af1b8626c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:34.381352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-15f0709b-f53c-449c-a057-87af1b8626c3 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:34.382764 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-15f0709b-f53c-449c-a057-87af1b8626c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:34.410484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1066/2138] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:34.423210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e6af6-d9bc-45cf-9829-0b1f43213aa2 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:34.425615 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-118e6af6-d9bc-45cf-9829-0b1f43213aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:34.449660 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1073/2139] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:34.460327 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0709b-f53c-449c-a057-87af1b8626c3 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:34.461791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-15f0709b-f53c-449c-a057-87af1b8626c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:34.488305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e6af6-d9bc-45cf-9829-0b1f43213aa2 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:34.523666 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0709b-f53c-449c-a057-87af1b8626c3 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:34.527262 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb2cfb-2b3f-45f9-a4d1-2aa7cee30c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:34.527898 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb2cfb-2b3f-45f9-a4d1-2aa7cee30c3b service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:34.528192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb2cfb-2b3f-45f9-a4d1-2aa7cee30c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:34.528465 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb2cfb-2b3f-45f9-a4d1-2aa7cee30c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:34.538128 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35712b-c7b1-4fa0-8698-aab87eb2c9bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:34.539114 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35712b-c7b1-4fa0-8698-aab87eb2c9bc service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:34.539563 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb2cfb-2b3f-45f9-a4d1-2aa7cee30c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:34.539701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35712b-c7b1-4fa0-8698-aab87eb2c9bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:34.539942 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35712b-c7b1-4fa0-8698-aab87eb2c9bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:34.541084 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb2cfb-2b3f-45f9-a4d1-2aa7cee30c3b service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:34.549566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35712b-c7b1-4fa0-8698-aab87eb2c9bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:34.551611 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1074/2140] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:26:34.551745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35712b-c7b1-4fa0-8698-aab87eb2c9bc service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:34.561738 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1067/2141] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:34.586809 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb2cfb-2b3f-45f9-a4d1-2aa7cee30c3b service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:34.588254 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-3ecb2cfb-2b3f-45f9-a4d1-2aa7cee30c3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:34.601368 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb2cfb-2b3f-45f9-a4d1-2aa7cee30c3b service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:34.606051 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4323f8-ba3b-4610-bb30-3d541d221339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:34.606892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4323f8-ba3b-4610-bb30-3d541d221339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:34.607177 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4323f8-ba3b-4610-bb30-3d541d221339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:34.607449 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4323f8-ba3b-4610-bb30-3d541d221339 admin admin] PATH_INFO: `/v3/users/67d78d0333654cdc8095b6b275df1f0c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:34.608682 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4323f8-ba3b-4610-bb30-3d541d221339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67d78d0333654cdc8095b6b275df1f0c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:34.610594 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4323f8-ba3b-4610-bb30-3d541d221339 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:34.660401 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-1c4323f8-ba3b-4610-bb30-3d541d221339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67d78d0333654cdc8095b6b275df1f0c'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:34.661857 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-1c4323f8-ba3b-4610-bb30-3d541d221339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67d78d0333654cdc8095b6b275df1f0c'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:34.669785 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-1c4323f8-ba3b-4610-bb30-3d541d221339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67d78d0333654cdc8095b6b275df1f0c'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:34.677571 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-1c4323f8-ba3b-4610-bb30-3d541d221339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67d78d0333654cdc8095b6b275df1f0c'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:34.691078 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-1c4323f8-ba3b-4610-bb30-3d541d221339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67d78d0333654cdc8095b6b275df1f0c'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:34.698310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1075/2142] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:34 2022] DELETE /identity/v3/users/67d78d0333654cdc8095b6b275df1f0c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:34.703021 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41603c3-f32a-4907-b3db-cc4e5e85921f None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:34.703393 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41603c3-f32a-4907-b3db-cc4e5e85921f None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:34.703769 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41603c3-f32a-4907-b3db-cc4e5e85921f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:34.721303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-f41603c3-f32a-4907-b3db-cc4e5e85921f None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:34.722704 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f41603c3-f32a-4907-b3db-cc4e5e85921f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:34.832233 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1068/2143] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:26:34.852469 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4323f8-ba3b-4610-bb30-3d541d221339 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:34.854090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-1c4323f8-ba3b-4610-bb30-3d541d221339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:34.935844 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4323f8-ba3b-4610-bb30-3d541d221339 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:34.939794 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2c0e5-79bd-4b62-8b80-6cb70f9809a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:34.940676 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2c0e5-79bd-4b62-8b80-6cb70f9809a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:34.941044 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2c0e5-79bd-4b62-8b80-6cb70f9809a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:34.941389 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2c0e5-79bd-4b62-8b80-6cb70f9809a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:34.955940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2c0e5-79bd-4b62-8b80-6cb70f9809a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:34.958678 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2c0e5-79bd-4b62-8b80-6cb70f9809a1 service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:34.971542 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1076/2144] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:34.980002 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41603c3-f32a-4907-b3db-cc4e5e85921f None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:34.981620 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f41603c3-f32a-4907-b3db-cc4e5e85921f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:35.002632 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41603c3-f32a-4907-b3db-cc4e5e85921f None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:35.016304 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4301ea-52f3-4773-b0dd-a5ceee2fb5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:35.017258 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4301ea-52f3-4773-b0dd-a5ceee2fb5f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:35.018008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4301ea-52f3-4773-b0dd-a5ceee2fb5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:35.019545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4301ea-52f3-4773-b0dd-a5ceee2fb5f4 admin admin] PATH_INFO: `/v3/projects/9151f805e5a647beb504f38073404862` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:35.023260 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4301ea-52f3-4773-b0dd-a5ceee2fb5f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9151f805e5a647beb504f38073404862)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:35.026028 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4301ea-52f3-4773-b0dd-a5ceee2fb5f4 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:35.048438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2c0e5-79bd-4b62-8b80-6cb70f9809a1 service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:35.049859 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-ace2c0e5-79bd-4b62-8b80-6cb70f9809a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:35.066064 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2c0e5-79bd-4b62-8b80-6cb70f9809a1 service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:35.083257 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6adb7b-c941-4275-a3bc-defd79b9c127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:35.084785 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6adb7b-c941-4275-a3bc-defd79b9c127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:35.087817 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6adb7b-c941-4275-a3bc-defd79b9c127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:35.090830 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6adb7b-c941-4275-a3bc-defd79b9c127 admin admin] PATH_INFO: `/v3/projects/4a02478ba1f0406488476a4ece702be5` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:35.100452 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6adb7b-c941-4275-a3bc-defd79b9c127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a02478ba1f0406488476a4ece702be5)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:35.107434 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6adb7b-c941-4275-a3bc-defd79b9c127 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:35.108854 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9b4301ea-52f3-4773-b0dd-a5ceee2fb5f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9151f805e5a647beb504f38073404862', 'request_id': 'req-9b4301ea-52f3-4773-b0dd-a5ceee2fb5f4'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.115583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9b4301ea-52f3-4773-b0dd-a5ceee2fb5f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9151f805e5a647beb504f38073404862', 'request_id': 'req-9b4301ea-52f3-4773-b0dd-a5ceee2fb5f4'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.126471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9b4301ea-52f3-4773-b0dd-a5ceee2fb5f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9151f805e5a647beb504f38073404862', 'request_id': 'req-9b4301ea-52f3-4773-b0dd-a5ceee2fb5f4'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.142284 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9b4301ea-52f3-4773-b0dd-a5ceee2fb5f4 admin admin] The token cache is being invalidate because project 9151f805e5a647beb504f38073404862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:35.142587 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9b4301ea-52f3-4773-b0dd-a5ceee2fb5f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.143261 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9b4301ea-52f3-4773-b0dd-a5ceee2fb5f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.146002 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1069/2145] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:34 2022] DELETE /identity/v3/projects/9151f805e5a647beb504f38073404862 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:35.150880 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa34ad-ef38-47f0-bb78-d306d7d25821 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:35.151179 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa34ad-ef38-47f0-bb78-d306d7d25821 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:35.151459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa34ad-ef38-47f0-bb78-d306d7d25821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:35.172087 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-94aa34ad-ef38-47f0-bb78-d306d7d25821 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:35.173402 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-94aa34ad-ef38-47f0-bb78-d306d7d25821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:35.175605 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-1e6adb7b-c941-4275-a3bc-defd79b9c127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a02478ba1f0406488476a4ece702be5', 'request_id': 'req-1e6adb7b-c941-4275-a3bc-defd79b9c127'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.186493 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-1e6adb7b-c941-4275-a3bc-defd79b9c127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a02478ba1f0406488476a4ece702be5', 'request_id': 'req-1e6adb7b-c941-4275-a3bc-defd79b9c127'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.195187 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-1e6adb7b-c941-4275-a3bc-defd79b9c127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a02478ba1f0406488476a4ece702be5', 'request_id': 'req-1e6adb7b-c941-4275-a3bc-defd79b9c127'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.211888 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-1e6adb7b-c941-4275-a3bc-defd79b9c127 admin admin] The token cache is being invalidate because project 4a02478ba1f0406488476a4ece702be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:35.212455 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-1e6adb7b-c941-4275-a3bc-defd79b9c127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.213549 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-1e6adb7b-c941-4275-a3bc-defd79b9c127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.216965 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1077/2146] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:35 2022] DELETE /identity/v3/projects/4a02478ba1f0406488476a4ece702be5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:35.220988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6adb7b-c941-4275-a3bc-defd79b9c127 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:35.222423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-1e6adb7b-c941-4275-a3bc-defd79b9c127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:35.257672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1070/2147] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:26:35.267232 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e1e01-6122-4f4f-a1e6-cdf1e3d41c0a None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:35.267759 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e1e01-6122-4f4f-a1e6-cdf1e3d41c0a None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:35.267981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e1e01-6122-4f4f-a1e6-cdf1e3d41c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:35.289060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-9d9e1e01-6122-4f4f-a1e6-cdf1e3d41c0a None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:35.290195 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-9d9e1e01-6122-4f4f-a1e6-cdf1e3d41c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:35.300185 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1071/2148] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:26:35.304610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e1e01-6122-4f4f-a1e6-cdf1e3d41c0a None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:35.309312 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6adb7b-c941-4275-a3bc-defd79b9c127 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:35.314187 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab323168-77fe-48e7-b11a-9770ac23b731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:35.315060 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab323168-77fe-48e7-b11a-9770ac23b731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:35.315375 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab323168-77fe-48e7-b11a-9770ac23b731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:35.315606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab323168-77fe-48e7-b11a-9770ac23b731 admin admin] PATH_INFO: `/v3/users/3060bd3c160c442bb7f8aa5e4b01a22e` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:35.317095 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab323168-77fe-48e7-b11a-9770ac23b731 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3060bd3c160c442bb7f8aa5e4b01a22e)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:35.319075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab323168-77fe-48e7-b11a-9770ac23b731 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:35.327828 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e1e01-6122-4f4f-a1e6-cdf1e3d41c0a None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:35.333866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cafbb-3b92-4afd-be05-2cdaf5f28227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:35.334559 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cafbb-3b92-4afd-be05-2cdaf5f28227 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:35.334840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cafbb-3b92-4afd-be05-2cdaf5f28227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:35.335118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cafbb-3b92-4afd-be05-2cdaf5f28227 admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:35.335987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cafbb-3b92-4afd-be05-2cdaf5f28227 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:35.336347 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cafbb-3b92-4afd-be05-2cdaf5f28227 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:35.338132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cafbb-3b92-4afd-be05-2cdaf5f28227 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:35.356615 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1072/2149] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:26:35.357771 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cafbb-3b92-4afd-be05-2cdaf5f28227 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:35.361907 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-855cafbb-3b92-4afd-be05-2cdaf5f28227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:35.377133 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cafbb-3b92-4afd-be05-2cdaf5f28227 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:35.380562 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-ab323168-77fe-48e7-b11a-9770ac23b731 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3060bd3c160c442bb7f8aa5e4b01a22e'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.381457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-ab323168-77fe-48e7-b11a-9770ac23b731 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3060bd3c160c442bb7f8aa5e4b01a22e'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.381944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ab455-b0e5-43fe-9fe8-2cc39a7a4f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:35.382795 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ab455-b0e5-43fe-9fe8-2cc39a7a4f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:35.383077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ab455-b0e5-43fe-9fe8-2cc39a7a4f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:35.383351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ab455-b0e5-43fe-9fe8-2cc39a7a4f86 admin admin] PATH_INFO: `/v3/projects/342a1d8a441940e1b8142d7f16533b95` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:35.385175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ab455-b0e5-43fe-9fe8-2cc39a7a4f86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=342a1d8a441940e1b8142d7f16533b95)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:35.387075 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ab455-b0e5-43fe-9fe8-2cc39a7a4f86 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:35.388900 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-ab323168-77fe-48e7-b11a-9770ac23b731 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3060bd3c160c442bb7f8aa5e4b01a22e'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.397595 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-ab323168-77fe-48e7-b11a-9770ac23b731 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3060bd3c160c442bb7f8aa5e4b01a22e'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.410029 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-ab323168-77fe-48e7-b11a-9770ac23b731 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3060bd3c160c442bb7f8aa5e4b01a22e'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.416694 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1078/2150] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:35 2022] DELETE /identity/v3/users/3060bd3c160c442bb7f8aa5e4b01a22e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:26:35.420636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab323168-77fe-48e7-b11a-9770ac23b731 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:35.422135 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-ab323168-77fe-48e7-b11a-9770ac23b731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:35.442176 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-910ab455-b0e5-43fe-9fe8-2cc39a7a4f86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '342a1d8a441940e1b8142d7f16533b95', 'request_id': 'req-910ab455-b0e5-43fe-9fe8-2cc39a7a4f86'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.448003 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-910ab455-b0e5-43fe-9fe8-2cc39a7a4f86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '342a1d8a441940e1b8142d7f16533b95', 'request_id': 'req-910ab455-b0e5-43fe-9fe8-2cc39a7a4f86'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.460111 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-910ab455-b0e5-43fe-9fe8-2cc39a7a4f86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '342a1d8a441940e1b8142d7f16533b95', 'request_id': 'req-910ab455-b0e5-43fe-9fe8-2cc39a7a4f86'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.477191 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-910ab455-b0e5-43fe-9fe8-2cc39a7a4f86 admin admin] The token cache is being invalidate because project 342a1d8a441940e1b8142d7f16533b95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:35.477535 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-910ab455-b0e5-43fe-9fe8-2cc39a7a4f86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.478579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-910ab455-b0e5-43fe-9fe8-2cc39a7a4f86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.480328 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1073/2151] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:35 2022] DELETE /identity/v3/projects/342a1d8a441940e1b8142d7f16533b95 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:35.487903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e4f72-0591-4952-b34c-c5509f38b5c3 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:35.488268 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e4f72-0591-4952-b34c-c5509f38b5c3 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:35.488640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e4f72-0591-4952-b34c-c5509f38b5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:35.498667 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab323168-77fe-48e7-b11a-9770ac23b731 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:35.517461 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-d96e4f72-0591-4952-b34c-c5509f38b5c3 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:35.520428 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-d96e4f72-0591-4952-b34c-c5509f38b5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:35.562726 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d4741-0ea4-4b7b-8cc4-8e1d7da6e573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:35.563644 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d4741-0ea4-4b7b-8cc4-8e1d7da6e573 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:35.563644 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d4741-0ea4-4b7b-8cc4-8e1d7da6e573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:35.563932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d4741-0ea4-4b7b-8cc4-8e1d7da6e573 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:35.564641 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d4741-0ea4-4b7b-8cc4-8e1d7da6e573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:35.566615 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d4741-0ea4-4b7b-8cc4-8e1d7da6e573 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:35.607463 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1079/2152] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:35 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:35.608475 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d4741-0ea4-4b7b-8cc4-8e1d7da6e573 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:35.610675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-9e0d4741-0ea4-4b7b-8cc4-8e1d7da6e573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:35.618188 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1074/2153] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:35.619712 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f585a-7c38-4c3b-a38f-5a6cbb4365b5 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:35.620243 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f585a-7c38-4c3b-a38f-5a6cbb4365b5 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:35.620473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f585a-7c38-4c3b-a38f-5a6cbb4365b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:35.662191 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-f89f585a-7c38-4c3b-a38f-5a6cbb4365b5 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:35.676197 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f89f585a-7c38-4c3b-a38f-5a6cbb4365b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:35.714026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d4741-0ea4-4b7b-8cc4-8e1d7da6e573 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:35.719147 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11546370-cfc8-4823-b104-1af19aeb31b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:35.719811 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11546370-cfc8-4823-b104-1af19aeb31b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:35.720087 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11546370-cfc8-4823-b104-1af19aeb31b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:35.720383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11546370-cfc8-4823-b104-1af19aeb31b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:35.721068 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11546370-cfc8-4823-b104-1af19aeb31b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:35.723024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11546370-cfc8-4823-b104-1af19aeb31b5 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:35.746349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1080/2154] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:35 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:35.749052 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1075/2155] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:35.751158 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11546370-cfc8-4823-b104-1af19aeb31b5 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:35.752807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f585a-7c38-4c3b-a38f-5a6cbb4365b5 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:35.762872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f585a-7c38-4c3b-a38f-5a6cbb4365b5 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:35.764371 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11546370-cfc8-4823-b104-1af19aeb31b5 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:35.767823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8411a4-93cc-4668-85a4-c11129eca355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:35.768838 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8411a4-93cc-4668-85a4-c11129eca355 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:35.769123 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8411a4-93cc-4668-85a4-c11129eca355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:35.769387 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8411a4-93cc-4668-85a4-c11129eca355 admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:35.770280 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf596ddc-1d4a-4166-a581-a5c0f6e40510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:35.771077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8411a4-93cc-4668-85a4-c11129eca355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:35.771077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8411a4-93cc-4668-85a4-c11129eca355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:35.771354 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf596ddc-1d4a-4166-a581-a5c0f6e40510 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:35.772084 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf596ddc-1d4a-4166-a581-a5c0f6e40510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:35.772685 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf596ddc-1d4a-4166-a581-a5c0f6e40510 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:35.772800 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8411a4-93cc-4668-85a4-c11129eca355 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:35.773093 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf596ddc-1d4a-4166-a581-a5c0f6e40510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:35.774700 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf596ddc-1d4a-4166-a581-a5c0f6e40510 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:35.785213 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1076/2156] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:26:35.788758 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1081/2157] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:35.789959 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8411a4-93cc-4668-85a4-c11129eca355 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:35.792515 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf596ddc-1d4a-4166-a581-a5c0f6e40510 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:35.803577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf596ddc-1d4a-4166-a581-a5c0f6e40510 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:35.806010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8411a4-93cc-4668-85a4-c11129eca355 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:35.808573 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42034f44-5572-4f2f-8a36-3dc04f95f88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:35.809242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42034f44-5572-4f2f-8a36-3dc04f95f88b admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:35.813028 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d30cfb-b3f0-48d9-b6aa-d1e7ff9d3676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:35.813187 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42034f44-5572-4f2f-8a36-3dc04f95f88b admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:35.813313 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d30cfb-b3f0-48d9-b6aa-d1e7ff9d3676 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:35.813412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42034f44-5572-4f2f-8a36-3dc04f95f88b admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:35.814072 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d30cfb-b3f0-48d9-b6aa-d1e7ff9d3676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:35.814383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42034f44-5572-4f2f-8a36-3dc04f95f88b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:35.814473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d30cfb-b3f0-48d9-b6aa-d1e7ff9d3676 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:35.814925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d30cfb-b3f0-48d9-b6aa-d1e7ff9d3676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:35.815294 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42034f44-5572-4f2f-8a36-3dc04f95f88b admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:35.818360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d30cfb-b3f0-48d9-b6aa-d1e7ff9d3676 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:35.830369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1082/2158] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:26:35.831933 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42034f44-5572-4f2f-8a36-3dc04f95f88b admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:35.834672 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-42034f44-5572-4f2f-8a36-3dc04f95f88b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:35.849032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42034f44-5572-4f2f-8a36-3dc04f95f88b admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:35.852072 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1077/2159] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:35 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:35.853441 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d30cfb-b3f0-48d9-b6aa-d1e7ff9d3676 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:35.854163 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0c088-522c-455e-a097-cf264f915a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:35.855004 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0c088-522c-455e-a097-cf264f915a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:35.855811 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0c088-522c-455e-a097-cf264f915a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:35.856080 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0c088-522c-455e-a097-cf264f915a10 admin admin] PATH_INFO: `/v3/projects/56b37ae1234a4eb29ecf46f51e4780dc` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:35.857373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0c088-522c-455e-a097-cf264f915a10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56b37ae1234a4eb29ecf46f51e4780dc)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:35.859956 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0c088-522c-455e-a097-cf264f915a10 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:35.907235 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-cbb0c088-522c-455e-a097-cf264f915a10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56b37ae1234a4eb29ecf46f51e4780dc', 'request_id': 'req-cbb0c088-522c-455e-a097-cf264f915a10'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.915064 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-cbb0c088-522c-455e-a097-cf264f915a10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56b37ae1234a4eb29ecf46f51e4780dc', 'request_id': 'req-cbb0c088-522c-455e-a097-cf264f915a10'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.921520 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d30cfb-b3f0-48d9-b6aa-d1e7ff9d3676 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:35.921996 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-cbb0c088-522c-455e-a097-cf264f915a10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56b37ae1234a4eb29ecf46f51e4780dc', 'request_id': 'req-cbb0c088-522c-455e-a097-cf264f915a10'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.933747 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-cbb0c088-522c-455e-a097-cf264f915a10 admin admin] The token cache is being invalidate because project 56b37ae1234a4eb29ecf46f51e4780dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:35.934126 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-cbb0c088-522c-455e-a097-cf264f915a10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.934774 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-cbb0c088-522c-455e-a097-cf264f915a10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:35.936357 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1083/2160] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:35 2022] DELETE /identity/v3/projects/56b37ae1234a4eb29ecf46f51e4780dc => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:35.937085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0c088-522c-455e-a097-cf264f915a10 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:35.938353 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-cbb0c088-522c-455e-a097-cf264f915a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:35.977910 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310155a-bcec-4dd9-aefe-62be0abb2dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:35.978834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310155a-bcec-4dd9-aefe-62be0abb2dba admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:35.979117 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310155a-bcec-4dd9-aefe-62be0abb2dba admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:35.979393 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310155a-bcec-4dd9-aefe-62be0abb2dba admin admin] PATH_INFO: `/v3/projects/08178a0fd39e4c07806097319a9f5d66/users/065e77b8c4df4016bd499fd80ac7eb66/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:35.994995 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310155a-bcec-4dd9-aefe-62be0abb2dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=08178a0fd39e4c07806097319a9f5d66, user_id=065e77b8c4df4016bd499fd80ac7eb66, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:35.997844 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310155a-bcec-4dd9-aefe-62be0abb2dba admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:36.002149 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0c088-522c-455e-a097-cf264f915a10 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:36.007846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2501e-5ad9-482a-aaa3-ea68232bedbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:36.008573 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2501e-5ad9-482a-aaa3-ea68232bedbf admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:36.008812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2501e-5ad9-482a-aaa3-ea68232bedbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:36.009075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2501e-5ad9-482a-aaa3-ea68232bedbf admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:36.009761 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2501e-5ad9-482a-aaa3-ea68232bedbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:36.011594 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1078/2161] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:35 2022] PUT /identity/v3/projects/08178a0fd39e4c07806097319a9f5d66/users/065e77b8c4df4016bd499fd80ac7eb66/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:36.011748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2501e-5ad9-482a-aaa3-ea68232bedbf admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:36.013814 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09f888-55ae-4dcd-937e-2b6f6c82143f None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:36.014207 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09f888-55ae-4dcd-937e-2b6f6c82143f None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:36.014607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09f888-55ae-4dcd-937e-2b6f6c82143f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:36.035694 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1084/2162] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:35 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:36.035694 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9555781-6b7f-4c88-900d-c5a6d8b1eff1 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:36.035694 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9555781-6b7f-4c88-900d-c5a6d8b1eff1 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:36.035694 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9555781-6b7f-4c88-900d-c5a6d8b1eff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:36.036121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-ac09f888-55ae-4dcd-937e-2b6f6c82143f None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:36.036241 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-ac09f888-55ae-4dcd-937e-2b6f6c82143f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:36.060883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-b9555781-6b7f-4c88-900d-c5a6d8b1eff1 None None] MFA Rules not processed for user `065e77b8c4df4016bd499fd80ac7eb66`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:36.062148 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-b9555781-6b7f-4c88-900d-c5a6d8b1eff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:36.093729 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1079/2163] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:36.094570 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09f888-55ae-4dcd-937e-2b6f6c82143f None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:36.104189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09f888-55ae-4dcd-937e-2b6f6c82143f None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:36.108723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179c55a-ce7f-407f-b620-ccbf0ec08c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:36.109373 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179c55a-ce7f-407f-b620-ccbf0ec08c54 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:36.109946 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179c55a-ce7f-407f-b620-ccbf0ec08c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:36.109946 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179c55a-ce7f-407f-b620-ccbf0ec08c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:36.110613 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179c55a-ce7f-407f-b620-ccbf0ec08c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:36.112291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179c55a-ce7f-407f-b620-ccbf0ec08c54 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:36.122213 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1080/2164] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:36.123539 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b350d-bf46-4d6c-8bc5-c2709e4e4c2a None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:36.123753 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b350d-bf46-4d6c-8bc5-c2709e4e4c2a None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:36.124027 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b350d-bf46-4d6c-8bc5-c2709e4e4c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:36.127884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1085/2165] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:36.132272 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9555781-6b7f-4c88-900d-c5a6d8b1eff1 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:36.143242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9555781-6b7f-4c88-900d-c5a6d8b1eff1 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:36.144412 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-401b350d-bf46-4d6c-8bc5-c2709e4e4c2a None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:36.146400 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-401b350d-bf46-4d6c-8bc5-c2709e4e4c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:36.148974 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c5fb2-b520-42db-8d51-f55b7df8f6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:36.149646 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c5fb2-b520-42db-8d51-f55b7df8f6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:36.149928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c5fb2-b520-42db-8d51-f55b7df8f6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:36.150263 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c5fb2-b520-42db-8d51-f55b7df8f6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:36.150928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c5fb2-b520-42db-8d51-f55b7df8f6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:36.152721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c5fb2-b520-42db-8d51-f55b7df8f6e6 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:36.158515 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1081/2166] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:36.158515 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b350d-bf46-4d6c-8bc5-c2709e4e4c2a None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:36.159988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-401b350d-bf46-4d6c-8bc5-c2709e4e4c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:36.167277 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1086/2167] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:36.167277 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c5fb2-b520-42db-8d51-f55b7df8f6e6 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:36.172757 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b350d-bf46-4d6c-8bc5-c2709e4e4c2a None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:36.177306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c5fb2-b520-42db-8d51-f55b7df8f6e6 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:36.177829 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8029796-6986-4da2-a02f-178587b71fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:36.178493 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8029796-6986-4da2-a02f-178587b71fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:36.178776 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8029796-6986-4da2-a02f-178587b71fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:36.179054 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8029796-6986-4da2-a02f-178587b71fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:36.179749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8029796-6986-4da2-a02f-178587b71fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:36.181696 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8029796-6986-4da2-a02f-178587b71fb1 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:36.183843 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b94f63-6a38-41da-882d-e6ec0c0461e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:36.184688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b94f63-6a38-41da-882d-e6ec0c0461e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:36.185060 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b94f63-6a38-41da-882d-e6ec0c0461e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:36.185318 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b94f63-6a38-41da-882d-e6ec0c0461e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:36.186188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b94f63-6a38-41da-882d-e6ec0c0461e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:36.186547 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b94f63-6a38-41da-882d-e6ec0c0461e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:36.188781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b94f63-6a38-41da-882d-e6ec0c0461e5 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:36.202854 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1087/2168] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:36.203725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b94f63-6a38-41da-882d-e6ec0c0461e5 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:36.214972 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1082/2169] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:36 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:36.216109 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8029796-6986-4da2-a02f-178587b71fb1 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:36.216665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b94f63-6a38-41da-882d-e6ec0c0461e5 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:36.277015 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef0ff7-04c8-437a-8c64-2a7513468627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:36.278017 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef0ff7-04c8-437a-8c64-2a7513468627 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:36.278358 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef0ff7-04c8-437a-8c64-2a7513468627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:36.278713 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef0ff7-04c8-437a-8c64-2a7513468627 admin admin] PATH_INFO: `/v3/projects/2715141f8ffd49d892600c779e02fa17/users/6dfbf496174e4138bfac5e1b925a0b2c/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:36.286699 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8029796-6986-4da2-a02f-178587b71fb1 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:36.293216 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cdae4-cd75-41e6-bb2c-0f724ba22a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:36.293901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cdae4-cd75-41e6-bb2c-0f724ba22a12 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:36.294117 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cdae4-cd75-41e6-bb2c-0f724ba22a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:36.294378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cdae4-cd75-41e6-bb2c-0f724ba22a12 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:36.295075 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cdae4-cd75-41e6-bb2c-0f724ba22a12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:36.295584 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef0ff7-04c8-437a-8c64-2a7513468627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2715141f8ffd49d892600c779e02fa17, user_id=6dfbf496174e4138bfac5e1b925a0b2c, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:36.297218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cdae4-cd75-41e6-bb2c-0f724ba22a12 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:36.298267 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef0ff7-04c8-437a-8c64-2a7513468627 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:36.316032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1088/2170] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:36 2022] PUT /identity/v3/projects/2715141f8ffd49d892600c779e02fa17/users/6dfbf496174e4138bfac5e1b925a0b2c/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:36.318088 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef0ff7-04c8-437a-8c64-2a7513468627 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:36.333125 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1083/2171] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:36 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:36.334492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945af72-db33-4905-b2ea-b5f9aed98956 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:36.334790 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945af72-db33-4905-b2ea-b5f9aed98956 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:36.335055 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945af72-db33-4905-b2ea-b5f9aed98956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:36.353764 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-4945af72-db33-4905-b2ea-b5f9aed98956 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:36.355010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-4945af72-db33-4905-b2ea-b5f9aed98956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:36.386826 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef0ff7-04c8-437a-8c64-2a7513468627 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:36.424294 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1084/2172] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:36.425133 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945af72-db33-4905-b2ea-b5f9aed98956 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:36.440819 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945af72-db33-4905-b2ea-b5f9aed98956 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:36.446446 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e32a9b-0d22-4cd0-9b7b-4435d3bcf76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:36.447138 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e32a9b-0d22-4cd0-9b7b-4435d3bcf76d admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:36.447423 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e32a9b-0d22-4cd0-9b7b-4435d3bcf76d admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:36.447699 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e32a9b-0d22-4cd0-9b7b-4435d3bcf76d admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:36.448429 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e32a9b-0d22-4cd0-9b7b-4435d3bcf76d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:36.450663 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e32a9b-0d22-4cd0-9b7b-4435d3bcf76d admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:36.455000 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d6eb9-9197-4120-a8ad-6ff7b7f9eaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:36.455747 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d6eb9-9197-4120-a8ad-6ff7b7f9eaa9 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:36.456096 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d6eb9-9197-4120-a8ad-6ff7b7f9eaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:36.456493 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d6eb9-9197-4120-a8ad-6ff7b7f9eaa9 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:36.457865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d6eb9-9197-4120-a8ad-6ff7b7f9eaa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:36.467318 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d6eb9-9197-4120-a8ad-6ff7b7f9eaa9 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:36.483693 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1085/2173] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:36 2022] POST /identity/v3/users => generated 283 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:36.484538 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e32a9b-0d22-4cd0-9b7b-4435d3bcf76d admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:36.486330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-d7e32a9b-0d22-4cd0-9b7b-4435d3bcf76d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:36.490344 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1089/2174] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:36 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:36.492398 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d6eb9-9197-4120-a8ad-6ff7b7f9eaa9 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:36.507451 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d6eb9-9197-4120-a8ad-6ff7b7f9eaa9 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:36.518995 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434189d-df62-4454-8e4e-55878231f6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:36.520385 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434189d-df62-4454-8e4e-55878231f6cf admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:36.520695 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434189d-df62-4454-8e4e-55878231f6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:36.521006 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434189d-df62-4454-8e4e-55878231f6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:36.521875 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434189d-df62-4454-8e4e-55878231f6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:36.523499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434189d-df62-4454-8e4e-55878231f6cf admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:36.533961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1090/2175] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:36.534635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434189d-df62-4454-8e4e-55878231f6cf admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:36.544412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434189d-df62-4454-8e4e-55878231f6cf admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:36.549365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8319f-3c3f-452e-9af0-0543419c9372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:36.549999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8319f-3c3f-452e-9af0-0543419c9372 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:36.550275 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8319f-3c3f-452e-9af0-0543419c9372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:36.550553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8319f-3c3f-452e-9af0-0543419c9372 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:36.551940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8319f-3c3f-452e-9af0-0543419c9372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:36.553312 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8319f-3c3f-452e-9af0-0543419c9372 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:36.556035 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e32a9b-0d22-4cd0-9b7b-4435d3bcf76d admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:36.559981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e294e-bbc1-42c9-8bc8-8a5355103928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:36.560740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e294e-bbc1-42c9-8bc8-8a5355103928 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:36.561027 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e294e-bbc1-42c9-8bc8-8a5355103928 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:36.561297 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e294e-bbc1-42c9-8bc8-8a5355103928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:36.563868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1091/2176] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:36.567983 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8319f-3c3f-452e-9af0-0543419c9372 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:36.573288 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e294e-bbc1-42c9-8bc8-8a5355103928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:36.574619 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e294e-bbc1-42c9-8bc8-8a5355103928 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:36.579273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8319f-3c3f-452e-9af0-0543419c9372 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:36.584839 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e786f6-80bc-4725-8a2a-f8acc6d517a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:36.585499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e786f6-80bc-4725-8a2a-f8acc6d517a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:36.585782 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e786f6-80bc-4725-8a2a-f8acc6d517a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:36.586064 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e786f6-80bc-4725-8a2a-f8acc6d517a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:36.586345 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1086/2177] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:36.586784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e786f6-80bc-4725-8a2a-f8acc6d517a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:36.587189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e294e-bbc1-42c9-8bc8-8a5355103928 service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:36.588498 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e786f6-80bc-4725-8a2a-f8acc6d517a3 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:36.599927 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1092/2178] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:36.603985 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e294e-bbc1-42c9-8bc8-8a5355103928 service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:36.604595 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e786f6-80bc-4725-8a2a-f8acc6d517a3 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:36.613329 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc2474-3517-4ab8-8678-67922a6a23fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:36.614380 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc2474-3517-4ab8-8678-67922a6a23fe admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:36.614669 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc2474-3517-4ab8-8678-67922a6a23fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:36.614782 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e786f6-80bc-4725-8a2a-f8acc6d517a3 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:36.614943 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc2474-3517-4ab8-8678-67922a6a23fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:36.616278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc2474-3517-4ab8-8678-67922a6a23fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:36.618645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc2474-3517-4ab8-8678-67922a6a23fe admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:36.619718 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5304199-7e17-4035-a32f-7cc0a3a92f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:36.620628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5304199-7e17-4035-a32f-7cc0a3a92f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:36.620910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5304199-7e17-4035-a32f-7cc0a3a92f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:36.621461 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5304199-7e17-4035-a32f-7cc0a3a92f2c admin admin] PATH_INFO: `/v3/projects/9034b98d6f0e4e1e8b71b29926b7fdc9/users/c92a425dd6ad440aa6f980568756dd59/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:36.631651 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1087/2179] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:36.635779 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc2474-3517-4ab8-8678-67922a6a23fe admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:36.641152 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5304199-7e17-4035-a32f-7cc0a3a92f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9034b98d6f0e4e1e8b71b29926b7fdc9, user_id=c92a425dd6ad440aa6f980568756dd59, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:36.644195 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5304199-7e17-4035-a32f-7cc0a3a92f2c admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:36.653192 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc2474-3517-4ab8-8678-67922a6a23fe admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:36.660986 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787af873-6461-42f0-af44-8691b19711a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:36.662350 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787af873-6461-42f0-af44-8691b19711a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:36.662497 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787af873-6461-42f0-af44-8691b19711a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:36.662762 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787af873-6461-42f0-af44-8691b19711a4 admin admin] PATH_INFO: `/v3/projects/d983bcbcc0dc4907a48116d4b5ba756d/users/f34d66aaaff64632868610b5bd4e783f/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:36.664987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1093/2180] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:36 2022] PUT /identity/v3/projects/9034b98d6f0e4e1e8b71b29926b7fdc9/users/c92a425dd6ad440aa6f980568756dd59/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:26:36.676246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da69c3c-5c04-4c5c-b884-117598be81a7 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:36.676837 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da69c3c-5c04-4c5c-b884-117598be81a7 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:36.677113 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da69c3c-5c04-4c5c-b884-117598be81a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:36.702345 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787af873-6461-42f0-af44-8691b19711a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d983bcbcc0dc4907a48116d4b5ba756d, user_id=f34d66aaaff64632868610b5bd4e783f, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:36.714808 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787af873-6461-42f0-af44-8691b19711a4 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:36.717779 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-0da69c3c-5c04-4c5c-b884-117598be81a7 None None] MFA Rules not processed for user `c92a425dd6ad440aa6f980568756dd59`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:36.719769 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-0da69c3c-5c04-4c5c-b884-117598be81a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:36.737657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1088/2181] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:36 2022] PUT /identity/v3/projects/d983bcbcc0dc4907a48116d4b5ba756d/users/f34d66aaaff64632868610b5bd4e783f/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:36.748891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e9cf7-7f84-4ff3-853c-f2eab7fed966 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:36.749252 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e9cf7-7f84-4ff3-853c-f2eab7fed966 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:36.749563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e9cf7-7f84-4ff3-853c-f2eab7fed966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:36.802392 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-e56e9cf7-7f84-4ff3-853c-f2eab7fed966 None None] MFA Rules not processed for user `f34d66aaaff64632868610b5bd4e783f`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:36.803832 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-e56e9cf7-7f84-4ff3-853c-f2eab7fed966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:36.824145 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1094/2182] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:26:36.831733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da69c3c-5c04-4c5c-b884-117598be81a7 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:36.912602 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1089/2183] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:36.919176 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e9cf7-7f84-4ff3-853c-f2eab7fed966 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:36.965629 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da69c3c-5c04-4c5c-b884-117598be81a7 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:37.022738 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e9cf7-7f84-4ff3-853c-f2eab7fed966 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:37.028302 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da876ca7-19c3-4986-b49d-b899648c052e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:37.029208 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da876ca7-19c3-4986-b49d-b899648c052e admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:37.029657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da876ca7-19c3-4986-b49d-b899648c052e admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:37.030103 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da876ca7-19c3-4986-b49d-b899648c052e admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:37.031700 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da876ca7-19c3-4986-b49d-b899648c052e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:37.033812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da876ca7-19c3-4986-b49d-b899648c052e admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:37.067241 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92464f1d-6c9a-41af-9648-86112f9616e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:37.068183 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92464f1d-6c9a-41af-9648-86112f9616e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:37.068570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92464f1d-6c9a-41af-9648-86112f9616e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:37.068915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92464f1d-6c9a-41af-9648-86112f9616e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:37.069843 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92464f1d-6c9a-41af-9648-86112f9616e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:37.070256 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1090/2184] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:36 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:26:37.071724 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92464f1d-6c9a-41af-9648-86112f9616e2 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:37.074049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da876ca7-19c3-4986-b49d-b899648c052e admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:37.112210 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1095/2185] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:36 2022] POST /identity/v3/projects => generated 365 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:37.114425 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92464f1d-6c9a-41af-9648-86112f9616e2 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:37.151260 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da876ca7-19c3-4986-b49d-b899648c052e admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:37.186260 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92464f1d-6c9a-41af-9648-86112f9616e2 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:37.191917 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f95a0b-e838-48b9-b7cb-d672c70e723e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:37.192718 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f95a0b-e838-48b9-b7cb-d672c70e723e admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:37.193065 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f95a0b-e838-48b9-b7cb-d672c70e723e admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:37.193411 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f95a0b-e838-48b9-b7cb-d672c70e723e admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:37.194164 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f95a0b-e838-48b9-b7cb-d672c70e723e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:37.196217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f95a0b-e838-48b9-b7cb-d672c70e723e admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:37.223694 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650b5d2-d021-4630-9f10-88a785dabf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:37.224504 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650b5d2-d021-4630-9f10-88a785dabf4f admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:37.224857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650b5d2-d021-4630-9f10-88a785dabf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:37.228332 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650b5d2-d021-4630-9f10-88a785dabf4f admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:37.228492 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1096/2186] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:37 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:37.228604 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650b5d2-d021-4630-9f10-88a785dabf4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:37.228696 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650b5d2-d021-4630-9f10-88a785dabf4f admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:37.234651 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f95a0b-e838-48b9-b7cb-d672c70e723e admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:37.248296 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f95a0b-e838-48b9-b7cb-d672c70e723e admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:37.256356 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf601c-f578-4ecc-ae6f-8d188dd4029b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:37.257152 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf601c-f578-4ecc-ae6f-8d188dd4029b admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:37.257600 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf601c-f578-4ecc-ae6f-8d188dd4029b admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:37.258078 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf601c-f578-4ecc-ae6f-8d188dd4029b admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:37.262697 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1091/2187] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:37 2022] POST /identity/v3/users => generated 295 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:37.262975 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf601c-f578-4ecc-ae6f-8d188dd4029b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:37.262975 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf601c-f578-4ecc-ae6f-8d188dd4029b admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:37.264350 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650b5d2-d021-4630-9f10-88a785dabf4f admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:37.283904 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1097/2188] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:37.284217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650b5d2-d021-4630-9f10-88a785dabf4f admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:37.285729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf601c-f578-4ecc-ae6f-8d188dd4029b admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:37.297512 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f90015-9080-4207-936d-e6a605196b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:37.298279 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f90015-9080-4207-936d-e6a605196b58 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:37.298629 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f90015-9080-4207-936d-e6a605196b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:37.298967 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f90015-9080-4207-936d-e6a605196b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:37.299710 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf601c-f578-4ecc-ae6f-8d188dd4029b admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:37.299861 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f90015-9080-4207-936d-e6a605196b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:37.301615 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f90015-9080-4207-936d-e6a605196b58 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:37.305892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c4a91-9ed2-4483-a0f5-96c00294cb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:37.306947 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c4a91-9ed2-4483-a0f5-96c00294cb54 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:37.307693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c4a91-9ed2-4483-a0f5-96c00294cb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:37.307978 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c4a91-9ed2-4483-a0f5-96c00294cb54 admin admin] PATH_INFO: `/v3/projects/878fabb3633e429b85611f10473574fd/users/f4c4390178ba46d68eecfb43a52e1e78/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:37.312718 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1092/2189] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:37.316356 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f90015-9080-4207-936d-e6a605196b58 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:37.326884 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f90015-9080-4207-936d-e6a605196b58 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:37.329911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c4a91-9ed2-4483-a0f5-96c00294cb54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=878fabb3633e429b85611f10473574fd, user_id=f4c4390178ba46d68eecfb43a52e1e78, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:37.332928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02439b-8426-482c-9ce0-34db0895a478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:37.333696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c4a91-9ed2-4483-a0f5-96c00294cb54 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:37.333819 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02439b-8426-482c-9ce0-34db0895a478 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:37.334182 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02439b-8426-482c-9ce0-34db0895a478 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:37.334506 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02439b-8426-482c-9ce0-34db0895a478 admin admin] PATH_INFO: `/v3/projects/cb54d6572883414e8f3d1a5aed47ea41/users/04b83356eff84d7fb352c2870267250f/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:37.350626 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02439b-8426-482c-9ce0-34db0895a478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb54d6572883414e8f3d1a5aed47ea41, user_id=04b83356eff84d7fb352c2870267250f, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:37.353461 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1098/2190] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:37 2022] PUT /identity/v3/projects/878fabb3633e429b85611f10473574fd/users/f4c4390178ba46d68eecfb43a52e1e78/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:37.356462 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02439b-8426-482c-9ce0-34db0895a478 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:37.358058 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c4a91-9ed2-4483-a0f5-96c00294cb54 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:37.376829 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1093/2191] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:37 2022] PUT /identity/v3/projects/cb54d6572883414e8f3d1a5aed47ea41/users/04b83356eff84d7fb352c2870267250f/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:26:37.378519 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02439b-8426-482c-9ce0-34db0895a478 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:37.442893 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c4a91-9ed2-4483-a0f5-96c00294cb54 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:37.483308 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02439b-8426-482c-9ce0-34db0895a478 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:37.492310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659aa39-c169-433d-b214-e8c975ba83a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:37.494417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659aa39-c169-433d-b214-e8c975ba83a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:37.494871 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659aa39-c169-433d-b214-e8c975ba83a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:37.495447 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659aa39-c169-433d-b214-e8c975ba83a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:37.497921 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659aa39-c169-433d-b214-e8c975ba83a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:37.501104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659aa39-c169-433d-b214-e8c975ba83a6 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:37.519138 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1094/2192] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:26:37.520915 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659aa39-c169-433d-b214-e8c975ba83a6 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:37.530891 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797caa4f-af5a-4b27-8624-b30195ad31a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:37.531563 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797caa4f-af5a-4b27-8624-b30195ad31a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:37.531841 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797caa4f-af5a-4b27-8624-b30195ad31a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:37.532110 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797caa4f-af5a-4b27-8624-b30195ad31a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:37.533097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797caa4f-af5a-4b27-8624-b30195ad31a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:37.536299 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659aa39-c169-433d-b214-e8c975ba83a6 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:37.537981 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797caa4f-af5a-4b27-8624-b30195ad31a5 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:37.544913 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f3e0a-4c42-4536-8c31-6090cc760109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:37.546138 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f3e0a-4c42-4536-8c31-6090cc760109 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:37.546641 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f3e0a-4c42-4536-8c31-6090cc760109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:37.547113 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f3e0a-4c42-4536-8c31-6090cc760109 admin admin] PATH_INFO: `/v3/projects/cb54d6572883414e8f3d1a5aed47ea41/users/04b83356eff84d7fb352c2870267250f/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:37.549807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f3e0a-4c42-4536-8c31-6090cc760109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb54d6572883414e8f3d1a5aed47ea41, user_id=04b83356eff84d7fb352c2870267250f, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:37.554554 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f3e0a-4c42-4536-8c31-6090cc760109 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:37.557788 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1099/2193] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:26:37.558940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797caa4f-af5a-4b27-8624-b30195ad31a5 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:37.569980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1095/2194] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:37 2022] PUT /identity/v3/projects/cb54d6572883414e8f3d1a5aed47ea41/users/04b83356eff84d7fb352c2870267250f/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:37.573717 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797caa4f-af5a-4b27-8624-b30195ad31a5 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:37.581430 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81749d3d-8bd0-4880-bc6f-0dc90f830099 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:37.582079 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81749d3d-8bd0-4880-bc6f-0dc90f830099 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:37.583164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81749d3d-8bd0-4880-bc6f-0dc90f830099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:37.615250 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-81749d3d-8bd0-4880-bc6f-0dc90f830099 None None] MFA Rules not processed for user `04b83356eff84d7fb352c2870267250f`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:37.616688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-81749d3d-8bd0-4880-bc6f-0dc90f830099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:37.656838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48037549-6e85-402f-afc9-7ae24def1eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:37.657958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48037549-6e85-402f-afc9-7ae24def1eee admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:37.658323 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48037549-6e85-402f-afc9-7ae24def1eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:37.658688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48037549-6e85-402f-afc9-7ae24def1eee admin admin] PATH_INFO: `/v3/projects/878fabb3633e429b85611f10473574fd/users/f4c4390178ba46d68eecfb43a52e1e78/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:37.661749 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48037549-6e85-402f-afc9-7ae24def1eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=878fabb3633e429b85611f10473574fd, user_id=f4c4390178ba46d68eecfb43a52e1e78, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:37.665180 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48037549-6e85-402f-afc9-7ae24def1eee admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:37.684301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1100/2195] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:37 2022] PUT /identity/v3/projects/878fabb3633e429b85611f10473574fd/users/f4c4390178ba46d68eecfb43a52e1e78/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:37.692543 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce8415-bd36-4385-8806-f94195a86612 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:37.692969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce8415-bd36-4385-8806-f94195a86612 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:37.693345 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce8415-bd36-4385-8806-f94195a86612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:37.724679 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-93ce8415-bd36-4385-8806-f94195a86612 None None] MFA Rules not processed for user `f4c4390178ba46d68eecfb43a52e1e78`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:37.729315 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1096/2196] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:37.729663 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-93ce8415-bd36-4385-8806-f94195a86612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:37.743296 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81749d3d-8bd0-4880-bc6f-0dc90f830099 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:37.745736 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-81749d3d-8bd0-4880-bc6f-0dc90f830099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:37.813390 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81749d3d-8bd0-4880-bc6f-0dc90f830099 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:37.858267 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1101/2197] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:37 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:26:37.868756 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce8415-bd36-4385-8806-f94195a86612 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:37.871596 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-93ce8415-bd36-4385-8806-f94195a86612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:37.894272 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4b0c0-6c0a-4db9-8e2c-a22d68788fc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:37.894866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4b0c0-6c0a-4db9-8e2c-a22d68788fc5 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:37.895146 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4b0c0-6c0a-4db9-8e2c-a22d68788fc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:37.895424 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4b0c0-6c0a-4db9-8e2c-a22d68788fc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:37.939444 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce8415-bd36-4385-8806-f94195a86612 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:37.943347 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbf205-b3de-444c-a0c8-5d2b6a361372 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:37.944000 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbf205-b3de-444c-a0c8-5d2b6a361372 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:37.944443 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbf205-b3de-444c-a0c8-5d2b6a361372 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:37.944727 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbf205-b3de-444c-a0c8-5d2b6a361372 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:37.957804 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbf205-b3de-444c-a0c8-5d2b6a361372 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:37.959310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbf205-b3de-444c-a0c8-5d2b6a361372 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:37.973206 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1102/2198] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:26:37.980709 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4b0c0-6c0a-4db9-8e2c-a22d68788fc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:37.982629 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4b0c0-6c0a-4db9-8e2c-a22d68788fc5 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:37.997210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1097/2199] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:26:38.203694 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbf205-b3de-444c-a0c8-5d2b6a361372 service cinder] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:38.217646 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbf205-b3de-444c-a0c8-5d2b6a361372 service cinder] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:38.222350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1396927-2dde-4b06-8b95-8e55c04d9667 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:38.223326 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1396927-2dde-4b06-8b95-8e55c04d9667 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:38.223492 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1396927-2dde-4b06-8b95-8e55c04d9667 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:38.223661 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1396927-2dde-4b06-8b95-8e55c04d9667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:38.297712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1396927-2dde-4b06-8b95-8e55c04d9667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:38.299656 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1396927-2dde-4b06-8b95-8e55c04d9667 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:38.314438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1103/2200] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:39.773617 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4b0c0-6c0a-4db9-8e2c-a22d68788fc5 service cinder] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:39.783218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4b0c0-6c0a-4db9-8e2c-a22d68788fc5 service cinder] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:39.788201 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60399d6b-791e-4215-a205-8ffe964cbe4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:39.789626 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60399d6b-791e-4215-a205-8ffe964cbe4d service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:39.789947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60399d6b-791e-4215-a205-8ffe964cbe4d service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:39.790483 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60399d6b-791e-4215-a205-8ffe964cbe4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:39.872378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60399d6b-791e-4215-a205-8ffe964cbe4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:39.874335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60399d6b-791e-4215-a205-8ffe964cbe4d service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:39.901781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1098/2201] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:40.980358 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1396927-2dde-4b06-8b95-8e55c04d9667 service cinder] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:40.994187 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1396927-2dde-4b06-8b95-8e55c04d9667 service cinder] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:40.998448 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623fe03-a532-4c61-8660-ab73415ff88e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:40.999391 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623fe03-a532-4c61-8660-ab73415ff88e service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:40.999880 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623fe03-a532-4c61-8660-ab73415ff88e service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:41.000405 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623fe03-a532-4c61-8660-ab73415ff88e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:41.112640 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623fe03-a532-4c61-8660-ab73415ff88e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:41.114677 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623fe03-a532-4c61-8660-ab73415ff88e service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:41.127145 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1104/2202] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:42.173205 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dc25d-e98c-4910-9697-90558a31de74 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:42.173690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dc25d-e98c-4910-9697-90558a31de74 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:42.174049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dc25d-e98c-4910-9697-90558a31de74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:42.204004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-b21dc25d-e98c-4910-9697-90558a31de74 None None] MFA Rules not processed for user `6dfbf496174e4138bfac5e1b925a0b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:42.205278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-b21dc25d-e98c-4910-9697-90558a31de74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:42.276074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1099/2203] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:42.280683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623fe03-a532-4c61-8660-ab73415ff88e service cinder] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:42.345821 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623fe03-a532-4c61-8660-ab73415ff88e service cinder] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:42.352837 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b76a7-7c35-4b3d-98b5-52accd8dfcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:42.353786 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b76a7-7c35-4b3d-98b5-52accd8dfcee admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:42.354221 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b76a7-7c35-4b3d-98b5-52accd8dfcee admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:42.354518 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b76a7-7c35-4b3d-98b5-52accd8dfcee admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:42.355378 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b76a7-7c35-4b3d-98b5-52accd8dfcee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:42.357508 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b76a7-7c35-4b3d-98b5-52accd8dfcee admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:42.391664 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1105/2204] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:42 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:42.396741 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dc25d-e98c-4910-9697-90558a31de74 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:42.408943 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dc25d-e98c-4910-9697-90558a31de74 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:42.470717 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879409d5-83d1-42ea-8a38-63fa0e06333a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:42.471397 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879409d5-83d1-42ea-8a38-63fa0e06333a admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:42.471682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879409d5-83d1-42ea-8a38-63fa0e06333a admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:42.471961 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879409d5-83d1-42ea-8a38-63fa0e06333a admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:42.472808 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879409d5-83d1-42ea-8a38-63fa0e06333a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:42.474746 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879409d5-83d1-42ea-8a38-63fa0e06333a admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:42.494973 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1100/2205] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:42 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:42.498669 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b76a7-7c35-4b3d-98b5-52accd8dfcee admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:42.509989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b76a7-7c35-4b3d-98b5-52accd8dfcee admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:42.515350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875a337-723a-470c-8ff4-28242047402f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:42.516037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875a337-723a-470c-8ff4-28242047402f admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:42.516422 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875a337-723a-470c-8ff4-28242047402f admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:42.516700 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875a337-723a-470c-8ff4-28242047402f admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:42.517539 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875a337-723a-470c-8ff4-28242047402f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:42.520374 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875a337-723a-470c-8ff4-28242047402f admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:42.532012 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1106/2206] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:26:42.536800 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879409d5-83d1-42ea-8a38-63fa0e06333a admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:42.547125 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879409d5-83d1-42ea-8a38-63fa0e06333a admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:42.553420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef0229-26d6-40e6-b146-ce4ba781f8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:42.554564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef0229-26d6-40e6-b146-ce4ba781f8e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:42.555032 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef0229-26d6-40e6-b146-ce4ba781f8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:42.555517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef0229-26d6-40e6-b146-ce4ba781f8e4 admin admin] PATH_INFO: `/v3/projects/e1fa8a2b2f064a62939e0a1c4a34f7cb/users/d9206adf107f4b9580b5b8ee7f18505f/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:42.573031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef0229-26d6-40e6-b146-ce4ba781f8e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1fa8a2b2f064a62939e0a1c4a34f7cb, user_id=d9206adf107f4b9580b5b8ee7f18505f, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:42.575983 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef0229-26d6-40e6-b146-ce4ba781f8e4 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:42.591511 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1101/2207] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:42 2022] PUT /identity/v3/projects/e1fa8a2b2f064a62939e0a1c4a34f7cb/users/d9206adf107f4b9580b5b8ee7f18505f/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:42.595480 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875a337-723a-470c-8ff4-28242047402f admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:42.612583 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875a337-723a-470c-8ff4-28242047402f admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:42.677161 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0da55f-55ae-4119-ac26-9fb66ba75634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:42.677854 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0da55f-55ae-4119-ac26-9fb66ba75634 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:42.678119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0da55f-55ae-4119-ac26-9fb66ba75634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:42.678384 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0da55f-55ae-4119-ac26-9fb66ba75634 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:42.679106 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0da55f-55ae-4119-ac26-9fb66ba75634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:42.681082 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0da55f-55ae-4119-ac26-9fb66ba75634 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:42.698652 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1107/2208] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:42.699784 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef0229-26d6-40e6-b146-ce4ba781f8e4 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:42.711793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef0229-26d6-40e6-b146-ce4ba781f8e4 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:42.716731 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f833d-f63e-4e2d-b05c-663b8d018059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:42.717620 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f833d-f63e-4e2d-b05c-663b8d018059 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:42.717902 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f833d-f63e-4e2d-b05c-663b8d018059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:42.718197 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f833d-f63e-4e2d-b05c-663b8d018059 admin admin] PATH_INFO: `/v3/projects/e1fa8a2b2f064a62939e0a1c4a34f7cb/users/d9206adf107f4b9580b5b8ee7f18505f/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:42.720280 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f833d-f63e-4e2d-b05c-663b8d018059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1fa8a2b2f064a62939e0a1c4a34f7cb, user_id=d9206adf107f4b9580b5b8ee7f18505f, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:42.723064 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f833d-f63e-4e2d-b05c-663b8d018059 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:42.734337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1102/2209] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:42 2022] PUT /identity/v3/projects/e1fa8a2b2f064a62939e0a1c4a34f7cb/users/d9206adf107f4b9580b5b8ee7f18505f/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:47.950956 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f40aeb-d80b-4764-b4b4-e14dc8ae3277 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:47.951434 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f40aeb-d80b-4764-b4b4-e14dc8ae3277 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:47.951668 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f40aeb-d80b-4764-b4b4-e14dc8ae3277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:47.986018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-e9f40aeb-d80b-4764-b4b4-e14dc8ae3277 None None] MFA Rules not processed for user `d9206adf107f4b9580b5b8ee7f18505f`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:47.987369 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-e9f40aeb-d80b-4764-b4b4-e14dc8ae3277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:48.067170 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1108/2210] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:48.080719 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f833d-f63e-4e2d-b05c-663b8d018059 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:48.082573 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-421f833d-f63e-4e2d-b05c-663b8d018059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:48.161199 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f833d-f63e-4e2d-b05c-663b8d018059 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:48.166704 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fefd3a-1b64-4b56-9590-0bf0dc8c15ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:48.167360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fefd3a-1b64-4b56-9590-0bf0dc8c15ba service nova] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:48.167642 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fefd3a-1b64-4b56-9590-0bf0dc8c15ba service nova] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:48.167918 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fefd3a-1b64-4b56-9590-0bf0dc8c15ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:48.223746 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fefd3a-1b64-4b56-9590-0bf0dc8c15ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:48.225376 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fefd3a-1b64-4b56-9590-0bf0dc8c15ba service nova] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:48.234238 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1103/2211] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:51.716593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f40aeb-d80b-4764-b4b4-e14dc8ae3277 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:51.800006 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f40aeb-d80b-4764-b4b4-e14dc8ae3277 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:51.804889 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce869ba-e1e6-45a4-9236-34c9fc19098e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:51.805986 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce869ba-e1e6-45a4-9236-34c9fc19098e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:51.806261 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce869ba-e1e6-45a4-9236-34c9fc19098e admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:51.806729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce869ba-e1e6-45a4-9236-34c9fc19098e admin admin] PATH_INFO: `/v3/users/065e77b8c4df4016bd499fd80ac7eb66` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:51.807970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce869ba-e1e6-45a4-9236-34c9fc19098e admin admin] RBAC: Authorizing `identity:delete_user(user_id=065e77b8c4df4016bd499fd80ac7eb66)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:51.810305 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce869ba-e1e6-45a4-9236-34c9fc19098e admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:51.860873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-cce869ba-e1e6-45a4-9236-34c9fc19098e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '065e77b8c4df4016bd499fd80ac7eb66'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:51.862020 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-cce869ba-e1e6-45a4-9236-34c9fc19098e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '065e77b8c4df4016bd499fd80ac7eb66'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:51.870446 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-cce869ba-e1e6-45a4-9236-34c9fc19098e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '065e77b8c4df4016bd499fd80ac7eb66'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:51.881397 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-cce869ba-e1e6-45a4-9236-34c9fc19098e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '065e77b8c4df4016bd499fd80ac7eb66'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:51.895200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-cce869ba-e1e6-45a4-9236-34c9fc19098e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '065e77b8c4df4016bd499fd80ac7eb66'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:51.904675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1109/2212] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:51 2022] DELETE /identity/v3/users/065e77b8c4df4016bd499fd80ac7eb66 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:51.909936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fcf8d-8269-4d1c-9b8a-6016172c753d None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:51.910811 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fcf8d-8269-4d1c-9b8a-6016172c753d None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:51.910811 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fcf8d-8269-4d1c-9b8a-6016172c753d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:51.941529 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-670fcf8d-8269-4d1c-9b8a-6016172c753d None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:51.946757 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-670fcf8d-8269-4d1c-9b8a-6016172c753d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:52.027610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1104/2213] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:52.039048 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce869ba-e1e6-45a4-9236-34c9fc19098e admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:52.040568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-cce869ba-e1e6-45a4-9236-34c9fc19098e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:52.121030 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce869ba-e1e6-45a4-9236-34c9fc19098e admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:52.126457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fa39d-71fd-4117-b152-65e97abe630a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:52.127357 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fa39d-71fd-4117-b152-65e97abe630a service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:52.127731 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fa39d-71fd-4117-b152-65e97abe630a service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:52.128567 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fa39d-71fd-4117-b152-65e97abe630a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:52.143075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725fa39d-71fd-4117-b152-65e97abe630a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:52.144899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725fa39d-71fd-4117-b152-65e97abe630a service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:52.157678 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fcf8d-8269-4d1c-9b8a-6016172c753d None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:52.158545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1110/2214] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:52.159048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-670fcf8d-8269-4d1c-9b8a-6016172c753d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:52.170872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fcf8d-8269-4d1c-9b8a-6016172c753d None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:52.175606 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02040c-1bbc-4124-ad7a-aef89dc8c091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:52.176944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02040c-1bbc-4124-ad7a-aef89dc8c091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:52.177218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02040c-1bbc-4124-ad7a-aef89dc8c091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:52.177636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02040c-1bbc-4124-ad7a-aef89dc8c091 admin admin] PATH_INFO: `/v3/users/b2b4de595d424c8284614782ab97c08e` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:52.178927 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02040c-1bbc-4124-ad7a-aef89dc8c091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2b4de595d424c8284614782ab97c08e)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:52.180975 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02040c-1bbc-4124-ad7a-aef89dc8c091 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:52.248957 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-ec02040c-1bbc-4124-ad7a-aef89dc8c091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2b4de595d424c8284614782ab97c08e'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:52.274538 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-ec02040c-1bbc-4124-ad7a-aef89dc8c091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2b4de595d424c8284614782ab97c08e'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:52.284051 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-ec02040c-1bbc-4124-ad7a-aef89dc8c091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2b4de595d424c8284614782ab97c08e'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:52.284977 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-ec02040c-1bbc-4124-ad7a-aef89dc8c091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2b4de595d424c8284614782ab97c08e'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:52.294500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-ec02040c-1bbc-4124-ad7a-aef89dc8c091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2b4de595d424c8284614782ab97c08e'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:52.302952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1105/2215] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:52 2022] DELETE /identity/v3/users/b2b4de595d424c8284614782ab97c08e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:26:52.307078 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70def1-0582-49af-a1db-353f0df9ed79 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:52.307362 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70def1-0582-49af-a1db-353f0df9ed79 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:52.307632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70def1-0582-49af-a1db-353f0df9ed79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:52.326546 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-0c70def1-0582-49af-a1db-353f0df9ed79 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:52.327754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-0c70def1-0582-49af-a1db-353f0df9ed79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:52.394670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1111/2216] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:52.416132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02040c-1bbc-4124-ad7a-aef89dc8c091 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:52.417727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-ec02040c-1bbc-4124-ad7a-aef89dc8c091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:52.484605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02040c-1bbc-4124-ad7a-aef89dc8c091 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:52.488402 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23279137-7c04-4208-b783-198a855f3ffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:52.489086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23279137-7c04-4208-b783-198a855f3ffb service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:52.489498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23279137-7c04-4208-b783-198a855f3ffb service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:52.489772 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23279137-7c04-4208-b783-198a855f3ffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:52.501003 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23279137-7c04-4208-b783-198a855f3ffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:52.502704 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23279137-7c04-4208-b783-198a855f3ffb service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:52.515593 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1106/2217] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:52.540900 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70def1-0582-49af-a1db-353f0df9ed79 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:52.545110 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-0c70def1-0582-49af-a1db-353f0df9ed79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:52.570762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70def1-0582-49af-a1db-353f0df9ed79 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:52.582746 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950821b-7996-44f3-8d01-593995cf09e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:52.583733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950821b-7996-44f3-8d01-593995cf09e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:52.584045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950821b-7996-44f3-8d01-593995cf09e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:52.584319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950821b-7996-44f3-8d01-593995cf09e8 admin admin] PATH_INFO: `/v3/projects/08178a0fd39e4c07806097319a9f5d66` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:52.588245 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950821b-7996-44f3-8d01-593995cf09e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08178a0fd39e4c07806097319a9f5d66)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:52.593930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950821b-7996-44f3-8d01-593995cf09e8 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:52.679239 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-3950821b-7996-44f3-8d01-593995cf09e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08178a0fd39e4c07806097319a9f5d66', 'request_id': 'req-3950821b-7996-44f3-8d01-593995cf09e8'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:52.700665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-3950821b-7996-44f3-8d01-593995cf09e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08178a0fd39e4c07806097319a9f5d66', 'request_id': 'req-3950821b-7996-44f3-8d01-593995cf09e8'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:52.717534 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-3950821b-7996-44f3-8d01-593995cf09e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08178a0fd39e4c07806097319a9f5d66', 'request_id': 'req-3950821b-7996-44f3-8d01-593995cf09e8'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:52.730928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-3950821b-7996-44f3-8d01-593995cf09e8 admin admin] The token cache is being invalidate because project 08178a0fd39e4c07806097319a9f5d66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:52.731508 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-3950821b-7996-44f3-8d01-593995cf09e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:52.732375 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-3950821b-7996-44f3-8d01-593995cf09e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:52.734063 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1112/2218] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:52 2022] DELETE /identity/v3/projects/08178a0fd39e4c07806097319a9f5d66 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:52.738201 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23279137-7c04-4208-b783-198a855f3ffb service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:52.750230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23279137-7c04-4208-b783-198a855f3ffb service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:52.849448 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992728a-1dc9-4f92-9764-d8153b04fea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:52.850733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992728a-1dc9-4f92-9764-d8153b04fea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:52.854276 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992728a-1dc9-4f92-9764-d8153b04fea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:52.854991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992728a-1dc9-4f92-9764-d8153b04fea3 admin admin] PATH_INFO: `/v3/users/f34d66aaaff64632868610b5bd4e783f` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:52.856951 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992728a-1dc9-4f92-9764-d8153b04fea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f34d66aaaff64632868610b5bd4e783f)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:52.861366 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992728a-1dc9-4f92-9764-d8153b04fea3 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:52.935690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0992728a-1dc9-4f92-9764-d8153b04fea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f34d66aaaff64632868610b5bd4e783f'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:52.957387 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0992728a-1dc9-4f92-9764-d8153b04fea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f34d66aaaff64632868610b5bd4e783f'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:52.967033 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0992728a-1dc9-4f92-9764-d8153b04fea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f34d66aaaff64632868610b5bd4e783f'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:52.968453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0992728a-1dc9-4f92-9764-d8153b04fea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f34d66aaaff64632868610b5bd4e783f'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:52.987565 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0992728a-1dc9-4f92-9764-d8153b04fea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f34d66aaaff64632868610b5bd4e783f'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:52.995275 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1107/2219] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:52 2022] DELETE /identity/v3/users/f34d66aaaff64632868610b5bd4e783f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:53.159069 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950821b-7996-44f3-8d01-593995cf09e8 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:53.160684 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-3950821b-7996-44f3-8d01-593995cf09e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:53.180769 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950821b-7996-44f3-8d01-593995cf09e8 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:53.404008 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec3c43-7c24-4e7f-8dad-b2c77653f4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:53.405333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec3c43-7c24-4e7f-8dad-b2c77653f4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:53.405632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec3c43-7c24-4e7f-8dad-b2c77653f4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:53.406162 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec3c43-7c24-4e7f-8dad-b2c77653f4e0 admin admin] PATH_INFO: `/v3/projects/3629fc9226c34f9e95e2b75db2f326bb` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:53.407938 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec3c43-7c24-4e7f-8dad-b2c77653f4e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3629fc9226c34f9e95e2b75db2f326bb)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:53.411233 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec3c43-7c24-4e7f-8dad-b2c77653f4e0 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:53.461141 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992728a-1dc9-4f92-9764-d8153b04fea3 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:53.462696 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-0992728a-1dc9-4f92-9764-d8153b04fea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:53.479064 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992728a-1dc9-4f92-9764-d8153b04fea3 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:53.484301 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ede852-1576-4571-8ae9-c11b290dc8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:53.485183 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ede852-1576-4571-8ae9-c11b290dc8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:53.485468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ede852-1576-4571-8ae9-c11b290dc8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:53.485749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ede852-1576-4571-8ae9-c11b290dc8b3 admin admin] PATH_INFO: `/v3/projects/d983bcbcc0dc4907a48116d4b5ba756d` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:53.486962 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ede852-1576-4571-8ae9-c11b290dc8b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d983bcbcc0dc4907a48116d4b5ba756d)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:53.489106 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ede852-1576-4571-8ae9-c11b290dc8b3 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:53.523019 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-63ec3c43-7c24-4e7f-8dad-b2c77653f4e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3629fc9226c34f9e95e2b75db2f326bb', 'request_id': 'req-63ec3c43-7c24-4e7f-8dad-b2c77653f4e0'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:53.533156 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-63ec3c43-7c24-4e7f-8dad-b2c77653f4e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3629fc9226c34f9e95e2b75db2f326bb', 'request_id': 'req-63ec3c43-7c24-4e7f-8dad-b2c77653f4e0'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:53.541160 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-63ec3c43-7c24-4e7f-8dad-b2c77653f4e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3629fc9226c34f9e95e2b75db2f326bb', 'request_id': 'req-63ec3c43-7c24-4e7f-8dad-b2c77653f4e0'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:53.545297 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d5ede852-1576-4571-8ae9-c11b290dc8b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd983bcbcc0dc4907a48116d4b5ba756d', 'request_id': 'req-d5ede852-1576-4571-8ae9-c11b290dc8b3'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:53.551163 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d5ede852-1576-4571-8ae9-c11b290dc8b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd983bcbcc0dc4907a48116d4b5ba756d', 'request_id': 'req-d5ede852-1576-4571-8ae9-c11b290dc8b3'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:53.553176 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-63ec3c43-7c24-4e7f-8dad-b2c77653f4e0 admin admin] The token cache is being invalidate because project 3629fc9226c34f9e95e2b75db2f326bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:53.553573 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-63ec3c43-7c24-4e7f-8dad-b2c77653f4e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:53.554414 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-63ec3c43-7c24-4e7f-8dad-b2c77653f4e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:53.556512 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1113/2220] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:53 2022] DELETE /identity/v3/projects/3629fc9226c34f9e95e2b75db2f326bb => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:53.561086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d5ede852-1576-4571-8ae9-c11b290dc8b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd983bcbcc0dc4907a48116d4b5ba756d', 'request_id': 'req-d5ede852-1576-4571-8ae9-c11b290dc8b3'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:53.561512 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac13b27-13f5-4e16-a9a4-bff6394463f1 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:53.561941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac13b27-13f5-4e16-a9a4-bff6394463f1 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:53.562220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac13b27-13f5-4e16-a9a4-bff6394463f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:53.575960 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d5ede852-1576-4571-8ae9-c11b290dc8b3 admin admin] The token cache is being invalidate because project d983bcbcc0dc4907a48116d4b5ba756d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:53.576290 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d5ede852-1576-4571-8ae9-c11b290dc8b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:53.577031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d5ede852-1576-4571-8ae9-c11b290dc8b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:53.578696 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1108/2221] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:53 2022] DELETE /identity/v3/projects/d983bcbcc0dc4907a48116d4b5ba756d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:53.581955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-7ac13b27-13f5-4e16-a9a4-bff6394463f1 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:53.582577 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ede852-1576-4571-8ae9-c11b290dc8b3 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:53.583228 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-7ac13b27-13f5-4e16-a9a4-bff6394463f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:53.584191 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-d5ede852-1576-4571-8ae9-c11b290dc8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:53.647689 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1114/2222] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:53.655206 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ede852-1576-4571-8ae9-c11b290dc8b3 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:53.655493 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb5df4-1fd9-4c5a-8620-c8e0b1808a64 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:53.655777 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb5df4-1fd9-4c5a-8620-c8e0b1808a64 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:53.656048 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb5df4-1fd9-4c5a-8620-c8e0b1808a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:53.660104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81569367-6c60-480f-b124-2703e71df959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:53.661574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81569367-6c60-480f-b124-2703e71df959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:53.661786 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81569367-6c60-480f-b124-2703e71df959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:53.662314 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81569367-6c60-480f-b124-2703e71df959 admin admin] PATH_INFO: `/v3/users/04b83356eff84d7fb352c2870267250f` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:53.663828 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81569367-6c60-480f-b124-2703e71df959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04b83356eff84d7fb352c2870267250f)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:53.665925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81569367-6c60-480f-b124-2703e71df959 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:53.675821 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-59fb5df4-1fd9-4c5a-8620-c8e0b1808a64 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:53.677850 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-59fb5df4-1fd9-4c5a-8620-c8e0b1808a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:53.686529 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1115/2223] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:26:53.690826 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb5df4-1fd9-4c5a-8620-c8e0b1808a64 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:53.702371 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb5df4-1fd9-4c5a-8620-c8e0b1808a64 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:53.707581 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03313ab-a091-4525-a32e-43fdcd867bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:53.708422 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03313ab-a091-4525-a32e-43fdcd867bba admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:53.708704 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03313ab-a091-4525-a32e-43fdcd867bba admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:53.708977 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03313ab-a091-4525-a32e-43fdcd867bba admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:53.709685 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03313ab-a091-4525-a32e-43fdcd867bba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:53.709986 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03313ab-a091-4525-a32e-43fdcd867bba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:53.711672 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03313ab-a091-4525-a32e-43fdcd867bba admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:53.717353 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-81569367-6c60-480f-b124-2703e71df959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04b83356eff84d7fb352c2870267250f'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:53.723374 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1116/2224] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:26:53.728545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03313ab-a091-4525-a32e-43fdcd867bba admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:53.729732 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-81569367-6c60-480f-b124-2703e71df959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04b83356eff84d7fb352c2870267250f'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:53.736332 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-81569367-6c60-480f-b124-2703e71df959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04b83356eff84d7fb352c2870267250f'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:53.737052 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-81569367-6c60-480f-b124-2703e71df959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04b83356eff84d7fb352c2870267250f'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:53.737941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03313ab-a091-4525-a32e-43fdcd867bba admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:53.744068 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11bcdd5-7797-4555-9d71-b7d981c23244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:53.744740 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11bcdd5-7797-4555-9d71-b7d981c23244 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:53.745061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11bcdd5-7797-4555-9d71-b7d981c23244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:53.745272 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-81569367-6c60-480f-b124-2703e71df959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04b83356eff84d7fb352c2870267250f'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:53.745397 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11bcdd5-7797-4555-9d71-b7d981c23244 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:53.746113 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11bcdd5-7797-4555-9d71-b7d981c23244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:53.748076 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11bcdd5-7797-4555-9d71-b7d981c23244 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:53.751303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1109/2225] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:53 2022] DELETE /identity/v3/users/04b83356eff84d7fb352c2870267250f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:26:53.777933 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1117/2226] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:53 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:26:53.782254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81569367-6c60-480f-b124-2703e71df959 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:53.784037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-81569367-6c60-480f-b124-2703e71df959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:53.858854 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81569367-6c60-480f-b124-2703e71df959 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:53.925789 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be097ef-f064-446c-8f01-1cc0f13e5150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:53.926472 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be097ef-f064-446c-8f01-1cc0f13e5150 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:53.927604 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be097ef-f064-446c-8f01-1cc0f13e5150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:53.927892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be097ef-f064-446c-8f01-1cc0f13e5150 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:53.928636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be097ef-f064-446c-8f01-1cc0f13e5150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:53.930572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be097ef-f064-446c-8f01-1cc0f13e5150 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:53.954925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1110/2227] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:53 2022] POST /identity/v3/users => generated 296 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:53.956906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11bcdd5-7797-4555-9d71-b7d981c23244 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:53.967482 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11bcdd5-7797-4555-9d71-b7d981c23244 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:53.972579 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f893e26-a821-4ba9-af3d-ef81b4b02c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:53.973237 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f893e26-a821-4ba9-af3d-ef81b4b02c2a admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:53.973523 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f893e26-a821-4ba9-af3d-ef81b4b02c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:53.973804 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f893e26-a821-4ba9-af3d-ef81b4b02c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:53.974529 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f893e26-a821-4ba9-af3d-ef81b4b02c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:53.976123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f893e26-a821-4ba9-af3d-ef81b4b02c2a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:53.990940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1118/2228] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:53.994344 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be097ef-f064-446c-8f01-1cc0f13e5150 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:54.014299 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be097ef-f064-446c-8f01-1cc0f13e5150 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:54.019977 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c424cfa-36c0-41ea-a57b-09b34b89932a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:54.021434 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c424cfa-36c0-41ea-a57b-09b34b89932a admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:54.022245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c424cfa-36c0-41ea-a57b-09b34b89932a admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:54.022408 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c424cfa-36c0-41ea-a57b-09b34b89932a admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:54.023350 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c424cfa-36c0-41ea-a57b-09b34b89932a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:54.025210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c424cfa-36c0-41ea-a57b-09b34b89932a admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:54.037855 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1111/2229] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:54.041641 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f893e26-a821-4ba9-af3d-ef81b4b02c2a admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:54.048342 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c424cfa-36c0-41ea-a57b-09b34b89932a admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:54.050097 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-8c424cfa-36c0-41ea-a57b-09b34b89932a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:54.053181 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f893e26-a821-4ba9-af3d-ef81b4b02c2a admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:54.065444 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c424cfa-36c0-41ea-a57b-09b34b89932a admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:54.066612 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922808d6-92ec-415b-888b-b3ffbe48218a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:54.068261 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922808d6-92ec-415b-888b-b3ffbe48218a admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:54.069026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922808d6-92ec-415b-888b-b3ffbe48218a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:54.069381 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922808d6-92ec-415b-888b-b3ffbe48218a admin admin] PATH_INFO: `/v3/projects/39aa20c1c2b24565b55df64b888b05d1/users/09ecc7bd55024032937c75646bd0aec6/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:54.086035 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d5439-db2a-4bd2-a51f-39b850f46cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:54.087795 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d5439-db2a-4bd2-a51f-39b850f46cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:54.088262 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d5439-db2a-4bd2-a51f-39b850f46cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:54.088684 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d5439-db2a-4bd2-a51f-39b850f46cc0 admin admin] PATH_INFO: `/v3/projects/cb54d6572883414e8f3d1a5aed47ea41` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:54.090875 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d5439-db2a-4bd2-a51f-39b850f46cc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb54d6572883414e8f3d1a5aed47ea41)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:54.095230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d5439-db2a-4bd2-a51f-39b850f46cc0 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:54.099086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922808d6-92ec-415b-888b-b3ffbe48218a admin admin] RBAC: Authorizing `identity:create_grant(project_id=39aa20c1c2b24565b55df64b888b05d1, user_id=09ecc7bd55024032937c75646bd0aec6, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:54.102173 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922808d6-92ec-415b-888b-b3ffbe48218a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:54.126554 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1119/2230] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:54 2022] PUT /identity/v3/projects/39aa20c1c2b24565b55df64b888b05d1/users/09ecc7bd55024032937c75646bd0aec6/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:54.137384 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262af1a7-e001-44d4-9165-07c7024099dd None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:54.137668 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262af1a7-e001-44d4-9165-07c7024099dd None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:54.137944 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262af1a7-e001-44d4-9165-07c7024099dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:54.167128 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-262af1a7-e001-44d4-9165-07c7024099dd None None] MFA Rules not processed for user `09ecc7bd55024032937c75646bd0aec6`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:54.168368 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-262af1a7-e001-44d4-9165-07c7024099dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:54.180349 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f42d5439-db2a-4bd2-a51f-39b850f46cc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb54d6572883414e8f3d1a5aed47ea41', 'request_id': 'req-f42d5439-db2a-4bd2-a51f-39b850f46cc0'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:54.186946 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f42d5439-db2a-4bd2-a51f-39b850f46cc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb54d6572883414e8f3d1a5aed47ea41', 'request_id': 'req-f42d5439-db2a-4bd2-a51f-39b850f46cc0'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:54.199402 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f42d5439-db2a-4bd2-a51f-39b850f46cc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb54d6572883414e8f3d1a5aed47ea41', 'request_id': 'req-f42d5439-db2a-4bd2-a51f-39b850f46cc0'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:54.213894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f42d5439-db2a-4bd2-a51f-39b850f46cc0 admin admin] The token cache is being invalidate because project cb54d6572883414e8f3d1a5aed47ea41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:54.214187 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f42d5439-db2a-4bd2-a51f-39b850f46cc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:54.214876 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f42d5439-db2a-4bd2-a51f-39b850f46cc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:54.216534 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1112/2231] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:54 2022] DELETE /identity/v3/projects/cb54d6572883414e8f3d1a5aed47ea41 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:54.217624 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d5439-db2a-4bd2-a51f-39b850f46cc0 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:54.219165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f42d5439-db2a-4bd2-a51f-39b850f46cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:54.299228 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d5439-db2a-4bd2-a51f-39b850f46cc0 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:54.307364 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56156f57-fdaa-45ba-8a68-4214bb1a8d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:54.308746 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56156f57-fdaa-45ba-8a68-4214bb1a8d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:54.309304 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56156f57-fdaa-45ba-8a68-4214bb1a8d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:54.309790 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56156f57-fdaa-45ba-8a68-4214bb1a8d51 admin admin] PATH_INFO: `/v3/users/c92a425dd6ad440aa6f980568756dd59` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:54.311422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56156f57-fdaa-45ba-8a68-4214bb1a8d51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c92a425dd6ad440aa6f980568756dd59)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:54.313779 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56156f57-fdaa-45ba-8a68-4214bb1a8d51 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:54.331666 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1120/2232] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:26:54.337666 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262af1a7-e001-44d4-9165-07c7024099dd None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:54.339392 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-262af1a7-e001-44d4-9165-07c7024099dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:54.396944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-56156f57-fdaa-45ba-8a68-4214bb1a8d51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c92a425dd6ad440aa6f980568756dd59'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:54.415525 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-56156f57-fdaa-45ba-8a68-4214bb1a8d51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c92a425dd6ad440aa6f980568756dd59'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:54.427168 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-56156f57-fdaa-45ba-8a68-4214bb1a8d51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c92a425dd6ad440aa6f980568756dd59'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:54.428117 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-56156f57-fdaa-45ba-8a68-4214bb1a8d51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c92a425dd6ad440aa6f980568756dd59'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:54.440776 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-56156f57-fdaa-45ba-8a68-4214bb1a8d51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c92a425dd6ad440aa6f980568756dd59'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:54.449729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262af1a7-e001-44d4-9165-07c7024099dd None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:54.453644 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757c073-308b-438b-96c0-7be2b2598578 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:54.454297 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757c073-308b-438b-96c0-7be2b2598578 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:54.454573 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757c073-308b-438b-96c0-7be2b2598578 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:54.454965 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757c073-308b-438b-96c0-7be2b2598578 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:54.457595 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f757c073-308b-438b-96c0-7be2b2598578 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:54.458563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1113/2233] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:54 2022] DELETE /identity/v3/users/c92a425dd6ad440aa6f980568756dd59 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:54.460400 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4266728-fda2-4e72-a528-80e3d6cd12d8 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:54.460845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4266728-fda2-4e72-a528-80e3d6cd12d8 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:54.461360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4266728-fda2-4e72-a528-80e3d6cd12d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:54.474292 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757c073-308b-438b-96c0-7be2b2598578 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:54.476029 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757c073-308b-438b-96c0-7be2b2598578 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:54.484199 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-b4266728-fda2-4e72-a528-80e3d6cd12d8 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:54.485525 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-b4266728-fda2-4e72-a528-80e3d6cd12d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:54.486460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1121/2234] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:26:54.547417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1114/2235] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:54.557955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757c073-308b-438b-96c0-7be2b2598578 service cinder] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:54.559350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f757c073-308b-438b-96c0-7be2b2598578 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:54.618821 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757c073-308b-438b-96c0-7be2b2598578 service cinder] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:54.669289 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04557455-a494-4bd8-8687-93bb70f24b56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:54.669931 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04557455-a494-4bd8-8687-93bb70f24b56 service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:54.670213 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04557455-a494-4bd8-8687-93bb70f24b56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:54.670481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04557455-a494-4bd8-8687-93bb70f24b56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:54.686347 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04557455-a494-4bd8-8687-93bb70f24b56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:54.687809 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04557455-a494-4bd8-8687-93bb70f24b56 service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:54.699778 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1122/2236] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:54.989791 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4266728-fda2-4e72-a528-80e3d6cd12d8 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:54.992010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-b4266728-fda2-4e72-a528-80e3d6cd12d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:55.006655 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4266728-fda2-4e72-a528-80e3d6cd12d8 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:55.011414 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e57004-d264-42e8-959a-0feb41a3339c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:55.012317 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e57004-d264-42e8-959a-0feb41a3339c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:55.012605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e57004-d264-42e8-959a-0feb41a3339c admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:55.012884 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e57004-d264-42e8-959a-0feb41a3339c admin admin] PATH_INFO: `/v3/projects/9034b98d6f0e4e1e8b71b29926b7fdc9` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:55.014200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e57004-d264-42e8-959a-0feb41a3339c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9034b98d6f0e4e1e8b71b29926b7fdc9)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:55.016650 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e57004-d264-42e8-959a-0feb41a3339c admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:55.064491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-86e57004-d264-42e8-959a-0feb41a3339c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9034b98d6f0e4e1e8b71b29926b7fdc9', 'request_id': 'req-86e57004-d264-42e8-959a-0feb41a3339c'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:55.070873 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-86e57004-d264-42e8-959a-0feb41a3339c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9034b98d6f0e4e1e8b71b29926b7fdc9', 'request_id': 'req-86e57004-d264-42e8-959a-0feb41a3339c'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:55.078132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-86e57004-d264-42e8-959a-0feb41a3339c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9034b98d6f0e4e1e8b71b29926b7fdc9', 'request_id': 'req-86e57004-d264-42e8-959a-0feb41a3339c'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:55.089259 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-86e57004-d264-42e8-959a-0feb41a3339c admin admin] The token cache is being invalidate because project 9034b98d6f0e4e1e8b71b29926b7fdc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:55.089548 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-86e57004-d264-42e8-959a-0feb41a3339c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:55.090182 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-86e57004-d264-42e8-959a-0feb41a3339c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:55.091751 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1115/2237] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:54 2022] DELETE /identity/v3/projects/9034b98d6f0e4e1e8b71b29926b7fdc9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:55.095836 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04557455-a494-4bd8-8687-93bb70f24b56 service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:55.105537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04557455-a494-4bd8-8687-93bb70f24b56 service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:55.162428 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c23129-0d26-40e1-82b3-7e8fe18656bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:55.163300 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c23129-0d26-40e1-82b3-7e8fe18656bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:55.164302 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c23129-0d26-40e1-82b3-7e8fe18656bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:55.164586 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c23129-0d26-40e1-82b3-7e8fe18656bc admin admin] PATH_INFO: `/v3/users/f4c4390178ba46d68eecfb43a52e1e78` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:55.165923 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c23129-0d26-40e1-82b3-7e8fe18656bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4c4390178ba46d68eecfb43a52e1e78)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:55.167864 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c23129-0d26-40e1-82b3-7e8fe18656bc admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:55.213401 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-12c23129-0d26-40e1-82b3-7e8fe18656bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4c4390178ba46d68eecfb43a52e1e78'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:55.214071 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-12c23129-0d26-40e1-82b3-7e8fe18656bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4c4390178ba46d68eecfb43a52e1e78'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:55.220653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-12c23129-0d26-40e1-82b3-7e8fe18656bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4c4390178ba46d68eecfb43a52e1e78'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:55.228459 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-12c23129-0d26-40e1-82b3-7e8fe18656bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4c4390178ba46d68eecfb43a52e1e78'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:55.242985 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-12c23129-0d26-40e1-82b3-7e8fe18656bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4c4390178ba46d68eecfb43a52e1e78'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:55.249083 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1123/2238] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:55 2022] DELETE /identity/v3/users/f4c4390178ba46d68eecfb43a52e1e78 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:55.527230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e57004-d264-42e8-959a-0feb41a3339c admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:55.529043 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-86e57004-d264-42e8-959a-0feb41a3339c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:55.546354 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e57004-d264-42e8-959a-0feb41a3339c admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:55.605293 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d2692-968a-4823-8c1f-a369f6f3c6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:55.606154 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d2692-968a-4823-8c1f-a369f6f3c6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:55.606457 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d2692-968a-4823-8c1f-a369f6f3c6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:55.606731 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d2692-968a-4823-8c1f-a369f6f3c6fc admin admin] PATH_INFO: `/v3/projects/878fabb3633e429b85611f10473574fd` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:55.607903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d2692-968a-4823-8c1f-a369f6f3c6fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=878fabb3633e429b85611f10473574fd)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:55.609852 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d2692-968a-4823-8c1f-a369f6f3c6fc admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:55.654532 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-636d2692-968a-4823-8c1f-a369f6f3c6fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '878fabb3633e429b85611f10473574fd', 'request_id': 'req-636d2692-968a-4823-8c1f-a369f6f3c6fc'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:55.659747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-636d2692-968a-4823-8c1f-a369f6f3c6fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '878fabb3633e429b85611f10473574fd', 'request_id': 'req-636d2692-968a-4823-8c1f-a369f6f3c6fc'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:55.667963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-636d2692-968a-4823-8c1f-a369f6f3c6fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '878fabb3633e429b85611f10473574fd', 'request_id': 'req-636d2692-968a-4823-8c1f-a369f6f3c6fc'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:55.678901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-636d2692-968a-4823-8c1f-a369f6f3c6fc admin admin] The token cache is being invalidate because project 878fabb3633e429b85611f10473574fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:55.679182 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-636d2692-968a-4823-8c1f-a369f6f3c6fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:55.679810 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-636d2692-968a-4823-8c1f-a369f6f3c6fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:55.681362 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1116/2239] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:55 2022] DELETE /identity/v3/projects/878fabb3633e429b85611f10473574fd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:55.686181 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c122a-55a3-4bb1-80fc-8966b1f6d281 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:55.686473 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c122a-55a3-4bb1-80fc-8966b1f6d281 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:55.686756 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c122a-55a3-4bb1-80fc-8966b1f6d281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:55.704973 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-745c122a-55a3-4bb1-80fc-8966b1f6d281 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:55.706284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-745c122a-55a3-4bb1-80fc-8966b1f6d281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:55.764692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1124/2240] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:55.773602 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cdb69-f019-46c4-9bc4-17c26bce10e0 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:55.773895 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cdb69-f019-46c4-9bc4-17c26bce10e0 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:55.774176 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cdb69-f019-46c4-9bc4-17c26bce10e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:55.793432 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-4c6cdb69-f019-46c4-9bc4-17c26bce10e0 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:55.794639 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-4c6cdb69-f019-46c4-9bc4-17c26bce10e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:55.802923 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1117/2241] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:55.807294 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c122a-55a3-4bb1-80fc-8966b1f6d281 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:55.817560 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c122a-55a3-4bb1-80fc-8966b1f6d281 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:55.822934 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb770346-2451-45ae-a2f6-23eab9128385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:55.823588 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb770346-2451-45ae-a2f6-23eab9128385 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:55.823873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb770346-2451-45ae-a2f6-23eab9128385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:55.824168 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb770346-2451-45ae-a2f6-23eab9128385 admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:55.824898 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb770346-2451-45ae-a2f6-23eab9128385 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:55.825206 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb770346-2451-45ae-a2f6-23eab9128385 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:55.826798 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb770346-2451-45ae-a2f6-23eab9128385 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:55.842554 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1125/2242] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:55.843738 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cdb69-f019-46c4-9bc4-17c26bce10e0 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:55.853868 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cdb69-f019-46c4-9bc4-17c26bce10e0 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:55.858510 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf01911-556a-4ce1-a159-bfc1cb1adf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:55.859160 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf01911-556a-4ce1-a159-bfc1cb1adf72 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:55.859440 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf01911-556a-4ce1-a159-bfc1cb1adf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:55.859716 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf01911-556a-4ce1-a159-bfc1cb1adf72 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:55.860433 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf01911-556a-4ce1-a159-bfc1cb1adf72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:55.862315 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf01911-556a-4ce1-a159-bfc1cb1adf72 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:55.888756 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1118/2243] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:55 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:55.893045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb770346-2451-45ae-a2f6-23eab9128385 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:55.905511 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb770346-2451-45ae-a2f6-23eab9128385 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:55.961662 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9909bb-2d8b-4b3d-82b7-fe3089d93c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:55.962406 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9909bb-2d8b-4b3d-82b7-fe3089d93c0f admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:55.962691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9909bb-2d8b-4b3d-82b7-fe3089d93c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:55.962969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9909bb-2d8b-4b3d-82b7-fe3089d93c0f admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:55.963653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9909bb-2d8b-4b3d-82b7-fe3089d93c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:55.965605 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9909bb-2d8b-4b3d-82b7-fe3089d93c0f admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:55.985290 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1126/2244] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:55 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:55.989433 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf01911-556a-4ce1-a159-bfc1cb1adf72 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:56.000005 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf01911-556a-4ce1-a159-bfc1cb1adf72 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:56.004541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7724d7-3a59-4246-8cf2-b28edc056d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:56.005685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7724d7-3a59-4246-8cf2-b28edc056d06 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:56.005981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7724d7-3a59-4246-8cf2-b28edc056d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:56.005981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7724d7-3a59-4246-8cf2-b28edc056d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:56.006933 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7724d7-3a59-4246-8cf2-b28edc056d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:56.008733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7724d7-3a59-4246-8cf2-b28edc056d06 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:56.019166 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1119/2245] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:56.023720 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9909bb-2d8b-4b3d-82b7-fe3089d93c0f admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:56.033551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9909bb-2d8b-4b3d-82b7-fe3089d93c0f admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:56.038239 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be94cc-331e-403a-8154-b3ba5785c41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:56.038884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be94cc-331e-403a-8154-b3ba5785c41f admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:56.039191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be94cc-331e-403a-8154-b3ba5785c41f admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:56.039464 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be94cc-331e-403a-8154-b3ba5785c41f admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:56.040201 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be94cc-331e-403a-8154-b3ba5785c41f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:56.041778 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be94cc-331e-403a-8154-b3ba5785c41f admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:56.051301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1127/2246] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:56.055401 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7724d7-3a59-4246-8cf2-b28edc056d06 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:56.065274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7724d7-3a59-4246-8cf2-b28edc056d06 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:56.070627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07c8c4-bdb9-4b30-b65d-4e4e6aae406b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:56.071495 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07c8c4-bdb9-4b30-b65d-4e4e6aae406b admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:56.071779 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07c8c4-bdb9-4b30-b65d-4e4e6aae406b admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:56.072055 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07c8c4-bdb9-4b30-b65d-4e4e6aae406b admin admin] PATH_INFO: `/v3/projects/f6ae9988b4ad482da4ca50a8ac794cdb/users/5ee84a5980fa4826ad0755a4b2701cc6/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:56.086278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07c8c4-bdb9-4b30-b65d-4e4e6aae406b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ae9988b4ad482da4ca50a8ac794cdb, user_id=5ee84a5980fa4826ad0755a4b2701cc6, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:56.088994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07c8c4-bdb9-4b30-b65d-4e4e6aae406b admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:56.104550 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1120/2247] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:56 2022] PUT /identity/v3/projects/f6ae9988b4ad482da4ca50a8ac794cdb/users/5ee84a5980fa4826ad0755a4b2701cc6/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:56.117207 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877ef09-a585-4f81-9165-1f8155053d52 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:56.117733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877ef09-a585-4f81-9165-1f8155053d52 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:56.117853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877ef09-a585-4f81-9165-1f8155053d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:56.144486 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-0877ef09-a585-4f81-9165-1f8155053d52 None None] MFA Rules not processed for user `5ee84a5980fa4826ad0755a4b2701cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:56.145675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-0877ef09-a585-4f81-9165-1f8155053d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:56.225708 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1128/2248] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:56.226688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07c8c4-bdb9-4b30-b65d-4e4e6aae406b admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:56.293450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07c8c4-bdb9-4b30-b65d-4e4e6aae406b admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:56.298148 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627af42-6057-4871-87e7-9dbce81cc09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:56.298832 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627af42-6057-4871-87e7-9dbce81cc09f admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:56.299098 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627af42-6057-4871-87e7-9dbce81cc09f admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:56.300034 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627af42-6057-4871-87e7-9dbce81cc09f admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:56.300777 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627af42-6057-4871-87e7-9dbce81cc09f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:56.302817 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627af42-6057-4871-87e7-9dbce81cc09f admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:56.332237 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1121/2249] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:56 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:56.334271 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877ef09-a585-4f81-9165-1f8155053d52 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:56.345204 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877ef09-a585-4f81-9165-1f8155053d52 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:56.402073 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d06018-101f-482e-885f-0c4e3dd1362d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:56.402733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d06018-101f-482e-885f-0c4e3dd1362d admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:56.403092 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d06018-101f-482e-885f-0c4e3dd1362d admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:56.403263 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d06018-101f-482e-885f-0c4e3dd1362d admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:56.404301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d06018-101f-482e-885f-0c4e3dd1362d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:56.405904 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d06018-101f-482e-885f-0c4e3dd1362d admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:56.425740 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1129/2250] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:56 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:56.429951 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627af42-6057-4871-87e7-9dbce81cc09f admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:56.440072 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627af42-6057-4871-87e7-9dbce81cc09f admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:56.445566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1945fa-bff0-4021-baf9-cbfdfe476846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:56.446238 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1945fa-bff0-4021-baf9-cbfdfe476846 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:56.446545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1945fa-bff0-4021-baf9-cbfdfe476846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:56.446842 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1945fa-bff0-4021-baf9-cbfdfe476846 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:56.447567 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1945fa-bff0-4021-baf9-cbfdfe476846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:56.449229 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1945fa-bff0-4021-baf9-cbfdfe476846 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:56.461330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1122/2251] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:26:56.465667 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d06018-101f-482e-885f-0c4e3dd1362d admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:56.476172 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d06018-101f-482e-885f-0c4e3dd1362d admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:56.480813 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148867fa-564c-4e95-9bc2-d6e021a3af5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:56.481681 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148867fa-564c-4e95-9bc2-d6e021a3af5c admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:56.481980 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148867fa-564c-4e95-9bc2-d6e021a3af5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:56.482252 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148867fa-564c-4e95-9bc2-d6e021a3af5c admin admin] PATH_INFO: `/v3/projects/5e4361ee756e4428a834c2ebd5f8a6cb/users/44c067372b304e44a5be45b2d1f95a86/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:56.496943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148867fa-564c-4e95-9bc2-d6e021a3af5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e4361ee756e4428a834c2ebd5f8a6cb, user_id=44c067372b304e44a5be45b2d1f95a86, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:56.499680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148867fa-564c-4e95-9bc2-d6e021a3af5c admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:56.515729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1130/2252] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:56 2022] PUT /identity/v3/projects/5e4361ee756e4428a834c2ebd5f8a6cb/users/44c067372b304e44a5be45b2d1f95a86/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:56.520098 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1945fa-bff0-4021-baf9-cbfdfe476846 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:56.530401 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1945fa-bff0-4021-baf9-cbfdfe476846 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:56.585959 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4dbe7f-5fb6-409f-a584-62ec3babeefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:56.586622 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dbe7f-5fb6-409f-a584-62ec3babeefd admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:56.586904 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dbe7f-5fb6-409f-a584-62ec3babeefd admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:56.587178 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dbe7f-5fb6-409f-a584-62ec3babeefd admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:56.587891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4dbe7f-5fb6-409f-a584-62ec3babeefd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:56.589506 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4dbe7f-5fb6-409f-a584-62ec3babeefd admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:56.598976 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1123/2253] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:56.603791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148867fa-564c-4e95-9bc2-d6e021a3af5c admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:56.614331 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148867fa-564c-4e95-9bc2-d6e021a3af5c admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:56.619293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1391a00-6fa1-4163-ad50-87c8c18cc75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:56.620210 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1391a00-6fa1-4163-ad50-87c8c18cc75c admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:56.620491 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1391a00-6fa1-4163-ad50-87c8c18cc75c admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:56.620759 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1391a00-6fa1-4163-ad50-87c8c18cc75c admin admin] PATH_INFO: `/v3/projects/5e4361ee756e4428a834c2ebd5f8a6cb/users/44c067372b304e44a5be45b2d1f95a86/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:56.622729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1391a00-6fa1-4163-ad50-87c8c18cc75c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e4361ee756e4428a834c2ebd5f8a6cb, user_id=44c067372b304e44a5be45b2d1f95a86, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:56.625487 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1391a00-6fa1-4163-ad50-87c8c18cc75c admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:56.636619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1131/2254] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:56 2022] PUT /identity/v3/projects/5e4361ee756e4428a834c2ebd5f8a6cb/users/44c067372b304e44a5be45b2d1f95a86/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:56.647760 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f6077-c4e4-4727-9a1f-54c3e43a9815 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:56.648130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f6077-c4e4-4727-9a1f-54c3e43a9815 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:56.648504 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f6077-c4e4-4727-9a1f-54c3e43a9815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:56.674619 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-f32f6077-c4e4-4727-9a1f-54c3e43a9815 None None] MFA Rules not processed for user `44c067372b304e44a5be45b2d1f95a86`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:56.676005 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f32f6077-c4e4-4727-9a1f-54c3e43a9815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:56.752299 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1124/2255] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:56.765355 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1391a00-6fa1-4163-ad50-87c8c18cc75c admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:56.767127 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f1391a00-6fa1-4163-ad50-87c8c18cc75c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:56.825402 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1391a00-6fa1-4163-ad50-87c8c18cc75c admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:56.828989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60acda-106b-43a7-beac-1ab02823cd22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:56.829613 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60acda-106b-43a7-beac-1ab02823cd22 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:56.829887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60acda-106b-43a7-beac-1ab02823cd22 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:56.830155 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60acda-106b-43a7-beac-1ab02823cd22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:56.843461 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60acda-106b-43a7-beac-1ab02823cd22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:56.843461 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60acda-106b-43a7-beac-1ab02823cd22 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:56.859643 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1132/2256] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:56.934970 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f6077-c4e4-4727-9a1f-54c3e43a9815 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:56.997352 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f6077-c4e4-4727-9a1f-54c3e43a9815 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:57.001806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792475f-6a2b-4d01-87ac-e58240ba9198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:57.002664 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792475f-6a2b-4d01-87ac-e58240ba9198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:57.002941 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792475f-6a2b-4d01-87ac-e58240ba9198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:57.003212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792475f-6a2b-4d01-87ac-e58240ba9198 admin admin] PATH_INFO: `/v3/users/5ee84a5980fa4826ad0755a4b2701cc6` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:57.004412 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792475f-6a2b-4d01-87ac-e58240ba9198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ee84a5980fa4826ad0755a4b2701cc6)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:57.007239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792475f-6a2b-4d01-87ac-e58240ba9198 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:57.054663 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9792475f-6a2b-4d01-87ac-e58240ba9198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee84a5980fa4826ad0755a4b2701cc6'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:57.069256 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9792475f-6a2b-4d01-87ac-e58240ba9198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee84a5980fa4826ad0755a4b2701cc6'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:57.076502 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9792475f-6a2b-4d01-87ac-e58240ba9198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee84a5980fa4826ad0755a4b2701cc6'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:57.077330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9792475f-6a2b-4d01-87ac-e58240ba9198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee84a5980fa4826ad0755a4b2701cc6'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:57.085880 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9792475f-6a2b-4d01-87ac-e58240ba9198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee84a5980fa4826ad0755a4b2701cc6'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:57.091831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1125/2257] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:56 2022] DELETE /identity/v3/users/5ee84a5980fa4826ad0755a4b2701cc6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:57.096450 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb04500-85ad-4e62-82c8-e40dde5d5527 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:57.096742 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb04500-85ad-4e62-82c8-e40dde5d5527 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:57.097020 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb04500-85ad-4e62-82c8-e40dde5d5527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:57.114233 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-2cb04500-85ad-4e62-82c8-e40dde5d5527 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:57.116032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-2cb04500-85ad-4e62-82c8-e40dde5d5527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:57.173786 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1133/2258] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:57.184694 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792475f-6a2b-4d01-87ac-e58240ba9198 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:57.186151 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-9792475f-6a2b-4d01-87ac-e58240ba9198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:57.244967 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792475f-6a2b-4d01-87ac-e58240ba9198 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:57.248998 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45743ba3-87cd-4f85-9ca7-34ad94f0c134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:57.249684 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45743ba3-87cd-4f85-9ca7-34ad94f0c134 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:57.250037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45743ba3-87cd-4f85-9ca7-34ad94f0c134 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:57.250241 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45743ba3-87cd-4f85-9ca7-34ad94f0c134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:57.260835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45743ba3-87cd-4f85-9ca7-34ad94f0c134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:57.262250 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45743ba3-87cd-4f85-9ca7-34ad94f0c134 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:57.272674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1126/2259] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:26:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:26:57.541452 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb04500-85ad-4e62-82c8-e40dde5d5527 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:57.542893 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-2cb04500-85ad-4e62-82c8-e40dde5d5527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:57.566771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb04500-85ad-4e62-82c8-e40dde5d5527 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:57.574187 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c233f-973c-4b3d-bd3f-e63c0dd6fe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:57.575061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c233f-973c-4b3d-bd3f-e63c0dd6fe25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:57.575339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c233f-973c-4b3d-bd3f-e63c0dd6fe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:57.575613 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c233f-973c-4b3d-bd3f-e63c0dd6fe25 admin admin] PATH_INFO: `/v3/projects/f6ae9988b4ad482da4ca50a8ac794cdb` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:57.577315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c233f-973c-4b3d-bd3f-e63c0dd6fe25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6ae9988b4ad482da4ca50a8ac794cdb)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:57.579263 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c233f-973c-4b3d-bd3f-e63c0dd6fe25 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:57.629943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-da6c233f-973c-4b3d-bd3f-e63c0dd6fe25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6ae9988b4ad482da4ca50a8ac794cdb', 'request_id': 'req-da6c233f-973c-4b3d-bd3f-e63c0dd6fe25'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:57.637871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-da6c233f-973c-4b3d-bd3f-e63c0dd6fe25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6ae9988b4ad482da4ca50a8ac794cdb', 'request_id': 'req-da6c233f-973c-4b3d-bd3f-e63c0dd6fe25'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:57.644589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-da6c233f-973c-4b3d-bd3f-e63c0dd6fe25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6ae9988b4ad482da4ca50a8ac794cdb', 'request_id': 'req-da6c233f-973c-4b3d-bd3f-e63c0dd6fe25'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:57.657069 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-da6c233f-973c-4b3d-bd3f-e63c0dd6fe25 admin admin] The token cache is being invalidate because project f6ae9988b4ad482da4ca50a8ac794cdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:57.657359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-da6c233f-973c-4b3d-bd3f-e63c0dd6fe25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:57.658025 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-da6c233f-973c-4b3d-bd3f-e63c0dd6fe25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:57.661370 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1134/2260] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:57 2022] DELETE /identity/v3/projects/f6ae9988b4ad482da4ca50a8ac794cdb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:57.666342 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45743ba3-87cd-4f85-9ca7-34ad94f0c134 service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:57.676534 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45743ba3-87cd-4f85-9ca7-34ad94f0c134 service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:57.740881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd86615-83f8-4482-9b34-ad3226a4fba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:57.741750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd86615-83f8-4482-9b34-ad3226a4fba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:57.742018 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd86615-83f8-4482-9b34-ad3226a4fba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:57.742297 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd86615-83f8-4482-9b34-ad3226a4fba8 admin admin] PATH_INFO: `/v3/users/44c067372b304e44a5be45b2d1f95a86` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:57.743580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd86615-83f8-4482-9b34-ad3226a4fba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44c067372b304e44a5be45b2d1f95a86)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:57.745545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd86615-83f8-4482-9b34-ad3226a4fba8 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:57.792225 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-7dd86615-83f8-4482-9b34-ad3226a4fba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44c067372b304e44a5be45b2d1f95a86'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:57.805048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-7dd86615-83f8-4482-9b34-ad3226a4fba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44c067372b304e44a5be45b2d1f95a86'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:57.812988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-7dd86615-83f8-4482-9b34-ad3226a4fba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44c067372b304e44a5be45b2d1f95a86'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:57.813726 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-7dd86615-83f8-4482-9b34-ad3226a4fba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44c067372b304e44a5be45b2d1f95a86'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:57.823618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-7dd86615-83f8-4482-9b34-ad3226a4fba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44c067372b304e44a5be45b2d1f95a86'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:57.829786 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1127/2261] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:26:57 2022] DELETE /identity/v3/users/44c067372b304e44a5be45b2d1f95a86 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:58.348269 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c233f-973c-4b3d-bd3f-e63c0dd6fe25 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:58.350431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-da6c233f-973c-4b3d-bd3f-e63c0dd6fe25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:58.363091 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c233f-973c-4b3d-bd3f-e63c0dd6fe25 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:58.420519 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282ad6d-68d4-41ef-9cfc-cfb9ea54c7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:58.421377 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282ad6d-68d4-41ef-9cfc-cfb9ea54c7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:58.421651 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282ad6d-68d4-41ef-9cfc-cfb9ea54c7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:58.421920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282ad6d-68d4-41ef-9cfc-cfb9ea54c7c0 admin admin] PATH_INFO: `/v3/projects/5e4361ee756e4428a834c2ebd5f8a6cb` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:58.423094 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282ad6d-68d4-41ef-9cfc-cfb9ea54c7c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e4361ee756e4428a834c2ebd5f8a6cb)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:58.425031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282ad6d-68d4-41ef-9cfc-cfb9ea54c7c0 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:58.472780 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-1282ad6d-68d4-41ef-9cfc-cfb9ea54c7c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e4361ee756e4428a834c2ebd5f8a6cb', 'request_id': 'req-1282ad6d-68d4-41ef-9cfc-cfb9ea54c7c0'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:58.480760 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-1282ad6d-68d4-41ef-9cfc-cfb9ea54c7c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e4361ee756e4428a834c2ebd5f8a6cb', 'request_id': 'req-1282ad6d-68d4-41ef-9cfc-cfb9ea54c7c0'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:58.486831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-1282ad6d-68d4-41ef-9cfc-cfb9ea54c7c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e4361ee756e4428a834c2ebd5f8a6cb', 'request_id': 'req-1282ad6d-68d4-41ef-9cfc-cfb9ea54c7c0'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:58.497342 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-1282ad6d-68d4-41ef-9cfc-cfb9ea54c7c0 admin admin] The token cache is being invalidate because project 5e4361ee756e4428a834c2ebd5f8a6cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:26:58.497629 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-1282ad6d-68d4-41ef-9cfc-cfb9ea54c7c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:58.498273 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-1282ad6d-68d4-41ef-9cfc-cfb9ea54c7c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:26:58.499836 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1135/2262] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:26:58 2022] DELETE /identity/v3/projects/5e4361ee756e4428a834c2ebd5f8a6cb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:58.504781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8e94a-6fc8-43b0-b9ba-8d2464841b0e None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:58.505285 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8e94a-6fc8-43b0-b9ba-8d2464841b0e None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:58.505451 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8e94a-6fc8-43b0-b9ba-8d2464841b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:58.524567 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-f2c8e94a-6fc8-43b0-b9ba-8d2464841b0e None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:58.525749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f2c8e94a-6fc8-43b0-b9ba-8d2464841b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:58.582566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1128/2263] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:58.592226 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382bdd1-1b6f-43b6-8a7d-e65831cef269 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:58.592508 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382bdd1-1b6f-43b6-8a7d-e65831cef269 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:58.592781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382bdd1-1b6f-43b6-8a7d-e65831cef269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:58.613684 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-8382bdd1-1b6f-43b6-8a7d-e65831cef269 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:58.615042 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8382bdd1-1b6f-43b6-8a7d-e65831cef269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:58.623133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1136/2264] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:58.627457 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8e94a-6fc8-43b0-b9ba-8d2464841b0e None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:58.637058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8e94a-6fc8-43b0-b9ba-8d2464841b0e None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:58.641635 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d14b1a-0dc7-4309-a1ac-142f167e6782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:58.642293 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d14b1a-0dc7-4309-a1ac-142f167e6782 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:58.642575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d14b1a-0dc7-4309-a1ac-142f167e6782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:58.642851 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d14b1a-0dc7-4309-a1ac-142f167e6782 admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:58.643825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d14b1a-0dc7-4309-a1ac-142f167e6782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:26:58.644133 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d14b1a-0dc7-4309-a1ac-142f167e6782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:58.646299 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d14b1a-0dc7-4309-a1ac-142f167e6782 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:58.657594 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1129/2265] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:26:58.662087 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382bdd1-1b6f-43b6-8a7d-e65831cef269 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:58.671274 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382bdd1-1b6f-43b6-8a7d-e65831cef269 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:58.675856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb772ad-3087-4f49-84e2-e77d3e6ffcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:58.676533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb772ad-3087-4f49-84e2-e77d3e6ffcd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:58.676812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb772ad-3087-4f49-84e2-e77d3e6ffcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:58.677598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb772ad-3087-4f49-84e2-e77d3e6ffcd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:58.678390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb772ad-3087-4f49-84e2-e77d3e6ffcd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:58.680360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb772ad-3087-4f49-84e2-e77d3e6ffcd0 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:58.705431 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1137/2266] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:58 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:26:58.709718 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d14b1a-0dc7-4309-a1ac-142f167e6782 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:58.719438 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d14b1a-0dc7-4309-a1ac-142f167e6782 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:58.776984 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7e661-9db4-4eba-ad5e-f1530f23c608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:58.777558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7e661-9db4-4eba-ad5e-f1530f23c608 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:58.777846 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7e661-9db4-4eba-ad5e-f1530f23c608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:58.778105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7e661-9db4-4eba-ad5e-f1530f23c608 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:58.778944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7e661-9db4-4eba-ad5e-f1530f23c608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:58.780953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7e661-9db4-4eba-ad5e-f1530f23c608 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:58.801366 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1130/2267] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:58 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:26:58.806120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb772ad-3087-4f49-84e2-e77d3e6ffcd0 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:58.816681 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb772ad-3087-4f49-84e2-e77d3e6ffcd0 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:58.822058 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a19159-5931-4653-b98a-cbf76f3db562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:58.822712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a19159-5931-4653-b98a-cbf76f3db562 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:58.822993 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a19159-5931-4653-b98a-cbf76f3db562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:58.823264 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a19159-5931-4653-b98a-cbf76f3db562 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:58.823995 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a19159-5931-4653-b98a-cbf76f3db562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:58.825623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a19159-5931-4653-b98a-cbf76f3db562 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:58.836856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1138/2268] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:58.841435 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7e661-9db4-4eba-ad5e-f1530f23c608 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:58.853052 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7e661-9db4-4eba-ad5e-f1530f23c608 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:58.857800 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0b598-93b0-4f88-b81e-343db7ae7b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:58.858458 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0b598-93b0-4f88-b81e-343db7ae7b73 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:58.858738 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0b598-93b0-4f88-b81e-343db7ae7b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:58.859014 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0b598-93b0-4f88-b81e-343db7ae7b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:58.859736 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0b598-93b0-4f88-b81e-343db7ae7b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:58.861367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0b598-93b0-4f88-b81e-343db7ae7b73 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:58.873142 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1131/2269] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:58.877344 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a19159-5931-4653-b98a-cbf76f3db562 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:58.887951 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a19159-5931-4653-b98a-cbf76f3db562 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:58.892971 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81d7ca-c64f-470d-b69c-998deff63eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:58.894106 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81d7ca-c64f-470d-b69c-998deff63eff admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:58.894411 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81d7ca-c64f-470d-b69c-998deff63eff admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:58.894704 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81d7ca-c64f-470d-b69c-998deff63eff admin admin] PATH_INFO: `/v3/projects/8b587f26f77f462f9001bf622c847161/users/c90e05f2bcd64857938829b2c4cb54f7/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:58.909507 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81d7ca-c64f-470d-b69c-998deff63eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b587f26f77f462f9001bf622c847161, user_id=c90e05f2bcd64857938829b2c4cb54f7, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:58.913070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81d7ca-c64f-470d-b69c-998deff63eff admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:58.926695 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1139/2270] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:58 2022] PUT /identity/v3/projects/8b587f26f77f462f9001bf622c847161/users/c90e05f2bcd64857938829b2c4cb54f7/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:58.937722 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9d8b2-2a20-4f01-b7d0-dc40193e2854 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:58.938024 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9d8b2-2a20-4f01-b7d0-dc40193e2854 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:58.938303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9d8b2-2a20-4f01-b7d0-dc40193e2854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:58.965070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-a6c9d8b2-2a20-4f01-b7d0-dc40193e2854 None None] MFA Rules not processed for user `c90e05f2bcd64857938829b2c4cb54f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:58.966339 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-a6c9d8b2-2a20-4f01-b7d0-dc40193e2854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:59.030094 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1132/2271] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:59.034572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81d7ca-c64f-470d-b69c-998deff63eff admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:59.102851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81d7ca-c64f-470d-b69c-998deff63eff admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:59.110757 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2fe92-ba42-49b1-8c82-70dcdc710ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:59.111499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2fe92-ba42-49b1-8c82-70dcdc710ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:59.111780 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2fe92-ba42-49b1-8c82-70dcdc710ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:59.112055 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2fe92-ba42-49b1-8c82-70dcdc710ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:59.112824 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2fe92-ba42-49b1-8c82-70dcdc710ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:59.115391 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2fe92-ba42-49b1-8c82-70dcdc710ba9 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:59.142115 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1140/2272] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:59 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:59.146956 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9d8b2-2a20-4f01-b7d0-dc40193e2854 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:59.157907 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9d8b2-2a20-4f01-b7d0-dc40193e2854 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:59.215299 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c904b-1671-44cf-bdf2-b06dddac1ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:59.215963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c904b-1671-44cf-bdf2-b06dddac1ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:59.216279 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c904b-1671-44cf-bdf2-b06dddac1ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:59.216553 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c904b-1671-44cf-bdf2-b06dddac1ac5 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:59.217228 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c904b-1671-44cf-bdf2-b06dddac1ac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:59.219121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c904b-1671-44cf-bdf2-b06dddac1ac5 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:59.242182 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1133/2273] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:59 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:59.246210 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2fe92-ba42-49b1-8c82-70dcdc710ba9 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:59.257614 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2fe92-ba42-49b1-8c82-70dcdc710ba9 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:59.262281 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8d93b-4ce4-4833-a8b4-85a48be13cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:59.262937 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8d93b-4ce4-4833-a8b4-85a48be13cff admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:59.263216 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8d93b-4ce4-4833-a8b4-85a48be13cff admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:59.263488 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8d93b-4ce4-4833-a8b4-85a48be13cff admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:59.264251 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8d93b-4ce4-4833-a8b4-85a48be13cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:59.265846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8d93b-4ce4-4833-a8b4-85a48be13cff admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:59.276978 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1141/2274] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:26:59.281066 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c904b-1671-44cf-bdf2-b06dddac1ac5 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:59.291200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c904b-1671-44cf-bdf2-b06dddac1ac5 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:59.295789 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdcf08-881c-411e-b1f3-ce7dd2374e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:59.296478 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdcf08-881c-411e-b1f3-ce7dd2374e4a admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:59.296762 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdcf08-881c-411e-b1f3-ce7dd2374e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:59.297037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdcf08-881c-411e-b1f3-ce7dd2374e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:59.297787 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdcf08-881c-411e-b1f3-ce7dd2374e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:59.299371 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdcf08-881c-411e-b1f3-ce7dd2374e4a admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:59.309729 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1134/2275] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:59.313949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8d93b-4ce4-4833-a8b4-85a48be13cff admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:59.324492 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8d93b-4ce4-4833-a8b4-85a48be13cff admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:59.329096 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881314e-ca01-494c-95e2-9862a0567fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:59.329962 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881314e-ca01-494c-95e2-9862a0567fb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:59.330237 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881314e-ca01-494c-95e2-9862a0567fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:59.330507 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881314e-ca01-494c-95e2-9862a0567fb2 admin admin] PATH_INFO: `/v3/projects/3cf2fa86fc7f432889e69d58a961b60d/users/8454aaa489b14730864807c251c133fb/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:59.346959 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881314e-ca01-494c-95e2-9862a0567fb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf2fa86fc7f432889e69d58a961b60d, user_id=8454aaa489b14730864807c251c133fb, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:59.350144 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881314e-ca01-494c-95e2-9862a0567fb2 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:59.367510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1142/2276] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:59 2022] PUT /identity/v3/projects/3cf2fa86fc7f432889e69d58a961b60d/users/8454aaa489b14730864807c251c133fb/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:59.378603 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110754ce-6aad-4d50-96bb-187f39e1b73b None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:59.378940 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110754ce-6aad-4d50-96bb-187f39e1b73b None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:59.379179 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110754ce-6aad-4d50-96bb-187f39e1b73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:59.414568 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-110754ce-6aad-4d50-96bb-187f39e1b73b None None] MFA Rules not processed for user `8454aaa489b14730864807c251c133fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:59.416185 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-110754ce-6aad-4d50-96bb-187f39e1b73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:26:59.478540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1135/2277] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:26:59.483043 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881314e-ca01-494c-95e2-9862a0567fb2 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:59.547894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881314e-ca01-494c-95e2-9862a0567fb2 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:59.553050 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756420d2-51b7-481e-8ff4-725fb1fd4a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:59.553699 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756420d2-51b7-481e-8ff4-725fb1fd4a1e admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:59.553973 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756420d2-51b7-481e-8ff4-725fb1fd4a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:59.554248 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756420d2-51b7-481e-8ff4-725fb1fd4a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:59.554937 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756420d2-51b7-481e-8ff4-725fb1fd4a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:59.556875 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756420d2-51b7-481e-8ff4-725fb1fd4a1e admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:59.581663 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1143/2278] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:26:59 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:26:59.585726 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110754ce-6aad-4d50-96bb-187f39e1b73b None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:59.596305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110754ce-6aad-4d50-96bb-187f39e1b73b None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:59.654857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6470e56-ca71-44ab-adb2-79d6141c793b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:59.655555 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6470e56-ca71-44ab-adb2-79d6141c793b admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:59.655839 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6470e56-ca71-44ab-adb2-79d6141c793b admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:59.656192 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6470e56-ca71-44ab-adb2-79d6141c793b admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:59.656889 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6470e56-ca71-44ab-adb2-79d6141c793b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:59.658816 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6470e56-ca71-44ab-adb2-79d6141c793b admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:59.679276 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1136/2279] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:26:59 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:26:59.683365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756420d2-51b7-481e-8ff4-725fb1fd4a1e admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:59.693521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756420d2-51b7-481e-8ff4-725fb1fd4a1e admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:59.698092 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208dfe7-40a7-4d4c-9241-97153b6d92df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:59.698739 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208dfe7-40a7-4d4c-9241-97153b6d92df admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:59.699013 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208dfe7-40a7-4d4c-9241-97153b6d92df admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:59.699282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208dfe7-40a7-4d4c-9241-97153b6d92df admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:59.700022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208dfe7-40a7-4d4c-9241-97153b6d92df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:59.701640 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208dfe7-40a7-4d4c-9241-97153b6d92df admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:59.712908 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1144/2280] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:26:59.717022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6470e56-ca71-44ab-adb2-79d6141c793b admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:59.727852 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6470e56-ca71-44ab-adb2-79d6141c793b admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:59.732647 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa60e0-a154-402d-a544-f197b1d7d00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:59.733541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa60e0-a154-402d-a544-f197b1d7d00b admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:59.733833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa60e0-a154-402d-a544-f197b1d7d00b admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:59.734164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa60e0-a154-402d-a544-f197b1d7d00b admin admin] PATH_INFO: `/v3/projects/ebf77443de0c44faad5cb76bc662d569/users/b17ba3e441f34f99ae5fab899e82adbb/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:59.751019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa60e0-a154-402d-a544-f197b1d7d00b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf77443de0c44faad5cb76bc662d569, user_id=b17ba3e441f34f99ae5fab899e82adbb, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:59.753706 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa60e0-a154-402d-a544-f197b1d7d00b admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:59.766598 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1137/2281] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:59 2022] PUT /identity/v3/projects/ebf77443de0c44faad5cb76bc662d569/users/b17ba3e441f34f99ae5fab899e82adbb/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:26:59.770820 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208dfe7-40a7-4d4c-9241-97153b6d92df admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:59.780537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208dfe7-40a7-4d4c-9241-97153b6d92df admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:59.835040 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c1a5f-8652-409d-90f8-f2adb0221f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:59.835699 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c1a5f-8652-409d-90f8-f2adb0221f7a admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:59.835976 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c1a5f-8652-409d-90f8-f2adb0221f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:59.836279 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c1a5f-8652-409d-90f8-f2adb0221f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:59.836992 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c1a5f-8652-409d-90f8-f2adb0221f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:59.838659 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c1a5f-8652-409d-90f8-f2adb0221f7a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:59.851325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1145/2282] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:26:59.855471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa60e0-a154-402d-a544-f197b1d7d00b admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:26:59.866620 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa60e0-a154-402d-a544-f197b1d7d00b admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:26:59.871351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb2cf2-896d-40e4-ba4c-3347d93c2bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:26:59.872286 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb2cf2-896d-40e4-ba4c-3347d93c2bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:59.872570 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb2cf2-896d-40e4-ba4c-3347d93c2bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:59.872845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb2cf2-896d-40e4-ba4c-3347d93c2bd7 admin admin] PATH_INFO: `/v3/projects/ebf77443de0c44faad5cb76bc662d569/users/b17ba3e441f34f99ae5fab899e82adbb/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:59.874811 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb2cf2-896d-40e4-ba4c-3347d93c2bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf77443de0c44faad5cb76bc662d569, user_id=b17ba3e441f34f99ae5fab899e82adbb, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:26:59.877620 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb2cf2-896d-40e4-ba4c-3347d93c2bd7 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:26:59.888400 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1138/2283] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:26:59 2022] PUT /identity/v3/projects/ebf77443de0c44faad5cb76bc662d569/users/b17ba3e441f34f99ae5fab899e82adbb/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:26:59.905576 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b285d-b4fd-4051-a997-f9c4e2936a10 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:26:59.905915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b285d-b4fd-4051-a997-f9c4e2936a10 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:26:59.906198 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b285d-b4fd-4051-a997-f9c4e2936a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:26:59.934321 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-cf7b285d-b4fd-4051-a997-f9c4e2936a10 None None] MFA Rules not processed for user `b17ba3e441f34f99ae5fab899e82adbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:26:59.935545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-cf7b285d-b4fd-4051-a997-f9c4e2936a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:00.006822 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1146/2284] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:26:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:00.017726 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb2cf2-896d-40e4-ba4c-3347d93c2bd7 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:00.019681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-2fdb2cf2-896d-40e4-ba4c-3347d93c2bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:00.074931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb2cf2-896d-40e4-ba4c-3347d93c2bd7 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:00.078598 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b019602-1c0b-4a9f-baf2-c7345c57b0c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:00.079259 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b019602-1c0b-4a9f-baf2-c7345c57b0c5 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:00.079543 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b019602-1c0b-4a9f-baf2-c7345c57b0c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:00.079816 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b019602-1c0b-4a9f-baf2-c7345c57b0c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:00.089319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b019602-1c0b-4a9f-baf2-c7345c57b0c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:00.090682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b019602-1c0b-4a9f-baf2-c7345c57b0c5 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:00.100652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1139/2285] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:27:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:27:00.655055 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b285d-b4fd-4051-a997-f9c4e2936a10 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:00.656603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-cf7b285d-b4fd-4051-a997-f9c4e2936a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:00.669687 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b285d-b4fd-4051-a997-f9c4e2936a10 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:00.673413 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2191c06-1ed1-491f-b1d8-98bbc3c4fe38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:00.674107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2191c06-1ed1-491f-b1d8-98bbc3c4fe38 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:00.674386 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2191c06-1ed1-491f-b1d8-98bbc3c4fe38 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:00.674659 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2191c06-1ed1-491f-b1d8-98bbc3c4fe38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:00.739084 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2191c06-1ed1-491f-b1d8-98bbc3c4fe38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:00.741096 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2191c06-1ed1-491f-b1d8-98bbc3c4fe38 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:00.750899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1147/2286] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:27:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:27:06.432741 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b019602-1c0b-4a9f-baf2-c7345c57b0c5 service cinder] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:06.434177 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-6b019602-1c0b-4a9f-baf2-c7345c57b0c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:06.507815 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b019602-1c0b-4a9f-baf2-c7345c57b0c5 service cinder] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:06.515742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126dff5-2268-4107-a487-104937ab06df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:06.516795 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126dff5-2268-4107-a487-104937ab06df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:06.517030 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126dff5-2268-4107-a487-104937ab06df admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:06.517395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126dff5-2268-4107-a487-104937ab06df admin admin] PATH_INFO: `/v3/users/9b5da81b394b46cca63d907ee90d6710` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:06.519194 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126dff5-2268-4107-a487-104937ab06df admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b5da81b394b46cca63d907ee90d6710)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:06.521905 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126dff5-2268-4107-a487-104937ab06df admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:06.582268 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9126dff5-2268-4107-a487-104937ab06df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b5da81b394b46cca63d907ee90d6710'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:06.609545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9126dff5-2268-4107-a487-104937ab06df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b5da81b394b46cca63d907ee90d6710'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:06.619084 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9126dff5-2268-4107-a487-104937ab06df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b5da81b394b46cca63d907ee90d6710'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:06.620413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9126dff5-2268-4107-a487-104937ab06df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b5da81b394b46cca63d907ee90d6710'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:06.630636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9126dff5-2268-4107-a487-104937ab06df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b5da81b394b46cca63d907ee90d6710'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:06.648237 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1140/2287] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:27:06 2022] DELETE /identity/v3/users/9b5da81b394b46cca63d907ee90d6710 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:27:06.652197 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6135fdf-2b96-41f5-a30e-33c94e3385bc None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:06.653049 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6135fdf-2b96-41f5-a30e-33c94e3385bc None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:06.653745 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6135fdf-2b96-41f5-a30e-33c94e3385bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:06.688693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-a6135fdf-2b96-41f5-a30e-33c94e3385bc None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:06.690009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-a6135fdf-2b96-41f5-a30e-33c94e3385bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:06.793284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1148/2288] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:06.799951 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126dff5-2268-4107-a487-104937ab06df admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:06.802042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-9126dff5-2268-4107-a487-104937ab06df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:06.873825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126dff5-2268-4107-a487-104937ab06df admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:06.877643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75dea22-d6a6-48d5-ab5f-f001b53dfc3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:06.878283 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75dea22-d6a6-48d5-ab5f-f001b53dfc3b service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:06.878562 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75dea22-d6a6-48d5-ab5f-f001b53dfc3b service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:06.878836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75dea22-d6a6-48d5-ab5f-f001b53dfc3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:06.893002 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75dea22-d6a6-48d5-ab5f-f001b53dfc3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:06.894852 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75dea22-d6a6-48d5-ab5f-f001b53dfc3b service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:06.907038 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1141/2289] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:27:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:27:06.936981 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6135fdf-2b96-41f5-a30e-33c94e3385bc None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:06.938395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-a6135fdf-2b96-41f5-a30e-33c94e3385bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:06.998492 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6135fdf-2b96-41f5-a30e-33c94e3385bc None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:07.002485 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a5cad-dff6-41c4-841c-0b62ffef3021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:07.003245 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a5cad-dff6-41c4-841c-0b62ffef3021 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:07.003530 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a5cad-dff6-41c4-841c-0b62ffef3021 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:07.003928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a5cad-dff6-41c4-841c-0b62ffef3021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:07.006442 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-3e5a5cad-dff6-41c4-841c-0b62ffef3021 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:07.080134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a5cad-dff6-41c4-841c-0b62ffef3021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:07.082061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a5cad-dff6-41c4-841c-0b62ffef3021 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:07.091343 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1149/2290] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:27:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:27:07.179856 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75dea22-d6a6-48d5-ab5f-f001b53dfc3b service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:07.181325 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-e75dea22-d6a6-48d5-ab5f-f001b53dfc3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:07.196349 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75dea22-d6a6-48d5-ab5f-f001b53dfc3b service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:07.210093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069472ed-59d4-4d8b-b3f1-ed0e98a1a5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:07.211053 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069472ed-59d4-4d8b-b3f1-ed0e98a1a5b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:07.211340 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069472ed-59d4-4d8b-b3f1-ed0e98a1a5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:07.211619 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069472ed-59d4-4d8b-b3f1-ed0e98a1a5b1 admin admin] PATH_INFO: `/v3/projects/c98a05cfa3bf4f5aa5a22eb7c50c1c1b` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:07.212882 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069472ed-59d4-4d8b-b3f1-ed0e98a1a5b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c98a05cfa3bf4f5aa5a22eb7c50c1c1b)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:07.215026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069472ed-59d4-4d8b-b3f1-ed0e98a1a5b1 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:07.286382 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-069472ed-59d4-4d8b-b3f1-ed0e98a1a5b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c98a05cfa3bf4f5aa5a22eb7c50c1c1b', 'request_id': 'req-069472ed-59d4-4d8b-b3f1-ed0e98a1a5b1'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:07.292501 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-069472ed-59d4-4d8b-b3f1-ed0e98a1a5b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c98a05cfa3bf4f5aa5a22eb7c50c1c1b', 'request_id': 'req-069472ed-59d4-4d8b-b3f1-ed0e98a1a5b1'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:07.303940 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-069472ed-59d4-4d8b-b3f1-ed0e98a1a5b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c98a05cfa3bf4f5aa5a22eb7c50c1c1b', 'request_id': 'req-069472ed-59d4-4d8b-b3f1-ed0e98a1a5b1'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:07.316795 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-069472ed-59d4-4d8b-b3f1-ed0e98a1a5b1 admin admin] The token cache is being invalidate because project c98a05cfa3bf4f5aa5a22eb7c50c1c1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:27:07.317090 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-069472ed-59d4-4d8b-b3f1-ed0e98a1a5b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:07.318830 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-069472ed-59d4-4d8b-b3f1-ed0e98a1a5b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:07.320476 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1142/2291] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:27:07 2022] DELETE /identity/v3/projects/c98a05cfa3bf4f5aa5a22eb7c50c1c1b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:27:07.329542 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c131b1-604f-4b2e-824c-5d0fe6186555 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:07.329833 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c131b1-604f-4b2e-824c-5d0fe6186555 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:07.330115 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c131b1-604f-4b2e-824c-5d0fe6186555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:07.362775 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-a6c131b1-604f-4b2e-824c-5d0fe6186555 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:07.364322 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-a6c131b1-604f-4b2e-824c-5d0fe6186555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:07.433793 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1150/2292] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:07.441516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d916d69-917c-4319-91b1-14f2872a7211 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:07.442033 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d916d69-917c-4319-91b1-14f2872a7211 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:07.442140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d916d69-917c-4319-91b1-14f2872a7211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:07.464053 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-1d916d69-917c-4319-91b1-14f2872a7211 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:07.465334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-1d916d69-917c-4319-91b1-14f2872a7211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:07.482121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1143/2293] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:07.482388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c131b1-604f-4b2e-824c-5d0fe6186555 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:07.487364 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c131b1-604f-4b2e-824c-5d0fe6186555 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:07.492781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda371c-702b-43f2-a86f-5fcb8bcec404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:07.493597 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda371c-702b-43f2-a86f-5fcb8bcec404 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:07.493876 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda371c-702b-43f2-a86f-5fcb8bcec404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:07.494150 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda371c-702b-43f2-a86f-5fcb8bcec404 admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:07.494875 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda371c-702b-43f2-a86f-5fcb8bcec404 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:27:07.495183 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda371c-702b-43f2-a86f-5fcb8bcec404 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:07.496812 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda371c-702b-43f2-a86f-5fcb8bcec404 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:07.509292 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1151/2294] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:27:07.513685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d916d69-917c-4319-91b1-14f2872a7211 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:07.524237 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d916d69-917c-4319-91b1-14f2872a7211 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:07.529123 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cb899-5563-4177-94ad-ffe1f98a36e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:07.529519 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cb899-5563-4177-94ad-ffe1f98a36e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:07.529803 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cb899-5563-4177-94ad-ffe1f98a36e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:07.530079 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cb899-5563-4177-94ad-ffe1f98a36e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:07.530772 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302cb899-5563-4177-94ad-ffe1f98a36e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:07.532717 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302cb899-5563-4177-94ad-ffe1f98a36e8 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:07.566740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1144/2295] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:27:07 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:27:07.568631 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda371c-702b-43f2-a86f-5fcb8bcec404 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:07.581700 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda371c-702b-43f2-a86f-5fcb8bcec404 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:07.649063 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df98f07-b63e-41ab-988a-3801e39516af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:07.649954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df98f07-b63e-41ab-988a-3801e39516af admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:07.650932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df98f07-b63e-41ab-988a-3801e39516af admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:07.650932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df98f07-b63e-41ab-988a-3801e39516af admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:07.651889 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df98f07-b63e-41ab-988a-3801e39516af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:07.654398 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df98f07-b63e-41ab-988a-3801e39516af admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:07.680645 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1152/2296] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:27:07 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:27:07.684984 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cb899-5563-4177-94ad-ffe1f98a36e8 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:07.696610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cb899-5563-4177-94ad-ffe1f98a36e8 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:07.702134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae5f3c-1094-4e5a-8ea3-316d2de067fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:07.702827 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae5f3c-1094-4e5a-8ea3-316d2de067fe admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:07.703132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae5f3c-1094-4e5a-8ea3-316d2de067fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:07.703400 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae5f3c-1094-4e5a-8ea3-316d2de067fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:07.704122 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae5f3c-1094-4e5a-8ea3-316d2de067fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:07.705860 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae5f3c-1094-4e5a-8ea3-316d2de067fe admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:07.716808 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1145/2297] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:27:07.721124 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df98f07-b63e-41ab-988a-3801e39516af admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:07.732593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df98f07-b63e-41ab-988a-3801e39516af admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:07.737492 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3c9a8-03cd-43a5-ae2f-c793eb2fc2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:07.738896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3c9a8-03cd-43a5-ae2f-c793eb2fc2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:07.739250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3c9a8-03cd-43a5-ae2f-c793eb2fc2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:07.740303 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3c9a8-03cd-43a5-ae2f-c793eb2fc2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:07.741819 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3c9a8-03cd-43a5-ae2f-c793eb2fc2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:07.743505 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3c9a8-03cd-43a5-ae2f-c793eb2fc2f4 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:07.754573 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1153/2298] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:27:07.759628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae5f3c-1094-4e5a-8ea3-316d2de067fe admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:07.771212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae5f3c-1094-4e5a-8ea3-316d2de067fe admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:07.777249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3686a54-60bd-4ce3-88b0-dc93eb1cf2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:07.778318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3686a54-60bd-4ce3-88b0-dc93eb1cf2a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:07.778614 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3686a54-60bd-4ce3-88b0-dc93eb1cf2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:07.778891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3686a54-60bd-4ce3-88b0-dc93eb1cf2a0 admin admin] PATH_INFO: `/v3/projects/64ecc58f6a5e4ef0be34b3da415dfdcb/users/129bbf5a3c374d17b2f32d8fed8e0950/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:07.800668 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3686a54-60bd-4ce3-88b0-dc93eb1cf2a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ecc58f6a5e4ef0be34b3da415dfdcb, user_id=129bbf5a3c374d17b2f32d8fed8e0950, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:07.808372 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3686a54-60bd-4ce3-88b0-dc93eb1cf2a0 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:07.825323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1146/2299] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:27:07 2022] PUT /identity/v3/projects/64ecc58f6a5e4ef0be34b3da415dfdcb/users/129bbf5a3c374d17b2f32d8fed8e0950/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:27:07.835530 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed1c1a-a303-41d7-9341-d3246f91037f None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:07.836294 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed1c1a-a303-41d7-9341-d3246f91037f None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:07.836294 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed1c1a-a303-41d7-9341-d3246f91037f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:07.871762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-c3ed1c1a-a303-41d7-9341-d3246f91037f None None] MFA Rules not processed for user `129bbf5a3c374d17b2f32d8fed8e0950`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:07.873261 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c3ed1c1a-a303-41d7-9341-d3246f91037f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:07.938177 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1154/2300] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:07.950009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3686a54-60bd-4ce3-88b0-dc93eb1cf2a0 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:07.951709 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-e3686a54-60bd-4ce3-88b0-dc93eb1cf2a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:08.010589 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3686a54-60bd-4ce3-88b0-dc93eb1cf2a0 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:08.014567 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776450a4-1c04-4f9d-963c-2dc5f44044a5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62c3f9351a4181a4fc2930570171b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:08.015218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776450a4-1c04-4f9d-963c-2dc5f44044a5 service glance] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:08.015525 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776450a4-1c04-4f9d-963c-2dc5f44044a5 service glance] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:08.015845 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776450a4-1c04-4f9d-963c-2dc5f44044a5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:08.026226 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776450a4-1c04-4f9d-963c-2dc5f44044a5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:08.027653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776450a4-1c04-4f9d-963c-2dc5f44044a5 service glance] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:08.038529 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1147/2301] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:27:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:27:10.855948 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed1c1a-a303-41d7-9341-d3246f91037f None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:10.857477 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c3ed1c1a-a303-41d7-9341-d3246f91037f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:11.014099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed1c1a-a303-41d7-9341-d3246f91037f None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:11.019215 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180e2cd-0c74-4b01-aab2-81a772567eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:11.020073 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180e2cd-0c74-4b01-aab2-81a772567eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:11.020411 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180e2cd-0c74-4b01-aab2-81a772567eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:11.020676 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180e2cd-0c74-4b01-aab2-81a772567eb1 admin admin] PATH_INFO: `/v3/users/c90e05f2bcd64857938829b2c4cb54f7` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:11.021984 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180e2cd-0c74-4b01-aab2-81a772567eb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c90e05f2bcd64857938829b2c4cb54f7)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:11.024452 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180e2cd-0c74-4b01-aab2-81a772567eb1 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:11.074347 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-d180e2cd-0c74-4b01-aab2-81a772567eb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c90e05f2bcd64857938829b2c4cb54f7'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:11.074995 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-d180e2cd-0c74-4b01-aab2-81a772567eb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c90e05f2bcd64857938829b2c4cb54f7'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:11.082891 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-d180e2cd-0c74-4b01-aab2-81a772567eb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c90e05f2bcd64857938829b2c4cb54f7'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:11.100229 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-d180e2cd-0c74-4b01-aab2-81a772567eb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c90e05f2bcd64857938829b2c4cb54f7'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:11.114004 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-d180e2cd-0c74-4b01-aab2-81a772567eb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c90e05f2bcd64857938829b2c4cb54f7'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:11.120494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1155/2302] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:27:10 2022] DELETE /identity/v3/users/c90e05f2bcd64857938829b2c4cb54f7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:11.125361 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5845b1f-b98a-45e3-ab7b-49b82b7407a9 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:11.125833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5845b1f-b98a-45e3-ab7b-49b82b7407a9 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:11.126227 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5845b1f-b98a-45e3-ab7b-49b82b7407a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:11.157959 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-d5845b1f-b98a-45e3-ab7b-49b82b7407a9 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:11.159187 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-d5845b1f-b98a-45e3-ab7b-49b82b7407a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:11.270290 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1148/2303] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:11.280539 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180e2cd-0c74-4b01-aab2-81a772567eb1 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:11.281947 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-d180e2cd-0c74-4b01-aab2-81a772567eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:11.393690 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180e2cd-0c74-4b01-aab2-81a772567eb1 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:11.398859 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b951e75-d4cd-4f5a-ac86-02686ed9d4fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:11.399611 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b951e75-d4cd-4f5a-ac86-02686ed9d4fc service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:11.399961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b951e75-d4cd-4f5a-ac86-02686ed9d4fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:11.400339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b951e75-d4cd-4f5a-ac86-02686ed9d4fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:11.414521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b951e75-d4cd-4f5a-ac86-02686ed9d4fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:11.416001 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b951e75-d4cd-4f5a-ac86-02686ed9d4fc service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:11.438187 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1156/2304] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:27:11.754742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5845b1f-b98a-45e3-ab7b-49b82b7407a9 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:11.757478 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-d5845b1f-b98a-45e3-ab7b-49b82b7407a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:11.773096 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5845b1f-b98a-45e3-ab7b-49b82b7407a9 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:11.777939 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb5421-7f04-4b84-b6b7-681114c96b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:11.779100 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb5421-7f04-4b84-b6b7-681114c96b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:11.779498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb5421-7f04-4b84-b6b7-681114c96b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:11.779962 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb5421-7f04-4b84-b6b7-681114c96b43 admin admin] PATH_INFO: `/v3/projects/8b587f26f77f462f9001bf622c847161` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:11.781394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb5421-7f04-4b84-b6b7-681114c96b43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b587f26f77f462f9001bf622c847161)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:11.783750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb5421-7f04-4b84-b6b7-681114c96b43 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:11.837302 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-1ebb5421-7f04-4b84-b6b7-681114c96b43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b587f26f77f462f9001bf622c847161', 'request_id': 'req-1ebb5421-7f04-4b84-b6b7-681114c96b43'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:11.843164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-1ebb5421-7f04-4b84-b6b7-681114c96b43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b587f26f77f462f9001bf622c847161', 'request_id': 'req-1ebb5421-7f04-4b84-b6b7-681114c96b43'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:11.851084 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-1ebb5421-7f04-4b84-b6b7-681114c96b43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b587f26f77f462f9001bf622c847161', 'request_id': 'req-1ebb5421-7f04-4b84-b6b7-681114c96b43'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:11.863265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-1ebb5421-7f04-4b84-b6b7-681114c96b43 admin admin] The token cache is being invalidate because project 8b587f26f77f462f9001bf622c847161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:27:11.863553 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-1ebb5421-7f04-4b84-b6b7-681114c96b43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:11.864217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-1ebb5421-7f04-4b84-b6b7-681114c96b43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:11.865968 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1149/2305] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:27:11 2022] DELETE /identity/v3/projects/8b587f26f77f462f9001bf622c847161 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:11.869904 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b951e75-d4cd-4f5a-ac86-02686ed9d4fc service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:11.879393 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b951e75-d4cd-4f5a-ac86-02686ed9d4fc service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:11.944966 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f614a-82fc-46a8-95be-b89f02d25569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:11.945801 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f614a-82fc-46a8-95be-b89f02d25569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:11.946074 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f614a-82fc-46a8-95be-b89f02d25569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:11.946346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f614a-82fc-46a8-95be-b89f02d25569 admin admin] PATH_INFO: `/v3/users/8454aaa489b14730864807c251c133fb` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:11.947809 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f614a-82fc-46a8-95be-b89f02d25569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8454aaa489b14730864807c251c133fb)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:11.949526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f614a-82fc-46a8-95be-b89f02d25569 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:11.996023 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-5b8f614a-82fc-46a8-95be-b89f02d25569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8454aaa489b14730864807c251c133fb'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:11.996708 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-5b8f614a-82fc-46a8-95be-b89f02d25569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8454aaa489b14730864807c251c133fb'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:12.004141 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-5b8f614a-82fc-46a8-95be-b89f02d25569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8454aaa489b14730864807c251c133fb'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:12.012543 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-5b8f614a-82fc-46a8-95be-b89f02d25569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8454aaa489b14730864807c251c133fb'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:12.025701 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-5b8f614a-82fc-46a8-95be-b89f02d25569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8454aaa489b14730864807c251c133fb'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:12.031676 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1157/2306] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:27:11 2022] DELETE /identity/v3/users/8454aaa489b14730864807c251c133fb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:27:12.340583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb5421-7f04-4b84-b6b7-681114c96b43 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:12.342493 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-1ebb5421-7f04-4b84-b6b7-681114c96b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:12.361607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb5421-7f04-4b84-b6b7-681114c96b43 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:12.419082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfc915-f363-4b50-bddc-8ec85985db31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:12.419966 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfc915-f363-4b50-bddc-8ec85985db31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:12.420275 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfc915-f363-4b50-bddc-8ec85985db31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:12.420543 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfc915-f363-4b50-bddc-8ec85985db31 admin admin] PATH_INFO: `/v3/projects/3cf2fa86fc7f432889e69d58a961b60d` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:12.421791 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfc915-f363-4b50-bddc-8ec85985db31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf2fa86fc7f432889e69d58a961b60d)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:12.423720 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfc915-f363-4b50-bddc-8ec85985db31 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:12.470392 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-01dfc915-f363-4b50-bddc-8ec85985db31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf2fa86fc7f432889e69d58a961b60d', 'request_id': 'req-01dfc915-f363-4b50-bddc-8ec85985db31'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:12.475590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-01dfc915-f363-4b50-bddc-8ec85985db31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf2fa86fc7f432889e69d58a961b60d', 'request_id': 'req-01dfc915-f363-4b50-bddc-8ec85985db31'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:12.482666 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-01dfc915-f363-4b50-bddc-8ec85985db31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf2fa86fc7f432889e69d58a961b60d', 'request_id': 'req-01dfc915-f363-4b50-bddc-8ec85985db31'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:12.494694 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-01dfc915-f363-4b50-bddc-8ec85985db31 admin admin] The token cache is being invalidate because project 3cf2fa86fc7f432889e69d58a961b60d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:27:12.495084 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-01dfc915-f363-4b50-bddc-8ec85985db31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:12.495911 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-01dfc915-f363-4b50-bddc-8ec85985db31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:12.497800 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1150/2307] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:27:12 2022] DELETE /identity/v3/projects/3cf2fa86fc7f432889e69d58a961b60d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:12.501525 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f614a-82fc-46a8-95be-b89f02d25569 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:12.502924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-5b8f614a-82fc-46a8-95be-b89f02d25569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:12.516523 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f614a-82fc-46a8-95be-b89f02d25569 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:12.573756 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80a619-7c5c-4f82-83cd-259d07e81ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:12.574629 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80a619-7c5c-4f82-83cd-259d07e81ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:12.574911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80a619-7c5c-4f82-83cd-259d07e81ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:12.575189 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80a619-7c5c-4f82-83cd-259d07e81ab7 admin admin] PATH_INFO: `/v3/users/b17ba3e441f34f99ae5fab899e82adbb` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:12.576395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80a619-7c5c-4f82-83cd-259d07e81ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b17ba3e441f34f99ae5fab899e82adbb)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:12.578331 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80a619-7c5c-4f82-83cd-259d07e81ab7 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:12.623206 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-cb80a619-7c5c-4f82-83cd-259d07e81ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b17ba3e441f34f99ae5fab899e82adbb'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:12.624041 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-cb80a619-7c5c-4f82-83cd-259d07e81ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b17ba3e441f34f99ae5fab899e82adbb'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:12.633971 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-cb80a619-7c5c-4f82-83cd-259d07e81ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b17ba3e441f34f99ae5fab899e82adbb'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:12.641186 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-cb80a619-7c5c-4f82-83cd-259d07e81ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b17ba3e441f34f99ae5fab899e82adbb'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:12.657896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-cb80a619-7c5c-4f82-83cd-259d07e81ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b17ba3e441f34f99ae5fab899e82adbb'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:12.664599 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1158/2308] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:27:12 2022] DELETE /identity/v3/users/b17ba3e441f34f99ae5fab899e82adbb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:12.972281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfc915-f363-4b50-bddc-8ec85985db31 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:12.973708 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-01dfc915-f363-4b50-bddc-8ec85985db31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:12.986980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfc915-f363-4b50-bddc-8ec85985db31 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:13.051341 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a9f59-82fa-4656-ac09-eced3f8bb772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:13.053728 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a9f59-82fa-4656-ac09-eced3f8bb772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:13.054020 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a9f59-82fa-4656-ac09-eced3f8bb772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:13.054371 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a9f59-82fa-4656-ac09-eced3f8bb772 admin admin] PATH_INFO: `/v3/projects/ebf77443de0c44faad5cb76bc662d569` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:13.055697 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a9f59-82fa-4656-ac09-eced3f8bb772 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebf77443de0c44faad5cb76bc662d569)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:13.057769 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a9f59-82fa-4656-ac09-eced3f8bb772 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:13.107027 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-811a9f59-82fa-4656-ac09-eced3f8bb772 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebf77443de0c44faad5cb76bc662d569', 'request_id': 'req-811a9f59-82fa-4656-ac09-eced3f8bb772'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:13.112607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-811a9f59-82fa-4656-ac09-eced3f8bb772 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebf77443de0c44faad5cb76bc662d569', 'request_id': 'req-811a9f59-82fa-4656-ac09-eced3f8bb772'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:13.122667 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-811a9f59-82fa-4656-ac09-eced3f8bb772 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebf77443de0c44faad5cb76bc662d569', 'request_id': 'req-811a9f59-82fa-4656-ac09-eced3f8bb772'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:13.134541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-811a9f59-82fa-4656-ac09-eced3f8bb772 admin admin] The token cache is being invalidate because project ebf77443de0c44faad5cb76bc662d569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:27:13.134811 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-811a9f59-82fa-4656-ac09-eced3f8bb772 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:13.135450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-811a9f59-82fa-4656-ac09-eced3f8bb772 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:13.137083 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1151/2309] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:27:12 2022] DELETE /identity/v3/projects/ebf77443de0c44faad5cb76bc662d569 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:13.143061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fbc44-e027-41f8-b58e-a129b3ff2b7e None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:13.143800 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fbc44-e027-41f8-b58e-a129b3ff2b7e None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:13.143894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fbc44-e027-41f8-b58e-a129b3ff2b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:13.171057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-895fbc44-e027-41f8-b58e-a129b3ff2b7e None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:13.172306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-895fbc44-e027-41f8-b58e-a129b3ff2b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:13.231599 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1159/2310] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:13.240767 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3facd-dbf3-408d-baf4-4174a87813c7 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:13.241057 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3facd-dbf3-408d-baf4-4174a87813c7 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:13.241336 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3facd-dbf3-408d-baf4-4174a87813c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:13.259792 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-e7c3facd-dbf3-408d-baf4-4174a87813c7 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:13.260947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-e7c3facd-dbf3-408d-baf4-4174a87813c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:13.270319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1152/2311] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:13.274587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fbc44-e027-41f8-b58e-a129b3ff2b7e None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:13.284647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fbc44-e027-41f8-b58e-a129b3ff2b7e None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:13.290072 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6de9f-6960-4647-a728-27e31968871a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:13.290744 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6de9f-6960-4647-a728-27e31968871a admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:13.291027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6de9f-6960-4647-a728-27e31968871a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:13.291321 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6de9f-6960-4647-a728-27e31968871a admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:13.292106 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6de9f-6960-4647-a728-27e31968871a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:27:13.292444 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6de9f-6960-4647-a728-27e31968871a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:13.294052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6de9f-6960-4647-a728-27e31968871a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:13.306774 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1160/2312] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:27:13.311237 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3facd-dbf3-408d-baf4-4174a87813c7 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:13.321357 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3facd-dbf3-408d-baf4-4174a87813c7 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:13.326073 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a2517-ae3c-4455-8e83-923b32b818bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:13.326734 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a2517-ae3c-4455-8e83-923b32b818bd admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:13.327051 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a2517-ae3c-4455-8e83-923b32b818bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:13.327329 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a2517-ae3c-4455-8e83-923b32b818bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:13.328022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a2517-ae3c-4455-8e83-923b32b818bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:13.329957 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a2517-ae3c-4455-8e83-923b32b818bd admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:13.360222 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1153/2313] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:27:13 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:27:13.362635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6de9f-6960-4647-a728-27e31968871a admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:13.372658 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6de9f-6960-4647-a728-27e31968871a admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:13.435508 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db9599-0b31-4d8a-91f1-1bb3ba811e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:13.436364 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db9599-0b31-4d8a-91f1-1bb3ba811e71 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:13.436657 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db9599-0b31-4d8a-91f1-1bb3ba811e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:13.436925 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db9599-0b31-4d8a-91f1-1bb3ba811e71 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:13.437602 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db9599-0b31-4d8a-91f1-1bb3ba811e71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:13.439493 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db9599-0b31-4d8a-91f1-1bb3ba811e71 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:13.460218 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1161/2314] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:27:13 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:27:13.464384 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a2517-ae3c-4455-8e83-923b32b818bd admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:13.475405 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a2517-ae3c-4455-8e83-923b32b818bd admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:13.480174 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772081e-6044-46d7-b387-3d9fff5b4642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:13.480834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772081e-6044-46d7-b387-3d9fff5b4642 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:13.481116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772081e-6044-46d7-b387-3d9fff5b4642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:13.481391 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772081e-6044-46d7-b387-3d9fff5b4642 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:13.482116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772081e-6044-46d7-b387-3d9fff5b4642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:13.483710 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772081e-6044-46d7-b387-3d9fff5b4642 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:13.496096 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1154/2315] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:27:13.500349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db9599-0b31-4d8a-91f1-1bb3ba811e71 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:13.510470 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db9599-0b31-4d8a-91f1-1bb3ba811e71 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:13.515047 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1f9fd-313f-4b92-ac27-de489bbf81c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:13.515693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1f9fd-313f-4b92-ac27-de489bbf81c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:13.515974 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1f9fd-313f-4b92-ac27-de489bbf81c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:13.516281 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1f9fd-313f-4b92-ac27-de489bbf81c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:13.517002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1f9fd-313f-4b92-ac27-de489bbf81c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:13.518849 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1f9fd-313f-4b92-ac27-de489bbf81c5 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:13.529011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1162/2316] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:27:13.533570 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772081e-6044-46d7-b387-3d9fff5b4642 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:13.544442 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772081e-6044-46d7-b387-3d9fff5b4642 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:13.549511 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbc33f-e7a6-4c38-821b-8ec56dfca00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:13.550410 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbc33f-e7a6-4c38-821b-8ec56dfca00c admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:13.550697 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbc33f-e7a6-4c38-821b-8ec56dfca00c admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:13.551454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbc33f-e7a6-4c38-821b-8ec56dfca00c admin admin] PATH_INFO: `/v3/projects/7f11943a0df4439fb9e0e12a42a133fb/users/901ef53986df47fc94637d821c82bcf2/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:13.566847 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbc33f-e7a6-4c38-821b-8ec56dfca00c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f11943a0df4439fb9e0e12a42a133fb, user_id=901ef53986df47fc94637d821c82bcf2, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:13.569777 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbc33f-e7a6-4c38-821b-8ec56dfca00c admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:13.582531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1155/2317] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:27:13 2022] PUT /identity/v3/projects/7f11943a0df4439fb9e0e12a42a133fb/users/901ef53986df47fc94637d821c82bcf2/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:13.595226 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97443dcb-9bd9-455a-9eec-f57175b6ddfb None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:13.595587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97443dcb-9bd9-455a-9eec-f57175b6ddfb None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:13.595929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97443dcb-9bd9-455a-9eec-f57175b6ddfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:13.625627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-97443dcb-9bd9-455a-9eec-f57175b6ddfb None None] MFA Rules not processed for user `901ef53986df47fc94637d821c82bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:13.627098 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-97443dcb-9bd9-455a-9eec-f57175b6ddfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:13.691362 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1163/2318] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:13.702603 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbc33f-e7a6-4c38-821b-8ec56dfca00c admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:13.704300 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-a8cbc33f-e7a6-4c38-821b-8ec56dfca00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:13.760951 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbc33f-e7a6-4c38-821b-8ec56dfca00c admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:13.764735 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d80114-c80b-4bc2-81ba-aa7d71690f12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:13.765388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d80114-c80b-4bc2-81ba-aa7d71690f12 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:13.765805 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d80114-c80b-4bc2-81ba-aa7d71690f12 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:13.766025 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d80114-c80b-4bc2-81ba-aa7d71690f12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:13.775990 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d80114-c80b-4bc2-81ba-aa7d71690f12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:13.777457 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d80114-c80b-4bc2-81ba-aa7d71690f12 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:13.786414 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1156/2319] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:27:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:27:16.226030 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97443dcb-9bd9-455a-9eec-f57175b6ddfb None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:16.227490 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-97443dcb-9bd9-455a-9eec-f57175b6ddfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:16.330145 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97443dcb-9bd9-455a-9eec-f57175b6ddfb None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:16.342865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcd380-08e4-4060-8bd9-3fe58be52990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:16.344378 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcd380-08e4-4060-8bd9-3fe58be52990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:16.344802 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcd380-08e4-4060-8bd9-3fe58be52990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:16.345228 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcd380-08e4-4060-8bd9-3fe58be52990 admin admin] PATH_INFO: `/v3/users/09ecc7bd55024032937c75646bd0aec6` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:16.346646 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcd380-08e4-4060-8bd9-3fe58be52990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09ecc7bd55024032937c75646bd0aec6)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:16.348619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcd380-08e4-4060-8bd9-3fe58be52990 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:16.395522 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb1195-4c45-4697-a005-0405f2e83dc5 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:16.397116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb1195-4c45-4697-a005-0405f2e83dc5 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:16.397356 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb1195-4c45-4697-a005-0405f2e83dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:16.421232 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-87eb1195-4c45-4697-a005-0405f2e83dc5 None None] MFA Rules not processed for user `6dfbf496174e4138bfac5e1b925a0b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:16.424137 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-87eb1195-4c45-4697-a005-0405f2e83dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:16.429608 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-69bcd380-08e4-4060-8bd9-3fe58be52990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09ecc7bd55024032937c75646bd0aec6'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:16.430796 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-69bcd380-08e4-4060-8bd9-3fe58be52990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09ecc7bd55024032937c75646bd0aec6'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:16.439710 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-69bcd380-08e4-4060-8bd9-3fe58be52990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09ecc7bd55024032937c75646bd0aec6'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:16.448297 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-69bcd380-08e4-4060-8bd9-3fe58be52990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09ecc7bd55024032937c75646bd0aec6'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:16.463609 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-69bcd380-08e4-4060-8bd9-3fe58be52990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09ecc7bd55024032937c75646bd0aec6'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:16.470336 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1164/2320] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:27:16 2022] DELETE /identity/v3/users/09ecc7bd55024032937c75646bd0aec6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:16.474554 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7caaa-6f23-4033-bdd1-85b6cd66ed70 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:16.475010 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7caaa-6f23-4033-bdd1-85b6cd66ed70 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:16.475279 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7caaa-6f23-4033-bdd1-85b6cd66ed70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:16.492175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1157/2321] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:16.495669 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-7fc7caaa-6f23-4033-bdd1-85b6cd66ed70 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:16.499448 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-7fc7caaa-6f23-4033-bdd1-85b6cd66ed70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:16.587257 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1165/2322] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:27:16.597320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb1195-4c45-4697-a005-0405f2e83dc5 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:16.601078 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-87eb1195-4c45-4697-a005-0405f2e83dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:16.663883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb1195-4c45-4697-a005-0405f2e83dc5 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:16.717849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191bec0-f59a-4918-95cc-847d8158beb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:16.718498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191bec0-f59a-4918-95cc-847d8158beb1 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:16.718782 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191bec0-f59a-4918-95cc-847d8158beb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:16.719057 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191bec0-f59a-4918-95cc-847d8158beb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:16.730630 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191bec0-f59a-4918-95cc-847d8158beb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:16.732200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191bec0-f59a-4918-95cc-847d8158beb1 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:16.745701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1158/2323] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:27:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:27:16.930949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7caaa-6f23-4033-bdd1-85b6cd66ed70 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:16.932525 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-7fc7caaa-6f23-4033-bdd1-85b6cd66ed70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:16.945910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7caaa-6f23-4033-bdd1-85b6cd66ed70 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:16.950870 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065c527-50b5-43b3-91be-c7f798d0e2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:16.951746 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065c527-50b5-43b3-91be-c7f798d0e2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:16.952021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065c527-50b5-43b3-91be-c7f798d0e2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:16.952333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065c527-50b5-43b3-91be-c7f798d0e2fb admin admin] PATH_INFO: `/v3/users/901ef53986df47fc94637d821c82bcf2` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:16.953621 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065c527-50b5-43b3-91be-c7f798d0e2fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=901ef53986df47fc94637d821c82bcf2)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:16.956081 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065c527-50b5-43b3-91be-c7f798d0e2fb admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:16.990284 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71e3da-5319-4a16-92c0-7498b66d98ce None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:16.991336 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71e3da-5319-4a16-92c0-7498b66d98ce None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:16.991695 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71e3da-5319-4a16-92c0-7498b66d98ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:17.046282 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-1d71e3da-5319-4a16-92c0-7498b66d98ce None None] MFA Rules not processed for user `7fb4dfe324594ec6924ded65bf7e613b`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:17.048056 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-1d71e3da-5319-4a16-92c0-7498b66d98ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:17.068905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e065c527-50b5-43b3-91be-c7f798d0e2fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '901ef53986df47fc94637d821c82bcf2'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:17.070091 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e065c527-50b5-43b3-91be-c7f798d0e2fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '901ef53986df47fc94637d821c82bcf2'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:17.080251 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e065c527-50b5-43b3-91be-c7f798d0e2fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '901ef53986df47fc94637d821c82bcf2'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:17.091302 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e065c527-50b5-43b3-91be-c7f798d0e2fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '901ef53986df47fc94637d821c82bcf2'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:17.107475 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e065c527-50b5-43b3-91be-c7f798d0e2fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '901ef53986df47fc94637d821c82bcf2'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:17.116571 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1166/2324] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:27:16 2022] DELETE /identity/v3/users/901ef53986df47fc94637d821c82bcf2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:17.121470 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4961e0-3067-45df-ab4c-cb2078c08105 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:17.121858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4961e0-3067-45df-ab4c-cb2078c08105 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:17.122325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4961e0-3067-45df-ab4c-cb2078c08105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:17.145254 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-2a4961e0-3067-45df-ab4c-cb2078c08105 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:17.145254 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-2a4961e0-3067-45df-ab4c-cb2078c08105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:17.178125 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1159/2325] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:17.227491 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1167/2326] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:27:17.237368 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71e3da-5319-4a16-92c0-7498b66d98ce None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:17.238832 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-1d71e3da-5319-4a16-92c0-7498b66d98ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:17.258732 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71e3da-5319-4a16-92c0-7498b66d98ce None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:17.264951 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4961e0-3067-45df-ab4c-cb2078c08105 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:17.266993 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-2a4961e0-3067-45df-ab4c-cb2078c08105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:17.299109 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4961e0-3067-45df-ab4c-cb2078c08105 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:17.310367 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a7b01-3149-4dcd-b2c7-7b20c84b18ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:17.311994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a7b01-3149-4dcd-b2c7-7b20c84b18ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:17.313131 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a7b01-3149-4dcd-b2c7-7b20c84b18ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:17.313645 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a7b01-3149-4dcd-b2c7-7b20c84b18ef admin admin] PATH_INFO: `/v3/projects/39aa20c1c2b24565b55df64b888b05d1` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:17.325194 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a7b01-3149-4dcd-b2c7-7b20c84b18ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=39aa20c1c2b24565b55df64b888b05d1)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:17.328037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a7b01-3149-4dcd-b2c7-7b20c84b18ef admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:17.342052 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1ed01-5447-46bf-b220-31d7cff11c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:17.343084 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1ed01-5447-46bf-b220-31d7cff11c19 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:17.343513 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1ed01-5447-46bf-b220-31d7cff11c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:17.344005 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1ed01-5447-46bf-b220-31d7cff11c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:17.364508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1ed01-5447-46bf-b220-31d7cff11c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:17.367410 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1ed01-5447-46bf-b220-31d7cff11c19 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:17.387085 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1160/2327] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:27:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:27:17.400009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f34a7b01-3149-4dcd-b2c7-7b20c84b18ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39aa20c1c2b24565b55df64b888b05d1', 'request_id': 'req-f34a7b01-3149-4dcd-b2c7-7b20c84b18ef'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:17.411531 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f34a7b01-3149-4dcd-b2c7-7b20c84b18ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39aa20c1c2b24565b55df64b888b05d1', 'request_id': 'req-f34a7b01-3149-4dcd-b2c7-7b20c84b18ef'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:17.425104 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f34a7b01-3149-4dcd-b2c7-7b20c84b18ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39aa20c1c2b24565b55df64b888b05d1', 'request_id': 'req-f34a7b01-3149-4dcd-b2c7-7b20c84b18ef'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:17.437127 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f34a7b01-3149-4dcd-b2c7-7b20c84b18ef admin admin] The token cache is being invalidate because project 39aa20c1c2b24565b55df64b888b05d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:27:17.437411 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f34a7b01-3149-4dcd-b2c7-7b20c84b18ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:17.438426 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f34a7b01-3149-4dcd-b2c7-7b20c84b18ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:17.439998 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1168/2328] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:27:17 2022] DELETE /identity/v3/projects/39aa20c1c2b24565b55df64b888b05d1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:27:17.932255 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1ed01-5447-46bf-b220-31d7cff11c19 service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:17.933864 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-75c1ed01-5447-46bf-b220-31d7cff11c19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:17.962422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1ed01-5447-46bf-b220-31d7cff11c19 service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:18.074252 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011758d-c24e-40dc-a706-06bcdbfebaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:18.080065 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011758d-c24e-40dc-a706-06bcdbfebaac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:18.080065 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011758d-c24e-40dc-a706-06bcdbfebaac admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:18.080065 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011758d-c24e-40dc-a706-06bcdbfebaac admin admin] PATH_INFO: `/v3/projects/7f11943a0df4439fb9e0e12a42a133fb` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:18.081027 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011758d-c24e-40dc-a706-06bcdbfebaac admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f11943a0df4439fb9e0e12a42a133fb)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:18.082992 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011758d-c24e-40dc-a706-06bcdbfebaac admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:18.213032 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-e011758d-c24e-40dc-a706-06bcdbfebaac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f11943a0df4439fb9e0e12a42a133fb', 'request_id': 'req-e011758d-c24e-40dc-a706-06bcdbfebaac'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:18.221229 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-e011758d-c24e-40dc-a706-06bcdbfebaac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f11943a0df4439fb9e0e12a42a133fb', 'request_id': 'req-e011758d-c24e-40dc-a706-06bcdbfebaac'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:18.242636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-e011758d-c24e-40dc-a706-06bcdbfebaac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f11943a0df4439fb9e0e12a42a133fb', 'request_id': 'req-e011758d-c24e-40dc-a706-06bcdbfebaac'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:18.279503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-e011758d-c24e-40dc-a706-06bcdbfebaac admin admin] The token cache is being invalidate because project 7f11943a0df4439fb9e0e12a42a133fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:27:18.279795 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-e011758d-c24e-40dc-a706-06bcdbfebaac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:18.282286 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-e011758d-c24e-40dc-a706-06bcdbfebaac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:18.289983 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1161/2329] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:27:17 2022] DELETE /identity/v3/projects/7f11943a0df4439fb9e0e12a42a133fb => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:18.291744 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35902695-a879-4fb9-9321-b7400306a7b5 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:18.292670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35902695-a879-4fb9-9321-b7400306a7b5 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:18.293102 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35902695-a879-4fb9-9321-b7400306a7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:18.334695 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-35902695-a879-4fb9-9321-b7400306a7b5 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:18.336112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-35902695-a879-4fb9-9321-b7400306a7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:18.435797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1169/2330] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:18.444566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d800df-eeda-47a8-a303-283ba10c54dc None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:18.444857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d800df-eeda-47a8-a303-283ba10c54dc None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:18.445500 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d800df-eeda-47a8-a303-283ba10c54dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:18.471120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-49d800df-eeda-47a8-a303-283ba10c54dc None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:18.472667 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-49d800df-eeda-47a8-a303-283ba10c54dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:18.482574 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1162/2331] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:18.486977 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35902695-a879-4fb9-9321-b7400306a7b5 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:18.498144 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35902695-a879-4fb9-9321-b7400306a7b5 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:18.502936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8f9f6-9ce8-4a16-8bd4-8c0a3b21bb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:18.503763 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8f9f6-9ce8-4a16-8bd4-8c0a3b21bb92 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:18.504052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8f9f6-9ce8-4a16-8bd4-8c0a3b21bb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:18.504389 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8f9f6-9ce8-4a16-8bd4-8c0a3b21bb92 admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:18.506662 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8f9f6-9ce8-4a16-8bd4-8c0a3b21bb92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:27:18.507150 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8f9f6-9ce8-4a16-8bd4-8c0a3b21bb92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:18.511063 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8f9f6-9ce8-4a16-8bd4-8c0a3b21bb92 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:18.527554 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1170/2332] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:27:18.528719 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d800df-eeda-47a8-a303-283ba10c54dc None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:18.540981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d800df-eeda-47a8-a303-283ba10c54dc None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:18.545920 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687cc75-bd8b-47bb-860c-72ae11d70bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:18.546583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687cc75-bd8b-47bb-860c-72ae11d70bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:18.546868 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687cc75-bd8b-47bb-860c-72ae11d70bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:18.547286 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687cc75-bd8b-47bb-860c-72ae11d70bb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:18.548199 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687cc75-bd8b-47bb-860c-72ae11d70bb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:18.550096 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687cc75-bd8b-47bb-860c-72ae11d70bb7 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:18.586368 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1163/2333] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:27:18 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:27:18.590645 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8f9f6-9ce8-4a16-8bd4-8c0a3b21bb92 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:18.601816 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8f9f6-9ce8-4a16-8bd4-8c0a3b21bb92 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:18.667524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a29fd-8ead-4cb5-90c8-46369a93760c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:18.668212 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a29fd-8ead-4cb5-90c8-46369a93760c admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:18.668496 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a29fd-8ead-4cb5-90c8-46369a93760c admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:18.668775 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a29fd-8ead-4cb5-90c8-46369a93760c admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:18.669930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a29fd-8ead-4cb5-90c8-46369a93760c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:18.671861 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a29fd-8ead-4cb5-90c8-46369a93760c admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:18.695925 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1171/2334] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:27:18 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:27:18.699947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687cc75-bd8b-47bb-860c-72ae11d70bb7 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:18.710144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687cc75-bd8b-47bb-860c-72ae11d70bb7 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:18.714691 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5eb0d7-f085-408c-a94b-392a3b3a3bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:18.715336 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5eb0d7-f085-408c-a94b-392a3b3a3bfb admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:18.715615 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5eb0d7-f085-408c-a94b-392a3b3a3bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:18.715884 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5eb0d7-f085-408c-a94b-392a3b3a3bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:18.716640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5eb0d7-f085-408c-a94b-392a3b3a3bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:18.718211 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5eb0d7-f085-408c-a94b-392a3b3a3bfb admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:18.729278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1164/2335] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:27:18.733133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a29fd-8ead-4cb5-90c8-46369a93760c admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:18.744187 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a29fd-8ead-4cb5-90c8-46369a93760c admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:18.749025 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51fa78-4494-4fc0-80e4-a861ac0e044f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:18.749694 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51fa78-4494-4fc0-80e4-a861ac0e044f admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:18.749979 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51fa78-4494-4fc0-80e4-a861ac0e044f admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:18.750242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51fa78-4494-4fc0-80e4-a861ac0e044f admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:18.750968 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51fa78-4494-4fc0-80e4-a861ac0e044f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:18.752614 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51fa78-4494-4fc0-80e4-a861ac0e044f admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:18.763655 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1172/2336] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:27:18.767665 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5eb0d7-f085-408c-a94b-392a3b3a3bfb admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:18.778191 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5eb0d7-f085-408c-a94b-392a3b3a3bfb admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:18.782752 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e0495-8569-42c1-b56f-5779a55e7e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:18.783617 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e0495-8569-42c1-b56f-5779a55e7e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:18.783892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e0495-8569-42c1-b56f-5779a55e7e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:18.784177 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e0495-8569-42c1-b56f-5779a55e7e63 admin admin] PATH_INFO: `/v3/projects/8e62b490ec474700814aa4880b0d0a96/users/7a3a43a3bc0c4d918cac33f14b0f48d2/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:18.799557 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e0495-8569-42c1-b56f-5779a55e7e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e62b490ec474700814aa4880b0d0a96, user_id=7a3a43a3bc0c4d918cac33f14b0f48d2, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:18.802278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e0495-8569-42c1-b56f-5779a55e7e63 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:18.816222 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1165/2337] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:27:18 2022] PUT /identity/v3/projects/8e62b490ec474700814aa4880b0d0a96/users/7a3a43a3bc0c4d918cac33f14b0f48d2/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:18.826865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6acd43-a09a-44dd-a56f-613526fc3f38 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:18.827226 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6acd43-a09a-44dd-a56f-613526fc3f38 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:18.827601 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6acd43-a09a-44dd-a56f-613526fc3f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:18.856504 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-4d6acd43-a09a-44dd-a56f-613526fc3f38 None None] MFA Rules not processed for user `7a3a43a3bc0c4d918cac33f14b0f48d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:18.857702 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-4d6acd43-a09a-44dd-a56f-613526fc3f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:18.935422 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1173/2338] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:27:18.936738 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e0495-8569-42c1-b56f-5779a55e7e63 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:19.010031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e0495-8569-42c1-b56f-5779a55e7e63 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:19.014667 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8921b7-caeb-4de2-8963-3b35ea6a8bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:19.015513 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8921b7-caeb-4de2-8963-3b35ea6a8bde admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:19.015983 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8921b7-caeb-4de2-8963-3b35ea6a8bde admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:19.016322 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8921b7-caeb-4de2-8963-3b35ea6a8bde admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:19.017007 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8921b7-caeb-4de2-8963-3b35ea6a8bde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:19.019254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8921b7-caeb-4de2-8963-3b35ea6a8bde admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:19.051151 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1166/2339] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:27:18 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:27:19.052145 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6acd43-a09a-44dd-a56f-613526fc3f38 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:19.065166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6acd43-a09a-44dd-a56f-613526fc3f38 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:19.131873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1478a-3f1f-4446-8f48-0560ea25fc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:19.132661 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1478a-3f1f-4446-8f48-0560ea25fc26 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:19.132945 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1478a-3f1f-4446-8f48-0560ea25fc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:19.133221 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1478a-3f1f-4446-8f48-0560ea25fc26 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:19.133903 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1478a-3f1f-4446-8f48-0560ea25fc26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:19.135840 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1478a-3f1f-4446-8f48-0560ea25fc26 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:19.162430 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1174/2340] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:27:19 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:27:19.166274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8921b7-caeb-4de2-8963-3b35ea6a8bde admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:19.183241 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8921b7-caeb-4de2-8963-3b35ea6a8bde admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:19.189076 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3fa50-73b3-40e0-9194-cb6c7c274b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:19.189815 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3fa50-73b3-40e0-9194-cb6c7c274b71 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:19.190100 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3fa50-73b3-40e0-9194-cb6c7c274b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:19.190377 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3fa50-73b3-40e0-9194-cb6c7c274b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:19.191106 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3fa50-73b3-40e0-9194-cb6c7c274b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:19.193437 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3fa50-73b3-40e0-9194-cb6c7c274b71 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:19.205298 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1167/2341] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:27:19.211053 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1478a-3f1f-4446-8f48-0560ea25fc26 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:19.220958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1478a-3f1f-4446-8f48-0560ea25fc26 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:19.225584 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c7712-94f8-40ff-a8d9-700a1ff36bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:19.226239 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c7712-94f8-40ff-a8d9-700a1ff36bea admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:19.226519 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c7712-94f8-40ff-a8d9-700a1ff36bea admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:19.226793 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c7712-94f8-40ff-a8d9-700a1ff36bea admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:19.227515 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c7712-94f8-40ff-a8d9-700a1ff36bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:19.230933 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c7712-94f8-40ff-a8d9-700a1ff36bea admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:19.248191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1175/2342] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:27:19.249746 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3fa50-73b3-40e0-9194-cb6c7c274b71 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:19.260837 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3fa50-73b3-40e0-9194-cb6c7c274b71 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:19.266006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a6c3b-35be-4f8e-9084-2a14e237ddad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:19.266963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a6c3b-35be-4f8e-9084-2a14e237ddad admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:19.267321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a6c3b-35be-4f8e-9084-2a14e237ddad admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:19.267897 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a6c3b-35be-4f8e-9084-2a14e237ddad admin admin] PATH_INFO: `/v3/projects/096e6b321e3f43249fa2562fd6cd6155/users/7915d69ceca24d5d885944ebb9dcf7a8/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:19.284255 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a6c3b-35be-4f8e-9084-2a14e237ddad admin admin] RBAC: Authorizing `identity:create_grant(project_id=096e6b321e3f43249fa2562fd6cd6155, user_id=7915d69ceca24d5d885944ebb9dcf7a8, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:19.287042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a6c3b-35be-4f8e-9084-2a14e237ddad admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:19.300487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1168/2343] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:27:19 2022] PUT /identity/v3/projects/096e6b321e3f43249fa2562fd6cd6155/users/7915d69ceca24d5d885944ebb9dcf7a8/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:19.312424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8eeaf0-3561-43c2-8f12-504d77c7af10 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:19.312914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8eeaf0-3561-43c2-8f12-504d77c7af10 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:19.313007 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8eeaf0-3561-43c2-8f12-504d77c7af10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:19.342598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-8a8eeaf0-3561-43c2-8f12-504d77c7af10 None None] MFA Rules not processed for user `7915d69ceca24d5d885944ebb9dcf7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:19.343814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8a8eeaf0-3561-43c2-8f12-504d77c7af10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:19.428200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1176/2344] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:19.434205 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a6c3b-35be-4f8e-9084-2a14e237ddad admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:19.538728 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a6c3b-35be-4f8e-9084-2a14e237ddad admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:19.551572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c89e9f-e218-4491-b4c9-0b26ef7cd1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:19.552590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c89e9f-e218-4491-b4c9-0b26ef7cd1d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:19.552740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c89e9f-e218-4491-b4c9-0b26ef7cd1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:19.553019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c89e9f-e218-4491-b4c9-0b26ef7cd1d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:19.553722 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c89e9f-e218-4491-b4c9-0b26ef7cd1d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:19.555838 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c89e9f-e218-4491-b4c9-0b26ef7cd1d6 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:19.592196 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1169/2345] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:27:19 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:27:19.594904 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8eeaf0-3561-43c2-8f12-504d77c7af10 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:19.610344 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8eeaf0-3561-43c2-8f12-504d77c7af10 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:19.682178 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43d8d8-6bd5-4e4e-9ffa-651ed12356aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:19.684143 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43d8d8-6bd5-4e4e-9ffa-651ed12356aa admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:19.684929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43d8d8-6bd5-4e4e-9ffa-651ed12356aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:19.685106 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43d8d8-6bd5-4e4e-9ffa-651ed12356aa admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:19.686676 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43d8d8-6bd5-4e4e-9ffa-651ed12356aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:19.691276 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43d8d8-6bd5-4e4e-9ffa-651ed12356aa admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:19.720503 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c89e9f-e218-4491-b4c9-0b26ef7cd1d6 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:19.721114 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1177/2346] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:27:19 2022] POST /identity/v3/users => generated 298 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:27:19.731886 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c89e9f-e218-4491-b4c9-0b26ef7cd1d6 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:19.737745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d10b7d-ea96-4b78-91d3-aaaf0bc3e22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:19.738454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d10b7d-ea96-4b78-91d3-aaaf0bc3e22e admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:19.738886 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d10b7d-ea96-4b78-91d3-aaaf0bc3e22e admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:19.739060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d10b7d-ea96-4b78-91d3-aaaf0bc3e22e admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:19.740584 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d10b7d-ea96-4b78-91d3-aaaf0bc3e22e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:19.742690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d10b7d-ea96-4b78-91d3-aaaf0bc3e22e admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:19.762895 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1170/2347] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:27:19.765419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43d8d8-6bd5-4e4e-9ffa-651ed12356aa admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:19.777557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43d8d8-6bd5-4e4e-9ffa-651ed12356aa admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:19.782811 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7c84b-6fd5-4d84-b321-c5961db597c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:19.783890 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7c84b-6fd5-4d84-b321-c5961db597c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:19.784180 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7c84b-6fd5-4d84-b321-c5961db597c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:19.784477 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7c84b-6fd5-4d84-b321-c5961db597c4 admin admin] PATH_INFO: `/v3/projects/d897c4bcd25143bcac69863323eb9fc5/users/6d00a61ef5a641929d04e3bc33ec10ae/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:19.799417 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7c84b-6fd5-4d84-b321-c5961db597c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d897c4bcd25143bcac69863323eb9fc5, user_id=6d00a61ef5a641929d04e3bc33ec10ae, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:19.802592 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7c84b-6fd5-4d84-b321-c5961db597c4 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:19.815122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1178/2348] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:27:19 2022] PUT /identity/v3/projects/d897c4bcd25143bcac69863323eb9fc5/users/6d00a61ef5a641929d04e3bc33ec10ae/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:19.819718 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d10b7d-ea96-4b78-91d3-aaaf0bc3e22e admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:19.829783 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d10b7d-ea96-4b78-91d3-aaaf0bc3e22e admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:19.888573 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f052d4d-21e6-4501-bdde-6cbd7a194452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:19.889167 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f052d4d-21e6-4501-bdde-6cbd7a194452 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:19.889444 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f052d4d-21e6-4501-bdde-6cbd7a194452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:19.889713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f052d4d-21e6-4501-bdde-6cbd7a194452 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:19.890426 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f052d4d-21e6-4501-bdde-6cbd7a194452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:19.892021 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f052d4d-21e6-4501-bdde-6cbd7a194452 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:19.904217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1171/2349] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:27:19.908455 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7c84b-6fd5-4d84-b321-c5961db597c4 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:19.920677 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7c84b-6fd5-4d84-b321-c5961db597c4 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:19.928106 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36560d05-26d8-4032-9685-92afb8f72f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:19.929087 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36560d05-26d8-4032-9685-92afb8f72f85 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:19.929375 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36560d05-26d8-4032-9685-92afb8f72f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:19.929674 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36560d05-26d8-4032-9685-92afb8f72f85 admin admin] PATH_INFO: `/v3/projects/d897c4bcd25143bcac69863323eb9fc5/users/6d00a61ef5a641929d04e3bc33ec10ae/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:19.931721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36560d05-26d8-4032-9685-92afb8f72f85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d897c4bcd25143bcac69863323eb9fc5, user_id=6d00a61ef5a641929d04e3bc33ec10ae, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:19.934717 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36560d05-26d8-4032-9685-92afb8f72f85 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:19.949049 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1179/2350] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:27:19 2022] PUT /identity/v3/projects/d897c4bcd25143bcac69863323eb9fc5/users/6d00a61ef5a641929d04e3bc33ec10ae/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:19.959957 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcce75-3e31-43a5-b082-e88db7dc6102 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:19.960449 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcce75-3e31-43a5-b082-e88db7dc6102 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:19.960564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcce75-3e31-43a5-b082-e88db7dc6102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:20.004183 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-7afcce75-3e31-43a5-b082-e88db7dc6102 None None] MFA Rules not processed for user `6d00a61ef5a641929d04e3bc33ec10ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:20.006010 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-7afcce75-3e31-43a5-b082-e88db7dc6102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:20.135187 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1172/2351] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:20.149402 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36560d05-26d8-4032-9685-92afb8f72f85 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:20.151481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-36560d05-26d8-4032-9685-92afb8f72f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:20.272833 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36560d05-26d8-4032-9685-92afb8f72f85 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:20.277490 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdeb2ee-a8fd-48f5-b634-200321305aad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:20.278813 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdeb2ee-a8fd-48f5-b634-200321305aad service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:20.278813 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdeb2ee-a8fd-48f5-b634-200321305aad service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:20.280084 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdeb2ee-a8fd-48f5-b634-200321305aad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:20.443704 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdeb2ee-a8fd-48f5-b634-200321305aad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:20.445344 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdeb2ee-a8fd-48f5-b634-200321305aad service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:20.459465 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1180/2352] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:27:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:27:22.249460 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcce75-3e31-43a5-b082-e88db7dc6102 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:22.262138 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcce75-3e31-43a5-b082-e88db7dc6102 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:22.269475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b7ce5-61fd-457a-a750-525d50cb5b72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:22.270347 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b7ce5-61fd-457a-a750-525d50cb5b72 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:22.272321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b7ce5-61fd-457a-a750-525d50cb5b72 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:22.272784 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b7ce5-61fd-457a-a750-525d50cb5b72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:22.360663 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b7ce5-61fd-457a-a750-525d50cb5b72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:22.362217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b7ce5-61fd-457a-a750-525d50cb5b72 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:22.374476 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1173/2353] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:27:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:27:22.963381 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdeb2ee-a8fd-48f5-b634-200321305aad service cinder] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:22.975763 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdeb2ee-a8fd-48f5-b634-200321305aad service cinder] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:22.980363 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba522ef-8780-4a03-9636-a7718a31edd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:22.981218 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba522ef-8780-4a03-9636-a7718a31edd3 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:22.981502 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba522ef-8780-4a03-9636-a7718a31edd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:22.981776 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba522ef-8780-4a03-9636-a7718a31edd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:22.991385 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba522ef-8780-4a03-9636-a7718a31edd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:22.992845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba522ef-8780-4a03-9636-a7718a31edd3 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:23.002258 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1181/2354] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:27:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:27:26.858130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b7ce5-61fd-457a-a750-525d50cb5b72 service cinder] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:26.921241 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b7ce5-61fd-457a-a750-525d50cb5b72 service cinder] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:26.925748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ffb6d-81e3-4d5c-833a-cc22114daf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:26.926619 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ffb6d-81e3-4d5c-833a-cc22114daf4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:26.926899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ffb6d-81e3-4d5c-833a-cc22114daf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:26.927181 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ffb6d-81e3-4d5c-833a-cc22114daf4a admin admin] PATH_INFO: `/v3/users/7a3a43a3bc0c4d918cac33f14b0f48d2` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:26.929699 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ffb6d-81e3-4d5c-833a-cc22114daf4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a3a43a3bc0c4d918cac33f14b0f48d2)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:26.931672 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ffb6d-81e3-4d5c-833a-cc22114daf4a admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:26.984170 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-507ffb6d-81e3-4d5c-833a-cc22114daf4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a3a43a3bc0c4d918cac33f14b0f48d2'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:27.001572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-507ffb6d-81e3-4d5c-833a-cc22114daf4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a3a43a3bc0c4d918cac33f14b0f48d2'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:27.010677 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-507ffb6d-81e3-4d5c-833a-cc22114daf4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a3a43a3bc0c4d918cac33f14b0f48d2'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:27.011675 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-507ffb6d-81e3-4d5c-833a-cc22114daf4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a3a43a3bc0c4d918cac33f14b0f48d2'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:27.023361 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-507ffb6d-81e3-4d5c-833a-cc22114daf4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a3a43a3bc0c4d918cac33f14b0f48d2'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:27.034937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1174/2355] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:27:26 2022] DELETE /identity/v3/users/7a3a43a3bc0c4d918cac33f14b0f48d2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:27.039602 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb196d9c-97b6-4da7-9c82-4733eda9ff1b None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:27.040083 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb196d9c-97b6-4da7-9c82-4733eda9ff1b None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:27.040221 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb196d9c-97b6-4da7-9c82-4733eda9ff1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:27.057367 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-bb196d9c-97b6-4da7-9c82-4733eda9ff1b None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:27.058829 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-bb196d9c-97b6-4da7-9c82-4733eda9ff1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:27.133865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1182/2356] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:27:27.144017 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ffb6d-81e3-4d5c-833a-cc22114daf4a admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:27.145866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-507ffb6d-81e3-4d5c-833a-cc22114daf4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:27.203717 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ffb6d-81e3-4d5c-833a-cc22114daf4a admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:27.207370 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27840e-fb09-4041-876c-cdac30f60a1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:27.208020 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27840e-fb09-4041-876c-cdac30f60a1d service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:27.208346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27840e-fb09-4041-876c-cdac30f60a1d service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:27.208622 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27840e-fb09-4041-876c-cdac30f60a1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:27.219174 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27840e-fb09-4041-876c-cdac30f60a1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:27.220707 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27840e-fb09-4041-876c-cdac30f60a1d service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:27.230931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1175/2357] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:27:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:27:27.487600 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb196d9c-97b6-4da7-9c82-4733eda9ff1b None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:27.489135 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-bb196d9c-97b6-4da7-9c82-4733eda9ff1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:27.502810 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb196d9c-97b6-4da7-9c82-4733eda9ff1b None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:27.508207 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d6819-8054-4bd5-a4e9-94b899168c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:27.509083 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d6819-8054-4bd5-a4e9-94b899168c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:27.509536 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d6819-8054-4bd5-a4e9-94b899168c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:27.509817 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d6819-8054-4bd5-a4e9-94b899168c52 admin admin] PATH_INFO: `/v3/projects/8e62b490ec474700814aa4880b0d0a96` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:27.511023 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d6819-8054-4bd5-a4e9-94b899168c52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e62b490ec474700814aa4880b0d0a96)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:27.512981 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d6819-8054-4bd5-a4e9-94b899168c52 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:27.563039 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b85d6819-8054-4bd5-a4e9-94b899168c52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e62b490ec474700814aa4880b0d0a96', 'request_id': 'req-b85d6819-8054-4bd5-a4e9-94b899168c52'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:27.571804 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b85d6819-8054-4bd5-a4e9-94b899168c52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e62b490ec474700814aa4880b0d0a96', 'request_id': 'req-b85d6819-8054-4bd5-a4e9-94b899168c52'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:27.578276 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b85d6819-8054-4bd5-a4e9-94b899168c52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e62b490ec474700814aa4880b0d0a96', 'request_id': 'req-b85d6819-8054-4bd5-a4e9-94b899168c52'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:27.588707 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b85d6819-8054-4bd5-a4e9-94b899168c52 admin admin] The token cache is being invalidate because project 8e62b490ec474700814aa4880b0d0a96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:27:27.588989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b85d6819-8054-4bd5-a4e9-94b899168c52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:27.589628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b85d6819-8054-4bd5-a4e9-94b899168c52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:27.592177 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1183/2358] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:27:27 2022] DELETE /identity/v3/projects/8e62b490ec474700814aa4880b0d0a96 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:27.594988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27840e-fb09-4041-876c-cdac30f60a1d service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:27.605580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27840e-fb09-4041-876c-cdac30f60a1d service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:27.673694 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3e7d4-5852-410b-8dca-34c49595bfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:27.674565 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3e7d4-5852-410b-8dca-34c49595bfb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:27.674844 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3e7d4-5852-410b-8dca-34c49595bfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:27.675121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3e7d4-5852-410b-8dca-34c49595bfb1 admin admin] PATH_INFO: `/v3/users/7915d69ceca24d5d885944ebb9dcf7a8` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:27.676353 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3e7d4-5852-410b-8dca-34c49595bfb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7915d69ceca24d5d885944ebb9dcf7a8)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:27.678993 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3e7d4-5852-410b-8dca-34c49595bfb1 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:27.728985 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-2cf3e7d4-5852-410b-8dca-34c49595bfb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7915d69ceca24d5d885944ebb9dcf7a8'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:27.740332 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-2cf3e7d4-5852-410b-8dca-34c49595bfb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7915d69ceca24d5d885944ebb9dcf7a8'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:27.747764 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-2cf3e7d4-5852-410b-8dca-34c49595bfb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7915d69ceca24d5d885944ebb9dcf7a8'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:27.748485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-2cf3e7d4-5852-410b-8dca-34c49595bfb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7915d69ceca24d5d885944ebb9dcf7a8'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:27.755674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-2cf3e7d4-5852-410b-8dca-34c49595bfb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7915d69ceca24d5d885944ebb9dcf7a8'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:27.763263 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1176/2359] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:27:27 2022] DELETE /identity/v3/users/7915d69ceca24d5d885944ebb9dcf7a8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:28.029692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d6819-8054-4bd5-a4e9-94b899168c52 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:28.031208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-b85d6819-8054-4bd5-a4e9-94b899168c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:28.046816 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d6819-8054-4bd5-a4e9-94b899168c52 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:28.104719 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a8b76-0162-4857-b0d4-15778049b50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:28.105569 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a8b76-0162-4857-b0d4-15778049b50c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:28.105849 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a8b76-0162-4857-b0d4-15778049b50c admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:28.106122 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a8b76-0162-4857-b0d4-15778049b50c admin admin] PATH_INFO: `/v3/projects/096e6b321e3f43249fa2562fd6cd6155` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:28.107282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a8b76-0162-4857-b0d4-15778049b50c admin admin] RBAC: Authorizing `identity:delete_project(project_id=096e6b321e3f43249fa2562fd6cd6155)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:28.109265 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a8b76-0162-4857-b0d4-15778049b50c admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:28.154248 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f34a8b76-0162-4857-b0d4-15778049b50c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '096e6b321e3f43249fa2562fd6cd6155', 'request_id': 'req-f34a8b76-0162-4857-b0d4-15778049b50c'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:28.161437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f34a8b76-0162-4857-b0d4-15778049b50c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '096e6b321e3f43249fa2562fd6cd6155', 'request_id': 'req-f34a8b76-0162-4857-b0d4-15778049b50c'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:28.168268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f34a8b76-0162-4857-b0d4-15778049b50c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '096e6b321e3f43249fa2562fd6cd6155', 'request_id': 'req-f34a8b76-0162-4857-b0d4-15778049b50c'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:28.179396 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f34a8b76-0162-4857-b0d4-15778049b50c admin admin] The token cache is being invalidate because project 096e6b321e3f43249fa2562fd6cd6155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:27:28.179825 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f34a8b76-0162-4857-b0d4-15778049b50c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:28.180501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f34a8b76-0162-4857-b0d4-15778049b50c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:28.184924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1184/2360] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:27:28 2022] DELETE /identity/v3/projects/096e6b321e3f43249fa2562fd6cd6155 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:28.186239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3e7d4-5852-410b-8dca-34c49595bfb1 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:28.187652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-2cf3e7d4-5852-410b-8dca-34c49595bfb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:28.201616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3e7d4-5852-410b-8dca-34c49595bfb1 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:28.266937 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df62ab-7c65-4ac7-80a4-4e99ee42472a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:28.267826 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df62ab-7c65-4ac7-80a4-4e99ee42472a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:28.268414 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df62ab-7c65-4ac7-80a4-4e99ee42472a admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:28.268691 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df62ab-7c65-4ac7-80a4-4e99ee42472a admin admin] PATH_INFO: `/v3/users/6d00a61ef5a641929d04e3bc33ec10ae` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:28.269918 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df62ab-7c65-4ac7-80a4-4e99ee42472a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d00a61ef5a641929d04e3bc33ec10ae)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:28.271959 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df62ab-7c65-4ac7-80a4-4e99ee42472a admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:28.319134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-66df62ab-7c65-4ac7-80a4-4e99ee42472a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d00a61ef5a641929d04e3bc33ec10ae'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:28.330508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-66df62ab-7c65-4ac7-80a4-4e99ee42472a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d00a61ef5a641929d04e3bc33ec10ae'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:28.337753 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-66df62ab-7c65-4ac7-80a4-4e99ee42472a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d00a61ef5a641929d04e3bc33ec10ae'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:28.338471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-66df62ab-7c65-4ac7-80a4-4e99ee42472a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d00a61ef5a641929d04e3bc33ec10ae'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:28.345929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-66df62ab-7c65-4ac7-80a4-4e99ee42472a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d00a61ef5a641929d04e3bc33ec10ae'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:28.353135 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1177/2361] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:27:28 2022] DELETE /identity/v3/users/6d00a61ef5a641929d04e3bc33ec10ae => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:28.637360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a8b76-0162-4857-b0d4-15778049b50c admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:28.638908 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f34a8b76-0162-4857-b0d4-15778049b50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:28.654193 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a8b76-0162-4857-b0d4-15778049b50c admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:28.735057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b822c-a046-4b9b-a3f3-3f2e0eee6661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:28.735952 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b822c-a046-4b9b-a3f3-3f2e0eee6661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:28.736279 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b822c-a046-4b9b-a3f3-3f2e0eee6661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:28.736551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b822c-a046-4b9b-a3f3-3f2e0eee6661 admin admin] PATH_INFO: `/v3/projects/d897c4bcd25143bcac69863323eb9fc5` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:28.737821 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b822c-a046-4b9b-a3f3-3f2e0eee6661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d897c4bcd25143bcac69863323eb9fc5)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:28.739755 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b822c-a046-4b9b-a3f3-3f2e0eee6661 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:28.805294 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-002b822c-a046-4b9b-a3f3-3f2e0eee6661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd897c4bcd25143bcac69863323eb9fc5', 'request_id': 'req-002b822c-a046-4b9b-a3f3-3f2e0eee6661'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:28.813540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-002b822c-a046-4b9b-a3f3-3f2e0eee6661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd897c4bcd25143bcac69863323eb9fc5', 'request_id': 'req-002b822c-a046-4b9b-a3f3-3f2e0eee6661'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:28.822820 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-002b822c-a046-4b9b-a3f3-3f2e0eee6661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd897c4bcd25143bcac69863323eb9fc5', 'request_id': 'req-002b822c-a046-4b9b-a3f3-3f2e0eee6661'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:28.859564 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-002b822c-a046-4b9b-a3f3-3f2e0eee6661 admin admin] The token cache is being invalidate because project d897c4bcd25143bcac69863323eb9fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:27:28.859564 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-002b822c-a046-4b9b-a3f3-3f2e0eee6661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:28.859564 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-002b822c-a046-4b9b-a3f3-3f2e0eee6661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:28.862280 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1185/2362] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:27:28 2022] DELETE /identity/v3/projects/d897c4bcd25143bcac69863323eb9fc5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:28.868331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34c3f1-1eca-4d86-beb3-5a31a6e39a3f None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:28.869056 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34c3f1-1eca-4d86-beb3-5a31a6e39a3f None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:28.869542 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34c3f1-1eca-4d86-beb3-5a31a6e39a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:28.897511 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-2a34c3f1-1eca-4d86-beb3-5a31a6e39a3f None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:28.899341 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-2a34c3f1-1eca-4d86-beb3-5a31a6e39a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:28.961862 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1178/2363] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:28.970658 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbc2f3-4494-4730-8868-063c31c32cb7 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:28.970995 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbc2f3-4494-4730-8868-063c31c32cb7 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:28.971309 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbc2f3-4494-4730-8868-063c31c32cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:28.991448 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-cbfbc2f3-4494-4730-8868-063c31c32cb7 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:28.993205 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-cbfbc2f3-4494-4730-8868-063c31c32cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:29.001832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1186/2364] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:27:29.006730 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34c3f1-1eca-4d86-beb3-5a31a6e39a3f None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:29.016942 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34c3f1-1eca-4d86-beb3-5a31a6e39a3f None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:29.023274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2004e2-2e24-4904-8e92-a9ca31a071a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:29.023948 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2004e2-2e24-4904-8e92-a9ca31a071a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:29.024267 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2004e2-2e24-4904-8e92-a9ca31a071a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:29.024540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2004e2-2e24-4904-8e92-a9ca31a071a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:29.025267 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2004e2-2e24-4904-8e92-a9ca31a071a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:27:29.025577 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2004e2-2e24-4904-8e92-a9ca31a071a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:29.027160 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2004e2-2e24-4904-8e92-a9ca31a071a2 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:29.038934 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1179/2365] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:27:29.043322 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbc2f3-4494-4730-8868-063c31c32cb7 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:29.052404 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbc2f3-4494-4730-8868-063c31c32cb7 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:29.057291 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5b212-5663-4e7a-b52a-d46022da463c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:29.057939 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5b212-5663-4e7a-b52a-d46022da463c admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:29.058219 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5b212-5663-4e7a-b52a-d46022da463c admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:29.058492 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5b212-5663-4e7a-b52a-d46022da463c admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:29.059204 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5b212-5663-4e7a-b52a-d46022da463c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:29.061162 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5b212-5663-4e7a-b52a-d46022da463c admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:29.090523 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1187/2366] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:27:29 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:27:29.091668 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2004e2-2e24-4904-8e92-a9ca31a071a2 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:29.101862 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2004e2-2e24-4904-8e92-a9ca31a071a2 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:29.159194 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebfbdc-8002-4b47-a286-a891085076cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:29.159872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebfbdc-8002-4b47-a286-a891085076cf admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:29.160183 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebfbdc-8002-4b47-a286-a891085076cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:29.160465 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebfbdc-8002-4b47-a286-a891085076cf admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:29.161148 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebfbdc-8002-4b47-a286-a891085076cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:29.163730 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebfbdc-8002-4b47-a286-a891085076cf admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:29.187348 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1180/2367] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:27:29 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:27:29.188594 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5b212-5663-4e7a-b52a-d46022da463c admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:29.199121 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5b212-5663-4e7a-b52a-d46022da463c admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:29.203829 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e08e9-737d-40dc-91be-55f68dd2c029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:29.204510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e08e9-737d-40dc-91be-55f68dd2c029 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:29.204796 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e08e9-737d-40dc-91be-55f68dd2c029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:29.205072 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e08e9-737d-40dc-91be-55f68dd2c029 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:29.205797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e08e9-737d-40dc-91be-55f68dd2c029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:29.207455 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e08e9-737d-40dc-91be-55f68dd2c029 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:29.218484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1188/2368] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:27:29.222492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebfbdc-8002-4b47-a286-a891085076cf admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:29.233269 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebfbdc-8002-4b47-a286-a891085076cf admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:29.238105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da4546-d5b9-4d8c-bc89-30b37d8dee11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:29.238786 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da4546-d5b9-4d8c-bc89-30b37d8dee11 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:29.239066 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da4546-d5b9-4d8c-bc89-30b37d8dee11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:29.239342 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da4546-d5b9-4d8c-bc89-30b37d8dee11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:29.240073 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da4546-d5b9-4d8c-bc89-30b37d8dee11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:29.241917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da4546-d5b9-4d8c-bc89-30b37d8dee11 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:29.251784 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1181/2369] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:27:29.255845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e08e9-737d-40dc-91be-55f68dd2c029 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:29.265794 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e08e9-737d-40dc-91be-55f68dd2c029 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:29.270820 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d577c03-aad8-4aef-bd6a-e5f8934268dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:29.271685 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d577c03-aad8-4aef-bd6a-e5f8934268dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:29.272636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d577c03-aad8-4aef-bd6a-e5f8934268dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:29.273126 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d577c03-aad8-4aef-bd6a-e5f8934268dd admin admin] PATH_INFO: `/v3/projects/9c33ef70308d4549bc6c7c69f6d2236d/users/defe86e55cef45bb940731bedd6efe5a/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:29.288537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d577c03-aad8-4aef-bd6a-e5f8934268dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c33ef70308d4549bc6c7c69f6d2236d, user_id=defe86e55cef45bb940731bedd6efe5a, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:29.291196 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d577c03-aad8-4aef-bd6a-e5f8934268dd admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:29.304810 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1189/2370] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:27:29 2022] PUT /identity/v3/projects/9c33ef70308d4549bc6c7c69f6d2236d/users/defe86e55cef45bb940731bedd6efe5a/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:27:29.314830 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd74919-e883-4263-8c94-364c579b80ff None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:29.315123 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd74919-e883-4263-8c94-364c579b80ff None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:29.315401 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd74919-e883-4263-8c94-364c579b80ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:29.341704 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-efd74919-e883-4263-8c94-364c579b80ff None None] MFA Rules not processed for user `defe86e55cef45bb940731bedd6efe5a`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:29.342881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-efd74919-e883-4263-8c94-364c579b80ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:29.415655 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1182/2371] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:29.426555 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d577c03-aad8-4aef-bd6a-e5f8934268dd admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:29.428795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-6d577c03-aad8-4aef-bd6a-e5f8934268dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:29.492801 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d577c03-aad8-4aef-bd6a-e5f8934268dd admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:29.496368 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde0d11-b640-4b06-9a82-8493949530b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:29.497003 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde0d11-b640-4b06-9a82-8493949530b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:29.497278 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde0d11-b640-4b06-9a82-8493949530b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:29.497546 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde0d11-b640-4b06-9a82-8493949530b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:29.505679 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde0d11-b640-4b06-9a82-8493949530b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:29.508191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde0d11-b640-4b06-9a82-8493949530b2 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:29.516463 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1190/2372] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:27:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:27:35.651506 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48988bd-2cbc-4eae-8b4b-d76dd5f98b08 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:35.652695 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48988bd-2cbc-4eae-8b4b-d76dd5f98b08 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:35.653052 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48988bd-2cbc-4eae-8b4b-d76dd5f98b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:35.715569 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-c48988bd-2cbc-4eae-8b4b-d76dd5f98b08 None None] MFA Rules not processed for user `38a56f3572874938ad4642fa34751a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:35.717059 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-c48988bd-2cbc-4eae-8b4b-d76dd5f98b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:35.793943 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1183/2373] 10.222.0.71 () {58 vars in 1009 bytes} [Mon May 16 20:27:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:35.862291 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde0d11-b640-4b06-9a82-8493949530b2 service cinder] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:35.864365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-ccde0d11-b640-4b06-9a82-8493949530b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:35.994211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde0d11-b640-4b06-9a82-8493949530b2 service cinder] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:36.004029 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5805bd4-5b29-4d75-8d5a-e1eb1059e254 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e701cf55d13410aa259ec72578ed27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:36.004831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5805bd4-5b29-4d75-8d5a-e1eb1059e254 service swift] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:36.005182 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5805bd4-5b29-4d75-8d5a-e1eb1059e254 service swift] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:36.005588 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5805bd4-5b29-4d75-8d5a-e1eb1059e254 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:36.019589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5805bd4-5b29-4d75-8d5a-e1eb1059e254 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:36.022250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5805bd4-5b29-4d75-8d5a-e1eb1059e254 service swift] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:36.032573 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1191/2374] 10.222.0.71 () {60 vars in 1384 bytes} [Mon May 16 20:27:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:27:39.149757 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48988bd-2cbc-4eae-8b4b-d76dd5f98b08 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:39.152878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-c48988bd-2cbc-4eae-8b4b-d76dd5f98b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:39.231103 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48988bd-2cbc-4eae-8b4b-d76dd5f98b08 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:39.234877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883ed45-c277-4fa7-b39e-48eebed39ede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:39.235753 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883ed45-c277-4fa7-b39e-48eebed39ede service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:39.236596 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883ed45-c277-4fa7-b39e-48eebed39ede service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:39.237063 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883ed45-c277-4fa7-b39e-48eebed39ede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:39.240806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-7883ed45-c277-4fa7-b39e-48eebed39ede service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:39.363080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883ed45-c277-4fa7-b39e-48eebed39ede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:39.365015 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883ed45-c277-4fa7-b39e-48eebed39ede service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:39.378160 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1184/2375] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:27:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:27:40.783532 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5805bd4-5b29-4d75-8d5a-e1eb1059e254 service swift] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:40.785375 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-e5805bd4-5b29-4d75-8d5a-e1eb1059e254 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:40.867260 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5805bd4-5b29-4d75-8d5a-e1eb1059e254 service swift] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:40.872447 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bb160-8a93-4811-a8a2-f52ea57499a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:40.873556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bb160-8a93-4811-a8a2-f52ea57499a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:40.873823 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bb160-8a93-4811-a8a2-f52ea57499a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:40.874254 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bb160-8a93-4811-a8a2-f52ea57499a8 admin admin] PATH_INFO: `/v3/users/129bbf5a3c374d17b2f32d8fed8e0950` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:40.875605 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358bb160-8a93-4811-a8a2-f52ea57499a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=129bbf5a3c374d17b2f32d8fed8e0950)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:40.877971 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358bb160-8a93-4811-a8a2-f52ea57499a8 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:40.949108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-358bb160-8a93-4811-a8a2-f52ea57499a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '129bbf5a3c374d17b2f32d8fed8e0950'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:40.950054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-358bb160-8a93-4811-a8a2-f52ea57499a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '129bbf5a3c374d17b2f32d8fed8e0950'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:40.957913 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-358bb160-8a93-4811-a8a2-f52ea57499a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '129bbf5a3c374d17b2f32d8fed8e0950'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:40.973716 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-358bb160-8a93-4811-a8a2-f52ea57499a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '129bbf5a3c374d17b2f32d8fed8e0950'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:40.995225 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-358bb160-8a93-4811-a8a2-f52ea57499a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '129bbf5a3c374d17b2f32d8fed8e0950'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:41.002880 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1192/2376] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:27:40 2022] DELETE /identity/v3/users/129bbf5a3c374d17b2f32d8fed8e0950 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:41.007988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b1840-ac53-4835-8ed9-f4fca382b8ba None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:41.008584 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b1840-ac53-4835-8ed9-f4fca382b8ba None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:41.008836 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b1840-ac53-4835-8ed9-f4fca382b8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:41.038957 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-672b1840-ac53-4835-8ed9-f4fca382b8ba None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:41.040853 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-672b1840-ac53-4835-8ed9-f4fca382b8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:41.113989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1185/2377] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:41.126390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bb160-8a93-4811-a8a2-f52ea57499a8 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:41.127924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-358bb160-8a93-4811-a8a2-f52ea57499a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:41.208126 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bb160-8a93-4811-a8a2-f52ea57499a8 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:41.212738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644574a-e0fb-4593-94f1-73a70d3706fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:41.213385 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644574a-e0fb-4593-94f1-73a70d3706fe service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:41.213664 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644574a-e0fb-4593-94f1-73a70d3706fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:41.214067 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644574a-e0fb-4593-94f1-73a70d3706fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:41.225709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644574a-e0fb-4593-94f1-73a70d3706fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:41.233306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644574a-e0fb-4593-94f1-73a70d3706fe service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:41.252993 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1193/2378] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:27:41.623781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b1840-ac53-4835-8ed9-f4fca382b8ba None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:41.625668 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-672b1840-ac53-4835-8ed9-f4fca382b8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:41.644196 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b1840-ac53-4835-8ed9-f4fca382b8ba None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:41.652407 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672096f9-538b-44cf-8030-bf8afbabb10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:41.654047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672096f9-538b-44cf-8030-bf8afbabb10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:41.655515 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672096f9-538b-44cf-8030-bf8afbabb10c admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:41.656130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672096f9-538b-44cf-8030-bf8afbabb10c admin admin] PATH_INFO: `/v3/projects/64ecc58f6a5e4ef0be34b3da415dfdcb` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:41.658236 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672096f9-538b-44cf-8030-bf8afbabb10c admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ecc58f6a5e4ef0be34b3da415dfdcb)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:41.666001 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672096f9-538b-44cf-8030-bf8afbabb10c admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:41.763044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-672096f9-538b-44cf-8030-bf8afbabb10c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ecc58f6a5e4ef0be34b3da415dfdcb', 'request_id': 'req-672096f9-538b-44cf-8030-bf8afbabb10c'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:41.780799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-672096f9-538b-44cf-8030-bf8afbabb10c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ecc58f6a5e4ef0be34b3da415dfdcb', 'request_id': 'req-672096f9-538b-44cf-8030-bf8afbabb10c'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:41.801569 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-672096f9-538b-44cf-8030-bf8afbabb10c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ecc58f6a5e4ef0be34b3da415dfdcb', 'request_id': 'req-672096f9-538b-44cf-8030-bf8afbabb10c'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:41.818901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-672096f9-538b-44cf-8030-bf8afbabb10c admin admin] The token cache is being invalidate because project 64ecc58f6a5e4ef0be34b3da415dfdcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:27:41.819337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-672096f9-538b-44cf-8030-bf8afbabb10c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:41.820301 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-672096f9-538b-44cf-8030-bf8afbabb10c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:41.825254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1186/2379] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:27:41 2022] DELETE /identity/v3/projects/64ecc58f6a5e4ef0be34b3da415dfdcb => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:41.826994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81757fb7-1fa7-497f-9fdb-8a6f25b441e8 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:41.827466 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81757fb7-1fa7-497f-9fdb-8a6f25b441e8 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:41.827584 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81757fb7-1fa7-497f-9fdb-8a6f25b441e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:41.882549 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-81757fb7-1fa7-497f-9fdb-8a6f25b441e8 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:41.884026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-81757fb7-1fa7-497f-9fdb-8a6f25b441e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:41.992884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1194/2380] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:42.001492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd5aa2-9d3e-4ffe-b5ca-97800597d7bc None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:42.002158 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd5aa2-9d3e-4ffe-b5ca-97800597d7bc None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:42.002635 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd5aa2-9d3e-4ffe-b5ca-97800597d7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:42.029510 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-02dd5aa2-9d3e-4ffe-b5ca-97800597d7bc None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:42.031508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-02dd5aa2-9d3e-4ffe-b5ca-97800597d7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:42.044689 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1187/2381] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:42.048762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81757fb7-1fa7-497f-9fdb-8a6f25b441e8 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:42.061801 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81757fb7-1fa7-497f-9fdb-8a6f25b441e8 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:42.069632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6417f-9010-42c7-b7cf-7585ad29ad35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:42.073211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6417f-9010-42c7-b7cf-7585ad29ad35 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:42.073680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6417f-9010-42c7-b7cf-7585ad29ad35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:42.074117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6417f-9010-42c7-b7cf-7585ad29ad35 admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:42.075497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6417f-9010-42c7-b7cf-7585ad29ad35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:27:42.075977 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6417f-9010-42c7-b7cf-7585ad29ad35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:42.079532 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6417f-9010-42c7-b7cf-7585ad29ad35 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:42.102973 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1195/2382] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:27:42.107124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd5aa2-9d3e-4ffe-b5ca-97800597d7bc None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:42.123200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd5aa2-9d3e-4ffe-b5ca-97800597d7bc None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:42.135482 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8948213-80a0-4b97-b0c5-5a64c9e526d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:42.136329 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8948213-80a0-4b97-b0c5-5a64c9e526d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:42.136648 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8948213-80a0-4b97-b0c5-5a64c9e526d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:42.136930 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8948213-80a0-4b97-b0c5-5a64c9e526d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:42.137643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8948213-80a0-4b97-b0c5-5a64c9e526d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:42.139564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8948213-80a0-4b97-b0c5-5a64c9e526d1 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:42.190106 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1188/2383] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:27:42 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:27:42.194522 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6417f-9010-42c7-b7cf-7585ad29ad35 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:42.213338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6417f-9010-42c7-b7cf-7585ad29ad35 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:42.326095 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b52fd-816b-4c89-b910-0dcf34e896dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:42.327260 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b52fd-816b-4c89-b910-0dcf34e896dd admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:42.327618 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b52fd-816b-4c89-b910-0dcf34e896dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:42.328076 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b52fd-816b-4c89-b910-0dcf34e896dd admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:42.328867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b52fd-816b-4c89-b910-0dcf34e896dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:42.331208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b52fd-816b-4c89-b910-0dcf34e896dd admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:42.379148 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1196/2384] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:27:42 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:27:42.383695 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8948213-80a0-4b97-b0c5-5a64c9e526d1 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:42.398428 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8948213-80a0-4b97-b0c5-5a64c9e526d1 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:42.405523 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02181e2b-9122-43c7-8801-8378d25b313c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:42.408640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02181e2b-9122-43c7-8801-8378d25b313c admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:42.409108 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02181e2b-9122-43c7-8801-8378d25b313c admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:42.410026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02181e2b-9122-43c7-8801-8378d25b313c admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:42.411573 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02181e2b-9122-43c7-8801-8378d25b313c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:42.415426 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02181e2b-9122-43c7-8801-8378d25b313c admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:42.429979 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1189/2385] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:27:42.434063 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b52fd-816b-4c89-b910-0dcf34e896dd admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:42.447115 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02181e2b-9122-43c7-8801-8378d25b313c admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:42.450971 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b52fd-816b-4c89-b910-0dcf34e896dd admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:42.451227 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-02181e2b-9122-43c7-8801-8378d25b313c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:42.457737 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13296b-68ac-47c1-9731-c9348bd35e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:42.458411 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13296b-68ac-47c1-9731-c9348bd35e9f admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:42.458701 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13296b-68ac-47c1-9731-c9348bd35e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:42.459561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13296b-68ac-47c1-9731-c9348bd35e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:42.460331 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13296b-68ac-47c1-9731-c9348bd35e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:42.462001 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13296b-68ac-47c1-9731-c9348bd35e9f admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:42.471654 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02181e2b-9122-43c7-8801-8378d25b313c admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:42.479461 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1197/2386] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:27:42.480545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13296b-68ac-47c1-9731-c9348bd35e9f admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:42.481104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55f5d5-2868-4f4a-997d-e6e5a947ad2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:42.482815 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55f5d5-2868-4f4a-997d-e6e5a947ad2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:42.483389 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55f5d5-2868-4f4a-997d-e6e5a947ad2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:42.483822 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55f5d5-2868-4f4a-997d-e6e5a947ad2a admin admin] PATH_INFO: `/v3/users/defe86e55cef45bb940731bedd6efe5a` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:42.486006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55f5d5-2868-4f4a-997d-e6e5a947ad2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=defe86e55cef45bb940731bedd6efe5a)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:42.489899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55f5d5-2868-4f4a-997d-e6e5a947ad2a admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:42.491546 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13296b-68ac-47c1-9731-c9348bd35e9f admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:42.496511 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70f8f4-5fba-462b-8f90-9b653e3744e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:42.497399 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70f8f4-5fba-462b-8f90-9b653e3744e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:42.497681 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70f8f4-5fba-462b-8f90-9b653e3744e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:42.497958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70f8f4-5fba-462b-8f90-9b653e3744e8 admin admin] PATH_INFO: `/v3/projects/0966cdee10bc4eebbb38ae04e066adf2/users/e7f77ef8223e4a64a6b72524e71f88e0/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:42.519726 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70f8f4-5fba-462b-8f90-9b653e3744e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0966cdee10bc4eebbb38ae04e066adf2, user_id=e7f77ef8223e4a64a6b72524e71f88e0, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:42.524551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70f8f4-5fba-462b-8f90-9b653e3744e8 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:42.553246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1198/2387] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:27:42 2022] PUT /identity/v3/projects/0966cdee10bc4eebbb38ae04e066adf2/users/e7f77ef8223e4a64a6b72524e71f88e0/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:42.554969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e842f47-7f99-493f-a32c-63123c8588f1 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:42.555384 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e842f47-7f99-493f-a32c-63123c8588f1 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:42.555662 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e842f47-7f99-493f-a32c-63123c8588f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:42.562224 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9e55f5d5-2868-4f4a-997d-e6e5a947ad2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'defe86e55cef45bb940731bedd6efe5a'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:42.578082 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-6e842f47-7f99-493f-a32c-63123c8588f1 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:42.581919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-6e842f47-7f99-493f-a32c-63123c8588f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:42.593459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9e55f5d5-2868-4f4a-997d-e6e5a947ad2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'defe86e55cef45bb940731bedd6efe5a'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:42.603572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9e55f5d5-2868-4f4a-997d-e6e5a947ad2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'defe86e55cef45bb940731bedd6efe5a'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:42.604685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9e55f5d5-2868-4f4a-997d-e6e5a947ad2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'defe86e55cef45bb940731bedd6efe5a'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:42.639819 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9e55f5d5-2868-4f4a-997d-e6e5a947ad2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'defe86e55cef45bb940731bedd6efe5a'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:42.655047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1190/2388] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:27:42 2022] DELETE /identity/v3/users/defe86e55cef45bb940731bedd6efe5a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:27:42.656964 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87260c07-c32b-4389-b436-4be386b44050 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:42.657608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87260c07-c32b-4389-b436-4be386b44050 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:42.657608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87260c07-c32b-4389-b436-4be386b44050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:42.695608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-87260c07-c32b-4389-b436-4be386b44050 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:42.697587 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-87260c07-c32b-4389-b436-4be386b44050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:42.712791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1199/2389] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:42.721530 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e842f47-7f99-493f-a32c-63123c8588f1 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:42.730913 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-6e842f47-7f99-493f-a32c-63123c8588f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:42.815699 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e842f47-7f99-493f-a32c-63123c8588f1 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:42.824007 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1191/2390] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:42.831858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87260c07-c32b-4389-b436-4be386b44050 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:42.833982 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-87260c07-c32b-4389-b436-4be386b44050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:42.879769 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d451b-76e0-4e4d-86df-9457f060d0b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:42.880792 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d451b-76e0-4e4d-86df-9457f060d0b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:42.881741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d451b-76e0-4e4d-86df-9457f060d0b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:42.882188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d451b-76e0-4e4d-86df-9457f060d0b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:42.892411 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d451b-76e0-4e4d-86df-9457f060d0b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:42.894228 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d451b-76e0-4e4d-86df-9457f060d0b9 service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:42.905901 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1200/2391] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:27:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:27:42.909578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87260c07-c32b-4389-b436-4be386b44050 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:42.913523 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dc909-275b-47cb-9cbf-a76542005cdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:42.914316 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dc909-275b-47cb-9cbf-a76542005cdb service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:42.914666 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dc909-275b-47cb-9cbf-a76542005cdb service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:42.915429 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dc909-275b-47cb-9cbf-a76542005cdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:42.933121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488dc909-275b-47cb-9cbf-a76542005cdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:42.934583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488dc909-275b-47cb-9cbf-a76542005cdb service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:42.948624 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1192/2392] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:27:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:27:43.411155 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d451b-76e0-4e4d-86df-9457f060d0b9 service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:43.413037 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-9b6d451b-76e0-4e4d-86df-9457f060d0b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:43.440784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d451b-76e0-4e4d-86df-9457f060d0b9 service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:43.455311 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eebcf6-12f1-4b8d-a5e3-69f376d74fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:43.456297 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eebcf6-12f1-4b8d-a5e3-69f376d74fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:43.456585 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eebcf6-12f1-4b8d-a5e3-69f376d74fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:43.456860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eebcf6-12f1-4b8d-a5e3-69f376d74fcb admin admin] PATH_INFO: `/v3/projects/9c33ef70308d4549bc6c7c69f6d2236d` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:43.458204 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eebcf6-12f1-4b8d-a5e3-69f376d74fcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c33ef70308d4549bc6c7c69f6d2236d)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:43.461129 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eebcf6-12f1-4b8d-a5e3-69f376d74fcb admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:43.531567 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-89eebcf6-12f1-4b8d-a5e3-69f376d74fcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c33ef70308d4549bc6c7c69f6d2236d', 'request_id': 'req-89eebcf6-12f1-4b8d-a5e3-69f376d74fcb'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:43.536488 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-89eebcf6-12f1-4b8d-a5e3-69f376d74fcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c33ef70308d4549bc6c7c69f6d2236d', 'request_id': 'req-89eebcf6-12f1-4b8d-a5e3-69f376d74fcb'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:43.545134 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-89eebcf6-12f1-4b8d-a5e3-69f376d74fcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c33ef70308d4549bc6c7c69f6d2236d', 'request_id': 'req-89eebcf6-12f1-4b8d-a5e3-69f376d74fcb'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:43.558205 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-89eebcf6-12f1-4b8d-a5e3-69f376d74fcb admin admin] The token cache is being invalidate because project 9c33ef70308d4549bc6c7c69f6d2236d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:27:43.558755 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-89eebcf6-12f1-4b8d-a5e3-69f376d74fcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:43.560107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-89eebcf6-12f1-4b8d-a5e3-69f376d74fcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:27:43.562147 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1201/2393] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:27:43 2022] DELETE /identity/v3/projects/9c33ef70308d4549bc6c7c69f6d2236d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:48.482543 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c2ef9-3c66-4bf2-9855-db4105577fe4 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:48.483145 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c2ef9-3c66-4bf2-9855-db4105577fe4 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:48.483145 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c2ef9-3c66-4bf2-9855-db4105577fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:48.515044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-810c2ef9-3c66-4bf2-9855-db4105577fe4 None None] MFA Rules not processed for user `e7f77ef8223e4a64a6b72524e71f88e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:48.516278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-810c2ef9-3c66-4bf2-9855-db4105577fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:48.601093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1193/2394] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:48.604509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eebcf6-12f1-4b8d-a5e3-69f376d74fcb admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:48.606546 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-89eebcf6-12f1-4b8d-a5e3-69f376d74fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:48.694736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eebcf6-12f1-4b8d-a5e3-69f376d74fcb admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:48.700039 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586d957-0bad-45e6-9ef6-d188008fd2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:48.700821 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586d957-0bad-45e6-9ef6-d188008fd2af admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:48.701208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586d957-0bad-45e6-9ef6-d188008fd2af admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:48.701546 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586d957-0bad-45e6-9ef6-d188008fd2af admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:48.702334 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586d957-0bad-45e6-9ef6-d188008fd2af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:48.704397 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586d957-0bad-45e6-9ef6-d188008fd2af admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:48.734140 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1202/2395] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:27:48 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:27:48.738201 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c2ef9-3c66-4bf2-9855-db4105577fe4 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:48.749084 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c2ef9-3c66-4bf2-9855-db4105577fe4 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:48.811498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06488100-ab35-4bee-8a37-11658cc27e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:48.812536 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06488100-ab35-4bee-8a37-11658cc27e55 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:48.812893 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06488100-ab35-4bee-8a37-11658cc27e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:48.813243 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06488100-ab35-4bee-8a37-11658cc27e55 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:48.814013 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06488100-ab35-4bee-8a37-11658cc27e55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:48.816000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06488100-ab35-4bee-8a37-11658cc27e55 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:48.838703 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1194/2396] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:27:48 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:27:48.844257 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586d957-0bad-45e6-9ef6-d188008fd2af admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:48.856178 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586d957-0bad-45e6-9ef6-d188008fd2af admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:48.860793 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b422c2b-faf3-4ac2-b321-a63d8b2f5fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:48.861504 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b422c2b-faf3-4ac2-b321-a63d8b2f5fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:48.861785 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b422c2b-faf3-4ac2-b321-a63d8b2f5fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:48.862056 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b422c2b-faf3-4ac2-b321-a63d8b2f5fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:48.862778 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b422c2b-faf3-4ac2-b321-a63d8b2f5fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:48.864426 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b422c2b-faf3-4ac2-b321-a63d8b2f5fb5 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:48.875783 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1203/2397] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:27:48.881667 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06488100-ab35-4bee-8a37-11658cc27e55 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:48.891814 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06488100-ab35-4bee-8a37-11658cc27e55 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:48.897698 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce272f1-afcc-4fa9-aa10-fb047aa1a3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:48.898580 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce272f1-afcc-4fa9-aa10-fb047aa1a3ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:48.899296 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce272f1-afcc-4fa9-aa10-fb047aa1a3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:48.899296 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce272f1-afcc-4fa9-aa10-fb047aa1a3ee admin admin] PATH_INFO: `/v3/projects/627f5e5ff6954e7ba2ba9338242c2345/users/2558e376a3024db2843a1f5c38d4dfb9/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:48.915542 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce272f1-afcc-4fa9-aa10-fb047aa1a3ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=627f5e5ff6954e7ba2ba9338242c2345, user_id=2558e376a3024db2843a1f5c38d4dfb9, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:48.918184 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce272f1-afcc-4fa9-aa10-fb047aa1a3ee admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:48.931186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1195/2398] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:27:48 2022] PUT /identity/v3/projects/627f5e5ff6954e7ba2ba9338242c2345/users/2558e376a3024db2843a1f5c38d4dfb9/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:27:48.935103 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b422c2b-faf3-4ac2-b321-a63d8b2f5fb5 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:48.945437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b422c2b-faf3-4ac2-b321-a63d8b2f5fb5 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:49.000303 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6748fc8-5870-4c36-a284-932aa9e7e6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:49.001164 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6748fc8-5870-4c36-a284-932aa9e7e6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:49.001520 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6748fc8-5870-4c36-a284-932aa9e7e6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:49.001856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6748fc8-5870-4c36-a284-932aa9e7e6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:49.002764 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6748fc8-5870-4c36-a284-932aa9e7e6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:49.004412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6748fc8-5870-4c36-a284-932aa9e7e6d2 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:49.014652 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1204/2399] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:27:49.019546 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce272f1-afcc-4fa9-aa10-fb047aa1a3ee admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:49.030271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce272f1-afcc-4fa9-aa10-fb047aa1a3ee admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:49.035339 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a092f5-3256-4014-82e4-b22666c6e5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:49.036290 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a092f5-3256-4014-82e4-b22666c6e5c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:49.036568 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a092f5-3256-4014-82e4-b22666c6e5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:49.037417 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a092f5-3256-4014-82e4-b22666c6e5c3 admin admin] PATH_INFO: `/v3/projects/627f5e5ff6954e7ba2ba9338242c2345/users/2558e376a3024db2843a1f5c38d4dfb9/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:49.039511 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a092f5-3256-4014-82e4-b22666c6e5c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=627f5e5ff6954e7ba2ba9338242c2345, user_id=2558e376a3024db2843a1f5c38d4dfb9, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:49.042235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a092f5-3256-4014-82e4-b22666c6e5c3 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:49.054617 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1196/2400] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:27:49 2022] PUT /identity/v3/projects/627f5e5ff6954e7ba2ba9338242c2345/users/2558e376a3024db2843a1f5c38d4dfb9/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:27:53.663108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e525c-169c-4a02-9e19-dd2688864357 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:53.663108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e525c-169c-4a02-9e19-dd2688864357 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:53.663699 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e525c-169c-4a02-9e19-dd2688864357 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:53.665192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1205/2401] 10.222.0.71 () {54 vars in 921 bytes} [Mon May 16 20:27:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:27:53.671415 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f01946-ca98-4105-9ae3-7e06ab6252af None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:53.672781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f01946-ca98-4105-9ae3-7e06ab6252af None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:53.673302 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f01946-ca98-4105-9ae3-7e06ab6252af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:53.804684 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-27f01946-ca98-4105-9ae3-7e06ab6252af None None] MFA Rules not processed for user `242d4f9634a74013af05f50981280864`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:53.806564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-27f01946-ca98-4105-9ae3-7e06ab6252af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:54.011665 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1197/2402] 10.222.0.71 () {58 vars in 1018 bytes} [Mon May 16 20:27:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:27:54.037914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e525c-169c-4a02-9e19-dd2688864357 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:54.040100 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-bc6e525c-169c-4a02-9e19-dd2688864357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:54.160825 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e525c-169c-4a02-9e19-dd2688864357 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:54.165254 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3d635-82a9-473a-b7a1-38638c02ab14 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62c3f9351a4181a4fc2930570171b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:54.166172 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3d635-82a9-473a-b7a1-38638c02ab14 service glance] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:54.166621 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3d635-82a9-473a-b7a1-38638c02ab14 service glance] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:54.167047 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3d635-82a9-473a-b7a1-38638c02ab14 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:54.181607 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3d635-82a9-473a-b7a1-38638c02ab14 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:54.183949 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3d635-82a9-473a-b7a1-38638c02ab14 service glance] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:54.197716 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1206/2403] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:27:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:27:54.298674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4acd63-ca75-4787-ac71-e49ee6fa5897 None None] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:54.299132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4acd63-ca75-4787-ac71-e49ee6fa5897 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:54.299591 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4acd63-ca75-4787-ac71-e49ee6fa5897 None None] PATH_INFO: `/` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:54.301173 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1198/2404] 10.222.0.71 () {54 vars in 921 bytes} [Mon May 16 20:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:27:54.307196 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be577c-0757-405d-bdc3-986486eeea7d None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:54.307698 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be577c-0757-405d-bdc3-986486eeea7d None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:54.308069 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be577c-0757-405d-bdc3-986486eeea7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:54.325647 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d04dd2-0e75-4155-9f52-09bf32dc4a99 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:54.325936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d04dd2-0e75-4155-9f52-09bf32dc4a99 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:54.326247 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d04dd2-0e75-4155-9f52-09bf32dc4a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:54.342325 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-97be577c-0757-405d-bdc3-986486eeea7d None None] MFA Rules not processed for user `eedc173e2cdc48b489ac40f3d9dccb7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:54.343663 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-97be577c-0757-405d-bdc3-986486eeea7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:54.357795 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-a1d04dd2-0e75-4155-9f52-09bf32dc4a99 None None] MFA Rules not processed for user `2558e376a3024db2843a1f5c38d4dfb9`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:54.359103 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-a1d04dd2-0e75-4155-9f52-09bf32dc4a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:54.398917 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1207/2405] 10.222.0.71 () {58 vars in 1018 bytes} [Mon May 16 20:27:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:54.410918 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be577c-0757-405d-bdc3-986486eeea7d None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:54.413022 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-97be577c-0757-405d-bdc3-986486eeea7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:54.423333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be577c-0757-405d-bdc3-986486eeea7d None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:54.427083 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021b00c-de90-48db-b8b2-2fdc821d05ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:54.428373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021b00c-de90-48db-b8b2-2fdc821d05ca service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:54.428663 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021b00c-de90-48db-b8b2-2fdc821d05ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:54.428937 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021b00c-de90-48db-b8b2-2fdc821d05ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:54.433611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1199/2406] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:27:54.437370 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021b00c-de90-48db-b8b2-2fdc821d05ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:54.438894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021b00c-de90-48db-b8b2-2fdc821d05ca service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:54.446878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d04dd2-0e75-4155-9f52-09bf32dc4a99 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:54.447720 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1208/2407] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:27:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:27:54.448449 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-a1d04dd2-0e75-4155-9f52-09bf32dc4a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:54.464893 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d04dd2-0e75-4155-9f52-09bf32dc4a99 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:54.470605 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af97bf-4c5f-4552-b7ae-5c81991fe253 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:54.471260 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af97bf-4c5f-4552-b7ae-5c81991fe253 service nova] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:54.471539 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af97bf-4c5f-4552-b7ae-5c81991fe253 service nova] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:54.471816 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af97bf-4c5f-4552-b7ae-5c81991fe253 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:54.534484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af97bf-4c5f-4552-b7ae-5c81991fe253 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:54.536072 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af97bf-4c5f-4552-b7ae-5c81991fe253 service nova] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:54.541540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49cc9a-05c0-4910-91d4-27d13c3cb0a9 None None] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:54.542537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49cc9a-05c0-4910-91d4-27d13c3cb0a9 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:54.542894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49cc9a-05c0-4910-91d4-27d13c3cb0a9 None None] PATH_INFO: `/` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:54.544966 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1209/2408] 10.222.0.71 () {54 vars in 921 bytes} [Mon May 16 20:27:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 20:27:54.547048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1200/2409] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:27:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:27:54.550446 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc45183-c41e-46a2-8b65-979bfc7b19a7 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:54.550855 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc45183-c41e-46a2-8b65-979bfc7b19a7 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:54.551230 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc45183-c41e-46a2-8b65-979bfc7b19a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:54.572226 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-8fc45183-c41e-46a2-8b65-979bfc7b19a7 None None] MFA Rules not processed for user `242d4f9634a74013af05f50981280864`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:54.573510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8fc45183-c41e-46a2-8b65-979bfc7b19a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:54.583269 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1210/2410] 10.222.0.71 () {58 vars in 1018 bytes} [Mon May 16 20:27:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:27:54.594302 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af97bf-4c5f-4552-b7ae-5c81991fe253 service nova] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:54.610752 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af97bf-4c5f-4552-b7ae-5c81991fe253 service nova] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:54.614514 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95ed7b-3bfc-483e-b856-e7bd606d553c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:54.615771 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95ed7b-3bfc-483e-b856-e7bd606d553c service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:54.616058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95ed7b-3bfc-483e-b856-e7bd606d553c service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:54.616359 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95ed7b-3bfc-483e-b856-e7bd606d553c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:54.635067 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95ed7b-3bfc-483e-b856-e7bd606d553c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:54.636615 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95ed7b-3bfc-483e-b856-e7bd606d553c service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:54.648909 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1201/2411] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:27:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:27:55.710324 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11688e1-f14c-4c6f-b63e-b6dcf2253d94 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:55.711671 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11688e1-f14c-4c6f-b63e-b6dcf2253d94 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:55.712288 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11688e1-f14c-4c6f-b63e-b6dcf2253d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:55.735033 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-a11688e1-f14c-4c6f-b63e-b6dcf2253d94 None None] MFA Rules not processed for user `e7f77ef8223e4a64a6b72524e71f88e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:55.736266 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-a11688e1-f14c-4c6f-b63e-b6dcf2253d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:55.750259 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1211/2412] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:27:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:27:57.522803 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbfcc1-371e-4d0f-a387-cf980868a4f9 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:57.523294 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbfcc1-371e-4d0f-a387-cf980868a4f9 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:57.523386 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbfcc1-371e-4d0f-a387-cf980868a4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:57.541621 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-f8fbfcc1-371e-4d0f-a387-cf980868a4f9 None None] MFA Rules not processed for user `38a56f3572874938ad4642fa34751a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:27:57.543054 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f8fbfcc1-371e-4d0f-a387-cf980868a4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:57.609693 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1202/2413] 10.222.0.71 () {58 vars in 1009 bytes} [Mon May 16 20:27:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:27:57.622379 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11688e1-f14c-4c6f-b63e-b6dcf2253d94 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:27:57.623752 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-a11688e1-f14c-4c6f-b63e-b6dcf2253d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:27:57.698890 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11688e1-f14c-4c6f-b63e-b6dcf2253d94 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:27:57.703854 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e62ff-aea2-455a-9102-a1ffadadc10c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e701cf55d13410aa259ec72578ed27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:27:57.705193 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e62ff-aea2-455a-9102-a1ffadadc10c service swift] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:27:57.705480 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e62ff-aea2-455a-9102-a1ffadadc10c service swift] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:27:57.705752 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e62ff-aea2-455a-9102-a1ffadadc10c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:27:57.715775 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e62ff-aea2-455a-9102-a1ffadadc10c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:27:57.717673 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e62ff-aea2-455a-9102-a1ffadadc10c service swift] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:27:57.726098 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1212/2414] 10.222.0.71 () {60 vars in 1384 bytes} [Mon May 16 20:27:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:28:11.042113 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbfcc1-371e-4d0f-a387-cf980868a4f9 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:28:11.043544 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f8fbfcc1-371e-4d0f-a387-cf980868a4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:11.130006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbfcc1-371e-4d0f-a387-cf980868a4f9 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:28:11.135738 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c37c64-77a6-4eb3-9bad-1a911e6e7969 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e2c8b4ff2349919750aa0f3f7309bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:28:11.136527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c37c64-77a6-4eb3-9bad-1a911e6e7969 service placement] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:11.136681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c37c64-77a6-4eb3-9bad-1a911e6e7969 service placement] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:11.137140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c37c64-77a6-4eb3-9bad-1a911e6e7969 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:11.138709 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-94c37c64-77a6-4eb3-9bad-1a911e6e7969 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:11.150963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c37c64-77a6-4eb3-9bad-1a911e6e7969 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:28:11.152566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c37c64-77a6-4eb3-9bad-1a911e6e7969 service placement] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:28:11.162169 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1203/2415] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:28:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:28:23.970506 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3393d76-123e-4890-b224-b6db55fcfe76 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:23.970981 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3393d76-123e-4890-b224-b6db55fcfe76 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:23.971099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3393d76-123e-4890-b224-b6db55fcfe76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:24.018622 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-b3393d76-123e-4890-b224-b6db55fcfe76 None None] MFA Rules not processed for user `38a56f3572874938ad4642fa34751a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:28:24.019800 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-b3393d76-123e-4890-b224-b6db55fcfe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:24.036137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1213/2416] 10.222.0.71 () {58 vars in 967 bytes} [Mon May 16 20:28:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:28:24.049317 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c37c64-77a6-4eb3-9bad-1a911e6e7969 service placement] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:28:24.069537 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c37c64-77a6-4eb3-9bad-1a911e6e7969 service placement] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:28:24.074873 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91153828-e546-45b5-8b49-337b39d60cdf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e701cf55d13410aa259ec72578ed27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:28:24.075531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91153828-e546-45b5-8b49-337b39d60cdf service swift] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:24.075810 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91153828-e546-45b5-8b49-337b39d60cdf service swift] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:24.076083 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91153828-e546-45b5-8b49-337b39d60cdf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:24.084073 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91153828-e546-45b5-8b49-337b39d60cdf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:28:24.085652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91153828-e546-45b5-8b49-337b39d60cdf service swift] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:28:24.093499 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1204/2417] 10.222.0.71 () {60 vars in 1384 bytes} [Mon May 16 20:28:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 20:28:31.629030 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3393d76-123e-4890-b224-b6db55fcfe76 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:28:31.630425 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-b3393d76-123e-4890-b224-b6db55fcfe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:31.642484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3393d76-123e-4890-b224-b6db55fcfe76 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:28:31.646288 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65955735-7f50-4379-9bc1-cf6e334006bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:28:31.646924 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65955735-7f50-4379-9bc1-cf6e334006bb service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:31.647204 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65955735-7f50-4379-9bc1-cf6e334006bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:31.647479 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65955735-7f50-4379-9bc1-cf6e334006bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:31.656958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65955735-7f50-4379-9bc1-cf6e334006bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:28:31.658385 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65955735-7f50-4379-9bc1-cf6e334006bb service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:28:31.667632 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1214/2418] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:28:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:28:52.764434 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438d533-d3af-4e28-803d-4d01225c90b6 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:28:52.764946 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438d533-d3af-4e28-803d-4d01225c90b6 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:28:52.764946 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438d533-d3af-4e28-803d-4d01225c90b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:28:52.782717 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-8438d533-d3af-4e28-803d-4d01225c90b6 None None] MFA Rules not processed for user `7fb4dfe324594ec6924ded65bf7e613b`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:28:52.783924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-8438d533-d3af-4e28-803d-4d01225c90b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:28:52.834929 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1205/2419] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:28:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:13.934163 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd78cdd-2af6-47e3-92ab-1794ab1bd7bd None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:13.935210 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd78cdd-2af6-47e3-92ab-1794ab1bd7bd None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:13.935327 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd78cdd-2af6-47e3-92ab-1794ab1bd7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:13.953165 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-6bd78cdd-2af6-47e3-92ab-1794ab1bd7bd None None] MFA Rules not processed for user `c330fcea8dda449ab5e125b741d49ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:13.954361 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-6bd78cdd-2af6-47e3-92ab-1794ab1bd7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:14.006430 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1215/2420] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:29:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:34.501962 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8df04-2e9d-40a0-8d0e-b96f343baac8 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:34.502465 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8df04-2e9d-40a0-8d0e-b96f343baac8 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:34.502563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8df04-2e9d-40a0-8d0e-b96f343baac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:34.519683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-23e8df04-2e9d-40a0-8d0e-b96f343baac8 None None] MFA Rules not processed for user `4bf4652bf6ac4713ab4931365b943d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:34.520892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-23e8df04-2e9d-40a0-8d0e-b96f343baac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:34.574230 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1206/2421] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:29:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:29:57.106434 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd44b21-5b11-478f-a82e-2a6ed2cf0d36 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:29:57.107703 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd44b21-5b11-478f-a82e-2a6ed2cf0d36 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:29:57.108480 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd44b21-5b11-478f-a82e-2a6ed2cf0d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:29:57.131363 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-6cd44b21-5b11-478f-a82e-2a6ed2cf0d36 None None] MFA Rules not processed for user `6dfbf496174e4138bfac5e1b925a0b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:29:57.132825 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-6cd44b21-5b11-478f-a82e-2a6ed2cf0d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:29:57.210377 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1216/2422] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:29:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:00.915797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8df04-2e9d-40a0-8d0e-b96f343baac8 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:00.917220 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-23e8df04-2e9d-40a0-8d0e-b96f343baac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:01.003491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8df04-2e9d-40a0-8d0e-b96f343baac8 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:01.008961 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260d382-bafb-4ffc-a681-63d8a224d037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:01.010108 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260d382-bafb-4ffc-a681-63d8a224d037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:01.010714 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260d382-bafb-4ffc-a681-63d8a224d037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:01.011337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260d382-bafb-4ffc-a681-63d8a224d037 admin admin] PATH_INFO: `/v3/users/7fb4dfe324594ec6924ded65bf7e613b` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:01.012839 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260d382-bafb-4ffc-a681-63d8a224d037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb4dfe324594ec6924ded65bf7e613b)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:01.014794 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260d382-bafb-4ffc-a681-63d8a224d037 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:01.086470 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-8260d382-bafb-4ffc-a681-63d8a224d037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb4dfe324594ec6924ded65bf7e613b'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:01.104067 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-8260d382-bafb-4ffc-a681-63d8a224d037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb4dfe324594ec6924ded65bf7e613b'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:01.112304 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-8260d382-bafb-4ffc-a681-63d8a224d037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb4dfe324594ec6924ded65bf7e613b'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:01.113206 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-8260d382-bafb-4ffc-a681-63d8a224d037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb4dfe324594ec6924ded65bf7e613b'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:01.122379 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-8260d382-bafb-4ffc-a681-63d8a224d037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb4dfe324594ec6924ded65bf7e613b'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:01.129982 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1207/2423] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:30:00 2022] DELETE /identity/v3/users/7fb4dfe324594ec6924ded65bf7e613b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:30:01.354299 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd44b21-5b11-478f-a82e-2a6ed2cf0d36 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:01.366703 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd44b21-5b11-478f-a82e-2a6ed2cf0d36 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:01.447450 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab53dba-b8a2-42f4-bc0c-d74b36e87925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:01.449178 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab53dba-b8a2-42f4-bc0c-d74b36e87925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:01.450030 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab53dba-b8a2-42f4-bc0c-d74b36e87925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:01.450478 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab53dba-b8a2-42f4-bc0c-d74b36e87925 admin admin] PATH_INFO: `/v3/projects/c5993f86ca3e459582b0aad65ca76d4d` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:01.451873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab53dba-b8a2-42f4-bc0c-d74b36e87925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5993f86ca3e459582b0aad65ca76d4d)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:01.454048 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab53dba-b8a2-42f4-bc0c-d74b36e87925 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:01.508249 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-fab53dba-b8a2-42f4-bc0c-d74b36e87925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5993f86ca3e459582b0aad65ca76d4d', 'request_id': 'req-fab53dba-b8a2-42f4-bc0c-d74b36e87925'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:01.516955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-fab53dba-b8a2-42f4-bc0c-d74b36e87925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5993f86ca3e459582b0aad65ca76d4d', 'request_id': 'req-fab53dba-b8a2-42f4-bc0c-d74b36e87925'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:01.529607 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-fab53dba-b8a2-42f4-bc0c-d74b36e87925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5993f86ca3e459582b0aad65ca76d4d', 'request_id': 'req-fab53dba-b8a2-42f4-bc0c-d74b36e87925'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:01.541458 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-fab53dba-b8a2-42f4-bc0c-d74b36e87925 admin admin] The token cache is being invalidate because project c5993f86ca3e459582b0aad65ca76d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:30:01.541748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-fab53dba-b8a2-42f4-bc0c-d74b36e87925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:01.542454 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-fab53dba-b8a2-42f4-bc0c-d74b36e87925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:01.544125 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1217/2424] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:30:01 2022] DELETE /identity/v3/projects/c5993f86ca3e459582b0aad65ca76d4d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:30:01.551795 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeae0ec-3d13-44dc-9031-93742b2f8edc None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:01.552079 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeae0ec-3d13-44dc-9031-93742b2f8edc None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:01.552685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeae0ec-3d13-44dc-9031-93742b2f8edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:01.571047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-bfeae0ec-3d13-44dc-9031-93742b2f8edc None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:01.572280 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-bfeae0ec-3d13-44dc-9031-93742b2f8edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:01.634456 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1208/2425] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:01.643090 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54a49a-48a3-47d6-b9bc-b95e185d6a02 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:01.643495 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54a49a-48a3-47d6-b9bc-b95e185d6a02 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:01.643871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54a49a-48a3-47d6-b9bc-b95e185d6a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:01.664811 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-5d54a49a-48a3-47d6-b9bc-b95e185d6a02 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:01.666087 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-5d54a49a-48a3-47d6-b9bc-b95e185d6a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:01.675799 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1218/2426] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:01.680069 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeae0ec-3d13-44dc-9031-93742b2f8edc None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:01.689920 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeae0ec-3d13-44dc-9031-93742b2f8edc None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:01.694492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d68a0-cb5d-4a78-bfcf-acda1dc044e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:01.695150 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d68a0-cb5d-4a78-bfcf-acda1dc044e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:01.695433 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d68a0-cb5d-4a78-bfcf-acda1dc044e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:01.695706 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d68a0-cb5d-4a78-bfcf-acda1dc044e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:01.696474 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d68a0-cb5d-4a78-bfcf-acda1dc044e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:30:01.696780 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d68a0-cb5d-4a78-bfcf-acda1dc044e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:01.698368 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d68a0-cb5d-4a78-bfcf-acda1dc044e0 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:01.713548 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1209/2427] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:30:01.715213 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54a49a-48a3-47d6-b9bc-b95e185d6a02 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:01.724518 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54a49a-48a3-47d6-b9bc-b95e185d6a02 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:01.729527 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08265a-4056-4f9f-8f7d-40574eee9cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:01.730810 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08265a-4056-4f9f-8f7d-40574eee9cde admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:01.731085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08265a-4056-4f9f-8f7d-40574eee9cde admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:01.731352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08265a-4056-4f9f-8f7d-40574eee9cde admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:01.732042 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08265a-4056-4f9f-8f7d-40574eee9cde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:01.734096 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08265a-4056-4f9f-8f7d-40574eee9cde admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:01.759488 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1219/2428] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:30:01 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:30:01.763499 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d68a0-cb5d-4a78-bfcf-acda1dc044e0 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:01.773720 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d68a0-cb5d-4a78-bfcf-acda1dc044e0 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:01.831275 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd523907-a3e1-4b10-839c-30f5c736659f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:01.831947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd523907-a3e1-4b10-839c-30f5c736659f admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:01.832265 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd523907-a3e1-4b10-839c-30f5c736659f admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:01.832546 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd523907-a3e1-4b10-839c-30f5c736659f admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:01.833244 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd523907-a3e1-4b10-839c-30f5c736659f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:01.835160 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd523907-a3e1-4b10-839c-30f5c736659f admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:01.856189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1210/2429] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:30:01 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:30:01.860450 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08265a-4056-4f9f-8f7d-40574eee9cde admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:01.871355 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08265a-4056-4f9f-8f7d-40574eee9cde admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:01.876853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b702584-2064-4e66-88d5-db63981011bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:01.877608 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b702584-2064-4e66-88d5-db63981011bb admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:01.877930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b702584-2064-4e66-88d5-db63981011bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:01.878414 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b702584-2064-4e66-88d5-db63981011bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:01.879381 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b702584-2064-4e66-88d5-db63981011bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:01.881148 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b702584-2064-4e66-88d5-db63981011bb admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:01.896179 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1220/2430] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:30:01.898193 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd523907-a3e1-4b10-839c-30f5c736659f admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:01.909879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd523907-a3e1-4b10-839c-30f5c736659f admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:01.915218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5a703-84ba-44fa-be4b-5dbfde262332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:01.915877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5a703-84ba-44fa-be4b-5dbfde262332 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:01.916482 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5a703-84ba-44fa-be4b-5dbfde262332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:01.916482 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5a703-84ba-44fa-be4b-5dbfde262332 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:01.917793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5a703-84ba-44fa-be4b-5dbfde262332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:01.919399 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5a703-84ba-44fa-be4b-5dbfde262332 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:01.931114 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1211/2431] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:30:01.934322 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b702584-2064-4e66-88d5-db63981011bb admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:01.944320 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b702584-2064-4e66-88d5-db63981011bb admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:01.949359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98648d28-41e3-4b67-a60f-66f1f2473dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:01.950233 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98648d28-41e3-4b67-a60f-66f1f2473dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:01.950512 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98648d28-41e3-4b67-a60f-66f1f2473dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:01.950784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98648d28-41e3-4b67-a60f-66f1f2473dc3 admin admin] PATH_INFO: `/v3/projects/7483c4fb2d174cc18a7d772377ba1ca5/users/fbf9646e961c45668beff065ebbe097c/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:01.966103 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98648d28-41e3-4b67-a60f-66f1f2473dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7483c4fb2d174cc18a7d772377ba1ca5, user_id=fbf9646e961c45668beff065ebbe097c, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:01.968936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98648d28-41e3-4b67-a60f-66f1f2473dc3 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:01.982552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1221/2432] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:30:01 2022] PUT /identity/v3/projects/7483c4fb2d174cc18a7d772377ba1ca5/users/fbf9646e961c45668beff065ebbe097c/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:30:01.993202 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161db93-ce61-40fb-b9c8-ab425110e3b2 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:01.993495 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161db93-ce61-40fb-b9c8-ab425110e3b2 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:01.993772 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161db93-ce61-40fb-b9c8-ab425110e3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:02.021005 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-3161db93-ce61-40fb-b9c8-ab425110e3b2 None None] MFA Rules not processed for user `fbf9646e961c45668beff065ebbe097c`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:02.022119 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-3161db93-ce61-40fb-b9c8-ab425110e3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:02.092083 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1212/2433] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:30:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:02.103115 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98648d28-41e3-4b67-a60f-66f1f2473dc3 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:02.104984 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-98648d28-41e3-4b67-a60f-66f1f2473dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:02.178724 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98648d28-41e3-4b67-a60f-66f1f2473dc3 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:02.184623 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d2209-4e90-4b7a-b73e-cb3d4c14e7e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:02.185271 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d2209-4e90-4b7a-b73e-cb3d4c14e7e9 service nova] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:02.185553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d2209-4e90-4b7a-b73e-cb3d4c14e7e9 service nova] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:02.185827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d2209-4e90-4b7a-b73e-cb3d4c14e7e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:02.193654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d2209-4e90-4b7a-b73e-cb3d4c14e7e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:02.195237 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d2209-4e90-4b7a-b73e-cb3d4c14e7e9 service nova] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:02.206052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1222/2434] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:30:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:06.379846 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161db93-ce61-40fb-b9c8-ab425110e3b2 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:06.381429 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-3161db93-ce61-40fb-b9c8-ab425110e3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:06.444518 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161db93-ce61-40fb-b9c8-ab425110e3b2 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:06.447988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4a817-625a-4f3c-a95c-631e95ed155e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:06.450037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4a817-625a-4f3c-a95c-631e95ed155e service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:06.450149 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4a817-625a-4f3c-a95c-631e95ed155e service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:06.452548 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4a817-625a-4f3c-a95c-631e95ed155e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:06.454473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-57a4a817-625a-4f3c-a95c-631e95ed155e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:06.468522 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4a817-625a-4f3c-a95c-631e95ed155e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:06.469949 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4a817-625a-4f3c-a95c-631e95ed155e service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:06.481681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1213/2435] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:30:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:07.651708 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d2209-4e90-4b7a-b73e-cb3d4c14e7e9 service nova] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:07.653832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-756d2209-4e90-4b7a-b73e-cb3d4c14e7e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:07.666493 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d2209-4e90-4b7a-b73e-cb3d4c14e7e9 service nova] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:07.671087 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef0ef3-61f3-4f5d-833d-8426d6f1cbfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:07.671729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef0ef3-61f3-4f5d-833d-8426d6f1cbfb service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:07.672005 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef0ef3-61f3-4f5d-833d-8426d6f1cbfb service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:07.672304 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef0ef3-61f3-4f5d-833d-8426d6f1cbfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:07.674057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c1ef0ef3-61f3-4f5d-833d-8426d6f1cbfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:07.687655 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef0ef3-61f3-4f5d-833d-8426d6f1cbfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:07.693857 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef0ef3-61f3-4f5d-833d-8426d6f1cbfb service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:07.700214 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1223/2436] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:30:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:09.461106 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4a817-625a-4f3c-a95c-631e95ed155e service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:09.521424 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4a817-625a-4f3c-a95c-631e95ed155e service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:09.525986 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc3647-2aee-4fa5-aeb4-f4a4f2310c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:09.526965 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc3647-2aee-4fa5-aeb4-f4a4f2310c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:09.527244 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc3647-2aee-4fa5-aeb4-f4a4f2310c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:09.527516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc3647-2aee-4fa5-aeb4-f4a4f2310c77 admin admin] PATH_INFO: `/v3/users/fbf9646e961c45668beff065ebbe097c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:09.529270 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc3647-2aee-4fa5-aeb4-f4a4f2310c77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf9646e961c45668beff065ebbe097c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:09.531224 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc3647-2aee-4fa5-aeb4-f4a4f2310c77 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:09.574251 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0cdc3647-2aee-4fa5-aeb4-f4a4f2310c77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf9646e961c45668beff065ebbe097c'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:09.586150 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0cdc3647-2aee-4fa5-aeb4-f4a4f2310c77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf9646e961c45668beff065ebbe097c'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:09.593305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0cdc3647-2aee-4fa5-aeb4-f4a4f2310c77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf9646e961c45668beff065ebbe097c'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:09.593923 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0cdc3647-2aee-4fa5-aeb4-f4a4f2310c77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf9646e961c45668beff065ebbe097c'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:09.601006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-0cdc3647-2aee-4fa5-aeb4-f4a4f2310c77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf9646e961c45668beff065ebbe097c'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:09.607043 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1214/2437] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:30:09 2022] DELETE /identity/v3/users/fbf9646e961c45668beff065ebbe097c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:30:09.611625 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80920dad-88c4-4470-85ec-42d485fb6e5a None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:09.612110 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80920dad-88c4-4470-85ec-42d485fb6e5a None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:09.612249 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80920dad-88c4-4470-85ec-42d485fb6e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:09.628751 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-80920dad-88c4-4470-85ec-42d485fb6e5a None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:09.629928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-80920dad-88c4-4470-85ec-42d485fb6e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:09.686674 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1224/2438] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:09.696344 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc3647-2aee-4fa5-aeb4-f4a4f2310c77 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:09.697755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-0cdc3647-2aee-4fa5-aeb4-f4a4f2310c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:09.754591 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc3647-2aee-4fa5-aeb4-f4a4f2310c77 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:09.758234 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0caed2-3bc6-4118-acab-4e1142e446f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:09.758879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0caed2-3bc6-4118-acab-4e1142e446f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:09.759166 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0caed2-3bc6-4118-acab-4e1142e446f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:09.759441 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0caed2-3bc6-4118-acab-4e1142e446f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:09.769221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0caed2-3bc6-4118-acab-4e1142e446f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:09.770637 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0caed2-3bc6-4118-acab-4e1142e446f3 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:09.780877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1215/2439] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:30:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:10.115860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80920dad-88c4-4470-85ec-42d485fb6e5a None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:10.117773 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-80920dad-88c4-4470-85ec-42d485fb6e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:10.130456 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80920dad-88c4-4470-85ec-42d485fb6e5a None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:10.141624 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a46312-4d7c-4700-91ea-935389943063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:10.143272 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a46312-4d7c-4700-91ea-935389943063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:10.143558 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a46312-4d7c-4700-91ea-935389943063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:10.144003 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a46312-4d7c-4700-91ea-935389943063 admin admin] PATH_INFO: `/v3/projects/7483c4fb2d174cc18a7d772377ba1ca5` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:10.145322 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a46312-4d7c-4700-91ea-935389943063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7483c4fb2d174cc18a7d772377ba1ca5)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:10.147343 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a46312-4d7c-4700-91ea-935389943063 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:10.208052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-25a46312-4d7c-4700-91ea-935389943063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7483c4fb2d174cc18a7d772377ba1ca5', 'request_id': 'req-25a46312-4d7c-4700-91ea-935389943063'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:10.216777 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-25a46312-4d7c-4700-91ea-935389943063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7483c4fb2d174cc18a7d772377ba1ca5', 'request_id': 'req-25a46312-4d7c-4700-91ea-935389943063'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:10.223609 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-25a46312-4d7c-4700-91ea-935389943063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7483c4fb2d174cc18a7d772377ba1ca5', 'request_id': 'req-25a46312-4d7c-4700-91ea-935389943063'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:10.234999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-25a46312-4d7c-4700-91ea-935389943063 admin admin] The token cache is being invalidate because project 7483c4fb2d174cc18a7d772377ba1ca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:30:10.235319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-25a46312-4d7c-4700-91ea-935389943063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:10.236053 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-25a46312-4d7c-4700-91ea-935389943063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:10.237700 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1225/2440] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:30:10 2022] DELETE /identity/v3/projects/7483c4fb2d174cc18a7d772377ba1ca5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:30:10.242744 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb5b37-4f70-4285-b8c4-8acf59760c8c None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:10.243060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb5b37-4f70-4285-b8c4-8acf59760c8c None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:10.243332 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb5b37-4f70-4285-b8c4-8acf59760c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:10.261495 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-5bdb5b37-4f70-4285-b8c4-8acf59760c8c None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:10.263004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-5bdb5b37-4f70-4285-b8c4-8acf59760c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:10.320533 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1216/2441] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:30:10.329953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54754adc-4f9e-4c37-9bc0-019bcdb9a02d None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:10.330237 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54754adc-4f9e-4c37-9bc0-019bcdb9a02d None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:10.330513 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54754adc-4f9e-4c37-9bc0-019bcdb9a02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:10.349094 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-54754adc-4f9e-4c37-9bc0-019bcdb9a02d None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:10.350289 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-54754adc-4f9e-4c37-9bc0-019bcdb9a02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:10.358527 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1226/2442] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:10.362644 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb5b37-4f70-4285-b8c4-8acf59760c8c None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:10.372053 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb5b37-4f70-4285-b8c4-8acf59760c8c None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:10.376748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac19eca-9ae2-48bd-9d5d-1a75c2abab49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:10.377488 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac19eca-9ae2-48bd-9d5d-1a75c2abab49 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:10.377681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac19eca-9ae2-48bd-9d5d-1a75c2abab49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:10.377958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac19eca-9ae2-48bd-9d5d-1a75c2abab49 admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:10.378679 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac19eca-9ae2-48bd-9d5d-1a75c2abab49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:30:10.378985 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac19eca-9ae2-48bd-9d5d-1a75c2abab49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:10.380644 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac19eca-9ae2-48bd-9d5d-1a75c2abab49 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:10.392920 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1217/2443] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:30:10.397283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54754adc-4f9e-4c37-9bc0-019bcdb9a02d None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:10.407873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54754adc-4f9e-4c37-9bc0-019bcdb9a02d None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:10.414814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf371e6-8769-4368-b130-f61762ab2053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:10.415925 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf371e6-8769-4368-b130-f61762ab2053 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:10.416574 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf371e6-8769-4368-b130-f61762ab2053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:10.417084 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf371e6-8769-4368-b130-f61762ab2053 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:10.419210 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf371e6-8769-4368-b130-f61762ab2053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:10.422470 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf371e6-8769-4368-b130-f61762ab2053 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:10.452794 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1227/2444] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:30:10 2022] POST /identity/v3/projects => generated 393 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:30:10.456889 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac19eca-9ae2-48bd-9d5d-1a75c2abab49 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:10.466991 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac19eca-9ae2-48bd-9d5d-1a75c2abab49 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:10.522865 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccaf51-09d9-4122-b76b-882d2d0a9db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:10.523530 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccaf51-09d9-4122-b76b-882d2d0a9db0 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:10.523815 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccaf51-09d9-4122-b76b-882d2d0a9db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:10.524092 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccaf51-09d9-4122-b76b-882d2d0a9db0 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:10.524818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ccaf51-09d9-4122-b76b-882d2d0a9db0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:10.526725 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ccaf51-09d9-4122-b76b-882d2d0a9db0 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:10.546768 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1218/2445] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:30:10 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:30:10.550780 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf371e6-8769-4368-b130-f61762ab2053 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:10.561379 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf371e6-8769-4368-b130-f61762ab2053 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:10.565897 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e383fc-be39-4b3f-aed6-551dff5da464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:10.566542 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e383fc-be39-4b3f-aed6-551dff5da464 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:10.566816 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e383fc-be39-4b3f-aed6-551dff5da464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:10.567085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e383fc-be39-4b3f-aed6-551dff5da464 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:10.567797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e383fc-be39-4b3f-aed6-551dff5da464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:10.569416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e383fc-be39-4b3f-aed6-551dff5da464 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:10.579746 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1228/2446] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:30:10.583680 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccaf51-09d9-4122-b76b-882d2d0a9db0 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:10.593862 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccaf51-09d9-4122-b76b-882d2d0a9db0 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:10.598429 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562e332-61af-4318-93e8-128bec6be22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:10.599089 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562e332-61af-4318-93e8-128bec6be22b admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:10.599355 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562e332-61af-4318-93e8-128bec6be22b admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:10.599632 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562e332-61af-4318-93e8-128bec6be22b admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:10.600378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562e332-61af-4318-93e8-128bec6be22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:10.601953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562e332-61af-4318-93e8-128bec6be22b admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:10.612258 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1219/2447] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:30:10.616077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e383fc-be39-4b3f-aed6-551dff5da464 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:10.625717 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e383fc-be39-4b3f-aed6-551dff5da464 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:10.630289 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046c4b1-a39d-433b-8adc-6626940f445e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:10.631257 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046c4b1-a39d-433b-8adc-6626940f445e admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:10.631536 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046c4b1-a39d-433b-8adc-6626940f445e admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:10.631805 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046c4b1-a39d-433b-8adc-6626940f445e admin admin] PATH_INFO: `/v3/projects/07bcccf088584154a856386260abadcf/users/a116bda4b5e14bfcb542d710e6fd4574/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:10.646830 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7046c4b1-a39d-433b-8adc-6626940f445e admin admin] RBAC: Authorizing `identity:create_grant(project_id=07bcccf088584154a856386260abadcf, user_id=a116bda4b5e14bfcb542d710e6fd4574, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:10.649538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7046c4b1-a39d-433b-8adc-6626940f445e admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:10.663918 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1229/2448] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:30:10 2022] PUT /identity/v3/projects/07bcccf088584154a856386260abadcf/users/a116bda4b5e14bfcb542d710e6fd4574/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:30:10.675144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9e5bf-ec0c-4ee6-bfdd-b7f0108a2d88 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:10.675436 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9e5bf-ec0c-4ee6-bfdd-b7f0108a2d88 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:10.675712 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9e5bf-ec0c-4ee6-bfdd-b7f0108a2d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:10.701529 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-44c9e5bf-ec0c-4ee6-bfdd-b7f0108a2d88 None None] MFA Rules not processed for user `a116bda4b5e14bfcb542d710e6fd4574`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:10.702710 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-44c9e5bf-ec0c-4ee6-bfdd-b7f0108a2d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:10.766037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1220/2449] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:30:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:10.770794 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046c4b1-a39d-433b-8adc-6626940f445e admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:10.832690 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046c4b1-a39d-433b-8adc-6626940f445e admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:10.837464 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fd6fe-20a3-40a7-a45c-edcf50505a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:10.838108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fd6fe-20a3-40a7-a45c-edcf50505a5a admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:10.838388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fd6fe-20a3-40a7-a45c-edcf50505a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:10.838655 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fd6fe-20a3-40a7-a45c-edcf50505a5a admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:10.839345 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fd6fe-20a3-40a7-a45c-edcf50505a5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:10.844280 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fd6fe-20a3-40a7-a45c-edcf50505a5a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:10.872418 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1230/2450] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:30:10 2022] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:30:10.876900 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9e5bf-ec0c-4ee6-bfdd-b7f0108a2d88 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:10.887817 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9e5bf-ec0c-4ee6-bfdd-b7f0108a2d88 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:10.946227 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8633c-3486-417b-98b1-1101d6eef7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:10.947005 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8633c-3486-417b-98b1-1101d6eef7ed admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:10.947293 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8633c-3486-417b-98b1-1101d6eef7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:10.947572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8633c-3486-417b-98b1-1101d6eef7ed admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:10.948327 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8633c-3486-417b-98b1-1101d6eef7ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:10.950807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8633c-3486-417b-98b1-1101d6eef7ed admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:10.972055 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1221/2451] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:30:10 2022] POST /identity/v3/users => generated 302 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:30:10.976244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fd6fe-20a3-40a7-a45c-edcf50505a5a admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:10.987041 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fd6fe-20a3-40a7-a45c-edcf50505a5a admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:10.993390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf2560-2587-4037-9366-9cc510928378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:10.994224 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf2560-2587-4037-9366-9cc510928378 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:10.994566 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf2560-2587-4037-9366-9cc510928378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:10.994915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf2560-2587-4037-9366-9cc510928378 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:10.995809 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf2560-2587-4037-9366-9cc510928378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:10.998101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf2560-2587-4037-9366-9cc510928378 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:11.014792 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8633c-3486-417b-98b1-1101d6eef7ed admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:11.015345 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1231/2452] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:30:11.026807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8633c-3486-417b-98b1-1101d6eef7ed admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:11.031957 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896990f-5bd7-494a-a229-14c58d760b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:11.032882 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896990f-5bd7-494a-a229-14c58d760b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:11.033168 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896990f-5bd7-494a-a229-14c58d760b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:11.033443 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896990f-5bd7-494a-a229-14c58d760b6a admin admin] PATH_INFO: `/v3/projects/76e848aa26454cedbcc0803f13bfe218/users/1eeefbe1bfc84cf3abc9cb3843bdf1f9/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:11.049349 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896990f-5bd7-494a-a229-14c58d760b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e848aa26454cedbcc0803f13bfe218, user_id=1eeefbe1bfc84cf3abc9cb3843bdf1f9, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:11.051980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896990f-5bd7-494a-a229-14c58d760b6a admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:11.066575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1222/2453] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:30:11 2022] PUT /identity/v3/projects/76e848aa26454cedbcc0803f13bfe218/users/1eeefbe1bfc84cf3abc9cb3843bdf1f9/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:30:11.070963 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf2560-2587-4037-9366-9cc510928378 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:11.080930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf2560-2587-4037-9366-9cc510928378 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:11.137227 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b36ca9-cbd2-4a6f-a31b-6f5212da781a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:11.138272 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b36ca9-cbd2-4a6f-a31b-6f5212da781a admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:11.138556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b36ca9-cbd2-4a6f-a31b-6f5212da781a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:11.138835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b36ca9-cbd2-4a6f-a31b-6f5212da781a admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:11.139851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b36ca9-cbd2-4a6f-a31b-6f5212da781a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:11.141184 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b36ca9-cbd2-4a6f-a31b-6f5212da781a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:11.151446 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1232/2454] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:30:11.155903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896990f-5bd7-494a-a229-14c58d760b6a admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:11.166274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896990f-5bd7-494a-a229-14c58d760b6a admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:11.173110 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c4f55-a591-4e0d-8d3e-2e3ffe217dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:11.175759 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c4f55-a591-4e0d-8d3e-2e3ffe217dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:11.176132 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c4f55-a591-4e0d-8d3e-2e3ffe217dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:11.176532 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c4f55-a591-4e0d-8d3e-2e3ffe217dcf admin admin] PATH_INFO: `/v3/projects/76e848aa26454cedbcc0803f13bfe218/users/1eeefbe1bfc84cf3abc9cb3843bdf1f9/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:11.178806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c4f55-a591-4e0d-8d3e-2e3ffe217dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e848aa26454cedbcc0803f13bfe218, user_id=1eeefbe1bfc84cf3abc9cb3843bdf1f9, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:11.181853 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c4f55-a591-4e0d-8d3e-2e3ffe217dcf admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:11.194284 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1223/2455] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:30:11 2022] PUT /identity/v3/projects/76e848aa26454cedbcc0803f13bfe218/users/1eeefbe1bfc84cf3abc9cb3843bdf1f9/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:30:11.208291 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400b94d-c1c7-431f-ae58-b239050bb5b2 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:11.208584 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400b94d-c1c7-431f-ae58-b239050bb5b2 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:11.208860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400b94d-c1c7-431f-ae58-b239050bb5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:11.262523 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-8400b94d-c1c7-431f-ae58-b239050bb5b2 None None] MFA Rules not processed for user `1eeefbe1bfc84cf3abc9cb3843bdf1f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:11.264692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8400b94d-c1c7-431f-ae58-b239050bb5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:11.385034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1233/2456] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:30:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:11.399535 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c4f55-a591-4e0d-8d3e-2e3ffe217dcf admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:11.402216 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-459c4f55-a591-4e0d-8d3e-2e3ffe217dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:11.492687 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c4f55-a591-4e0d-8d3e-2e3ffe217dcf admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:11.497150 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b135a9f-eb89-4ec0-b01d-6aed1f367e48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:11.497647 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b135a9f-eb89-4ec0-b01d-6aed1f367e48 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:11.497984 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b135a9f-eb89-4ec0-b01d-6aed1f367e48 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:11.498399 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b135a9f-eb89-4ec0-b01d-6aed1f367e48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:11.507718 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b135a9f-eb89-4ec0-b01d-6aed1f367e48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:11.509186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b135a9f-eb89-4ec0-b01d-6aed1f367e48 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:11.520350 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1224/2457] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:30:11 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:11.566306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400b94d-c1c7-431f-ae58-b239050bb5b2 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:11.567774 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8400b94d-c1c7-431f-ae58-b239050bb5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:11.579778 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400b94d-c1c7-431f-ae58-b239050bb5b2 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:11.583385 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d49be-831f-44e0-a774-af812dff063a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:11.584011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d49be-831f-44e0-a774-af812dff063a service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:11.584326 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d49be-831f-44e0-a774-af812dff063a service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:11.584596 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d49be-831f-44e0-a774-af812dff063a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:11.641836 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d49be-831f-44e0-a774-af812dff063a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:11.643432 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d49be-831f-44e0-a774-af812dff063a service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:11.652076 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1234/2458] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:30:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:30:14.991305 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b135a9f-eb89-4ec0-b01d-6aed1f367e48 service cinder] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:15.058550 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b135a9f-eb89-4ec0-b01d-6aed1f367e48 service cinder] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:15.064274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6cfec-e7ab-4511-9bb3-f49bb7216afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:15.065137 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6cfec-e7ab-4511-9bb3-f49bb7216afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:15.065418 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6cfec-e7ab-4511-9bb3-f49bb7216afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:15.065693 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6cfec-e7ab-4511-9bb3-f49bb7216afa admin admin] PATH_INFO: `/v3/users/a116bda4b5e14bfcb542d710e6fd4574` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:15.066897 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6cfec-e7ab-4511-9bb3-f49bb7216afa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a116bda4b5e14bfcb542d710e6fd4574)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:15.068854 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6cfec-e7ab-4511-9bb3-f49bb7216afa admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:15.115714 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f2a6cfec-e7ab-4511-9bb3-f49bb7216afa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a116bda4b5e14bfcb542d710e6fd4574'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:15.128454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f2a6cfec-e7ab-4511-9bb3-f49bb7216afa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a116bda4b5e14bfcb542d710e6fd4574'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:15.135291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f2a6cfec-e7ab-4511-9bb3-f49bb7216afa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a116bda4b5e14bfcb542d710e6fd4574'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:15.136094 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f2a6cfec-e7ab-4511-9bb3-f49bb7216afa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a116bda4b5e14bfcb542d710e6fd4574'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:15.145259 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f2a6cfec-e7ab-4511-9bb3-f49bb7216afa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a116bda4b5e14bfcb542d710e6fd4574'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:15.151376 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1225/2459] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:30:14 2022] DELETE /identity/v3/users/a116bda4b5e14bfcb542d710e6fd4574 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:30:15.156258 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074938b1-b39b-4df4-822c-160e17748e4d None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:15.156738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074938b1-b39b-4df4-822c-160e17748e4d None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:15.156833 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074938b1-b39b-4df4-822c-160e17748e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:15.173799 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-074938b1-b39b-4df4-822c-160e17748e4d None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:15.175010 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-074938b1-b39b-4df4-822c-160e17748e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:15.243594 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1235/2460] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:15.252640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6cfec-e7ab-4511-9bb3-f49bb7216afa admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:15.254044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f2a6cfec-e7ab-4511-9bb3-f49bb7216afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:15.313231 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6cfec-e7ab-4511-9bb3-f49bb7216afa admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:15.316902 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed82a6-503e-4ad5-b5bf-f347da8abcf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:15.317583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed82a6-503e-4ad5-b5bf-f347da8abcf2 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:15.317869 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed82a6-503e-4ad5-b5bf-f347da8abcf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:15.318147 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed82a6-503e-4ad5-b5bf-f347da8abcf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:15.327539 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed82a6-503e-4ad5-b5bf-f347da8abcf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:15.328993 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed82a6-503e-4ad5-b5bf-f347da8abcf2 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:15.339051 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1226/2461] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:30:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:15.720502 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074938b1-b39b-4df4-822c-160e17748e4d None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:15.722468 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-074938b1-b39b-4df4-822c-160e17748e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:15.733951 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074938b1-b39b-4df4-822c-160e17748e4d None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:15.738893 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1aec2-5490-4d47-855a-8a41451e1222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:15.739333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1aec2-5490-4d47-855a-8a41451e1222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:15.739614 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1aec2-5490-4d47-855a-8a41451e1222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:15.739861 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1aec2-5490-4d47-855a-8a41451e1222 admin admin] PATH_INFO: `/v3/projects/07bcccf088584154a856386260abadcf` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:15.741193 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe1aec2-5490-4d47-855a-8a41451e1222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07bcccf088584154a856386260abadcf)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:15.743031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe1aec2-5490-4d47-855a-8a41451e1222 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:15.813655 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-efe1aec2-5490-4d47-855a-8a41451e1222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07bcccf088584154a856386260abadcf', 'request_id': 'req-efe1aec2-5490-4d47-855a-8a41451e1222'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:15.824101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-efe1aec2-5490-4d47-855a-8a41451e1222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07bcccf088584154a856386260abadcf', 'request_id': 'req-efe1aec2-5490-4d47-855a-8a41451e1222'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:15.831677 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-efe1aec2-5490-4d47-855a-8a41451e1222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07bcccf088584154a856386260abadcf', 'request_id': 'req-efe1aec2-5490-4d47-855a-8a41451e1222'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:15.842799 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-efe1aec2-5490-4d47-855a-8a41451e1222 admin admin] The token cache is being invalidate because project 07bcccf088584154a856386260abadcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:30:15.843137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-efe1aec2-5490-4d47-855a-8a41451e1222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:15.843899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-efe1aec2-5490-4d47-855a-8a41451e1222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:15.849328 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1236/2462] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:30:15 2022] DELETE /identity/v3/projects/07bcccf088584154a856386260abadcf => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:30:15.850699 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed82a6-503e-4ad5-b5bf-f347da8abcf2 service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:15.860890 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed82a6-503e-4ad5-b5bf-f347da8abcf2 service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:15.922112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ef266-6221-46df-929b-ad7430f332c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:15.923052 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ef266-6221-46df-929b-ad7430f332c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:15.923839 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ef266-6221-46df-929b-ad7430f332c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:15.923839 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ef266-6221-46df-929b-ad7430f332c0 admin admin] PATH_INFO: `/v3/users/1eeefbe1bfc84cf3abc9cb3843bdf1f9` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:15.925104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ef266-6221-46df-929b-ad7430f332c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eeefbe1bfc84cf3abc9cb3843bdf1f9)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:15.927182 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ef266-6221-46df-929b-ad7430f332c0 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:15.986772 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-fa9ef266-6221-46df-929b-ad7430f332c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eeefbe1bfc84cf3abc9cb3843bdf1f9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:16.000758 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-fa9ef266-6221-46df-929b-ad7430f332c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eeefbe1bfc84cf3abc9cb3843bdf1f9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:16.009280 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-fa9ef266-6221-46df-929b-ad7430f332c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eeefbe1bfc84cf3abc9cb3843bdf1f9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:16.010309 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-fa9ef266-6221-46df-929b-ad7430f332c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eeefbe1bfc84cf3abc9cb3843bdf1f9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:16.019138 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-fa9ef266-6221-46df-929b-ad7430f332c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eeefbe1bfc84cf3abc9cb3843bdf1f9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:16.026363 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1227/2463] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:30:15 2022] DELETE /identity/v3/users/1eeefbe1bfc84cf3abc9cb3843bdf1f9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:30:16.329083 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1aec2-5490-4d47-855a-8a41451e1222 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:16.330715 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-efe1aec2-5490-4d47-855a-8a41451e1222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:16.344562 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1aec2-5490-4d47-855a-8a41451e1222 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:16.404358 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb1a8e-800b-42a1-83a0-b96d65126a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:16.405118 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb1a8e-800b-42a1-83a0-b96d65126a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:16.405590 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb1a8e-800b-42a1-83a0-b96d65126a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:16.405867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb1a8e-800b-42a1-83a0-b96d65126a4a admin admin] PATH_INFO: `/v3/projects/76e848aa26454cedbcc0803f13bfe218` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:16.407526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb1a8e-800b-42a1-83a0-b96d65126a4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=76e848aa26454cedbcc0803f13bfe218)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:16.408981 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb1a8e-800b-42a1-83a0-b96d65126a4a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:16.457505 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-a9cb1a8e-800b-42a1-83a0-b96d65126a4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76e848aa26454cedbcc0803f13bfe218', 'request_id': 'req-a9cb1a8e-800b-42a1-83a0-b96d65126a4a'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:16.466629 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-a9cb1a8e-800b-42a1-83a0-b96d65126a4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76e848aa26454cedbcc0803f13bfe218', 'request_id': 'req-a9cb1a8e-800b-42a1-83a0-b96d65126a4a'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:16.472887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-a9cb1a8e-800b-42a1-83a0-b96d65126a4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76e848aa26454cedbcc0803f13bfe218', 'request_id': 'req-a9cb1a8e-800b-42a1-83a0-b96d65126a4a'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:16.484427 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-a9cb1a8e-800b-42a1-83a0-b96d65126a4a admin admin] The token cache is being invalidate because project 76e848aa26454cedbcc0803f13bfe218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:30:16.484736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-a9cb1a8e-800b-42a1-83a0-b96d65126a4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:16.486201 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-a9cb1a8e-800b-42a1-83a0-b96d65126a4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:16.488232 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1237/2464] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:30:16 2022] DELETE /identity/v3/projects/76e848aa26454cedbcc0803f13bfe218 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:30:16.494294 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de70f4-2917-43e5-a40b-95858ab1fb63 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:16.494653 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de70f4-2917-43e5-a40b-95858ab1fb63 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:16.494999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de70f4-2917-43e5-a40b-95858ab1fb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:16.512644 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-61de70f4-2917-43e5-a40b-95858ab1fb63 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:16.513843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-61de70f4-2917-43e5-a40b-95858ab1fb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:16.576399 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1228/2465] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:16.585616 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f918b-dea0-4254-9d29-742d752943c9 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:16.585977 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f918b-dea0-4254-9d29-742d752943c9 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:16.586333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f918b-dea0-4254-9d29-742d752943c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:16.605073 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-342f918b-dea0-4254-9d29-742d752943c9 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:16.606922 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-342f918b-dea0-4254-9d29-742d752943c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:16.615919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1238/2466] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:16.620387 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de70f4-2917-43e5-a40b-95858ab1fb63 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:16.631997 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de70f4-2917-43e5-a40b-95858ab1fb63 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:16.636995 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdf1e8-cd60-4d8f-825f-bd34d9600a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:16.638238 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdf1e8-cd60-4d8f-825f-bd34d9600a8d admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:16.638517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdf1e8-cd60-4d8f-825f-bd34d9600a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:16.638788 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdf1e8-cd60-4d8f-825f-bd34d9600a8d admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:16.639510 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdf1e8-cd60-4d8f-825f-bd34d9600a8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:30:16.639850 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdf1e8-cd60-4d8f-825f-bd34d9600a8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:16.641474 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdf1e8-cd60-4d8f-825f-bd34d9600a8d admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:16.656777 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1229/2467] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:30:16.657785 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f918b-dea0-4254-9d29-742d752943c9 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:16.666991 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f918b-dea0-4254-9d29-742d752943c9 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:16.671861 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f5d24-1c01-4fa6-9dac-066aed9478b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:16.672575 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f5d24-1c01-4fa6-9dac-066aed9478b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:16.672856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f5d24-1c01-4fa6-9dac-066aed9478b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:16.673130 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f5d24-1c01-4fa6-9dac-066aed9478b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:16.673839 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f5d24-1c01-4fa6-9dac-066aed9478b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:16.675740 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f5d24-1c01-4fa6-9dac-066aed9478b3 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:16.703782 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1239/2468] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:30:16 2022] POST /identity/v3/projects => generated 361 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:30:16.708505 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdf1e8-cd60-4d8f-825f-bd34d9600a8d admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:16.718463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdf1e8-cd60-4d8f-825f-bd34d9600a8d admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:16.773389 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73c2c8-f3f5-49d7-b2cd-89b7066d8614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:16.774058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73c2c8-f3f5-49d7-b2cd-89b7066d8614 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:16.774346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73c2c8-f3f5-49d7-b2cd-89b7066d8614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:16.774733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73c2c8-f3f5-49d7-b2cd-89b7066d8614 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:16.775454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73c2c8-f3f5-49d7-b2cd-89b7066d8614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:16.777469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73c2c8-f3f5-49d7-b2cd-89b7066d8614 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:16.800045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1230/2469] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:30:16 2022] POST /identity/v3/users => generated 281 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:30:16.803875 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f5d24-1c01-4fa6-9dac-066aed9478b3 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:16.814430 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f5d24-1c01-4fa6-9dac-066aed9478b3 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:16.819491 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3bf3d-7d37-4b05-a593-f0e83caad849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:16.820184 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3bf3d-7d37-4b05-a593-f0e83caad849 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:16.820470 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3bf3d-7d37-4b05-a593-f0e83caad849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:16.820749 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3bf3d-7d37-4b05-a593-f0e83caad849 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:16.821480 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3bf3d-7d37-4b05-a593-f0e83caad849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:16.823121 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3bf3d-7d37-4b05-a593-f0e83caad849 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:16.834315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1240/2470] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:30:16.838303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73c2c8-f3f5-49d7-b2cd-89b7066d8614 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:16.849668 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73c2c8-f3f5-49d7-b2cd-89b7066d8614 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:16.854797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c42232-40ef-4072-bed5-9d57eb8e47b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:16.855548 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c42232-40ef-4072-bed5-9d57eb8e47b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:16.856011 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c42232-40ef-4072-bed5-9d57eb8e47b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:16.856436 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c42232-40ef-4072-bed5-9d57eb8e47b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:16.857171 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c42232-40ef-4072-bed5-9d57eb8e47b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:16.858787 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c42232-40ef-4072-bed5-9d57eb8e47b8 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:16.869275 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1231/2471] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:30:16.873973 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3bf3d-7d37-4b05-a593-f0e83caad849 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:16.884448 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3bf3d-7d37-4b05-a593-f0e83caad849 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:16.890072 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31443a1-6a92-4539-b2d4-983ea17e2450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:16.891191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31443a1-6a92-4539-b2d4-983ea17e2450 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:16.891751 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31443a1-6a92-4539-b2d4-983ea17e2450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:16.892030 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31443a1-6a92-4539-b2d4-983ea17e2450 admin admin] PATH_INFO: `/v3/projects/fcbed4620d73422bb18326ea991806f8/users/732faeaf04934de0aa37cf2a84aaeab2/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:16.907969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31443a1-6a92-4539-b2d4-983ea17e2450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcbed4620d73422bb18326ea991806f8, user_id=732faeaf04934de0aa37cf2a84aaeab2, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:16.910614 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31443a1-6a92-4539-b2d4-983ea17e2450 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:16.925868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1241/2472] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:30:16 2022] PUT /identity/v3/projects/fcbed4620d73422bb18326ea991806f8/users/732faeaf04934de0aa37cf2a84aaeab2/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:30:16.936598 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6cf48-f3aa-46e7-af8d-3e0329f24ffe None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:16.936885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6cf48-f3aa-46e7-af8d-3e0329f24ffe None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:16.937162 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6cf48-f3aa-46e7-af8d-3e0329f24ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:16.967085 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-25c6cf48-f3aa-46e7-af8d-3e0329f24ffe None None] MFA Rules not processed for user `732faeaf04934de0aa37cf2a84aaeab2`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:16.968469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-25c6cf48-f3aa-46e7-af8d-3e0329f24ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:17.059701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1232/2473] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:30:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:17.093892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31443a1-6a92-4539-b2d4-983ea17e2450 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:17.095636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f31443a1-6a92-4539-b2d4-983ea17e2450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:17.177951 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31443a1-6a92-4539-b2d4-983ea17e2450 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:17.181974 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5bbab-ac65-44f9-9240-0106c4e96495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:17.182627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5bbab-ac65-44f9-9240-0106c4e96495 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:17.182906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5bbab-ac65-44f9-9240-0106c4e96495 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:17.183179 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5bbab-ac65-44f9-9240-0106c4e96495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:17.193870 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5bbab-ac65-44f9-9240-0106c4e96495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:17.195739 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5bbab-ac65-44f9-9240-0106c4e96495 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:17.205955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1242/2474] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:30:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:17.225477 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6cf48-f3aa-46e7-af8d-3e0329f24ffe None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:17.263537 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aeb5e7-559d-429b-94b6-8763d7558723 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:17.264097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aeb5e7-559d-429b-94b6-8763d7558723 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:17.264643 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aeb5e7-559d-429b-94b6-8763d7558723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:17.293794 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-d8aeb5e7-559d-429b-94b6-8763d7558723 None None] MFA Rules not processed for user `38a56f3572874938ad4642fa34751a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:17.296230 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-d8aeb5e7-559d-429b-94b6-8763d7558723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:17.306731 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6cf48-f3aa-46e7-af8d-3e0329f24ffe None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:17.312866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd162536-9478-439e-9206-21701e4d181c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:17.313980 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd162536-9478-439e-9206-21701e4d181c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:17.314121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd162536-9478-439e-9206-21701e4d181c admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:17.314294 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd162536-9478-439e-9206-21701e4d181c admin admin] PATH_INFO: `/v3/users/732faeaf04934de0aa37cf2a84aaeab2` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:17.315655 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd162536-9478-439e-9206-21701e4d181c admin admin] RBAC: Authorizing `identity:delete_user(user_id=732faeaf04934de0aa37cf2a84aaeab2)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:17.318262 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd162536-9478-439e-9206-21701e4d181c admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:17.398813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-dd162536-9478-439e-9206-21701e4d181c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '732faeaf04934de0aa37cf2a84aaeab2'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:17.412364 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-dd162536-9478-439e-9206-21701e4d181c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '732faeaf04934de0aa37cf2a84aaeab2'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:17.420271 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-dd162536-9478-439e-9206-21701e4d181c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '732faeaf04934de0aa37cf2a84aaeab2'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:17.421150 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-dd162536-9478-439e-9206-21701e4d181c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '732faeaf04934de0aa37cf2a84aaeab2'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:17.421366 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1243/2475] 10.222.0.71 () {58 vars in 1009 bytes} [Mon May 16 20:30:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:30:17.432743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-dd162536-9478-439e-9206-21701e4d181c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '732faeaf04934de0aa37cf2a84aaeab2'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:17.445869 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1233/2476] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:30:17 2022] DELETE /identity/v3/users/732faeaf04934de0aa37cf2a84aaeab2 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:30:17.447946 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac2b34-f31b-4809-a6de-569942bb30db None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:17.448407 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac2b34-f31b-4809-a6de-569942bb30db None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:17.448698 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac2b34-f31b-4809-a6de-569942bb30db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:17.457530 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd162536-9478-439e-9206-21701e4d181c admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:17.460778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-dd162536-9478-439e-9206-21701e4d181c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:17.477510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-78ac2b34-f31b-4809-a6de-569942bb30db None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:17.478734 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-78ac2b34-f31b-4809-a6de-569942bb30db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:17.561931 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1244/2477] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:30:17.571863 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac2b34-f31b-4809-a6de-569942bb30db None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:17.573475 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-78ac2b34-f31b-4809-a6de-569942bb30db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:17.587088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd162536-9478-439e-9206-21701e4d181c admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:17.593488 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713909b-6410-4c3a-9787-735f6149d41e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e701cf55d13410aa259ec72578ed27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:17.594156 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713909b-6410-4c3a-9787-735f6149d41e service swift] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:17.594440 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713909b-6410-4c3a-9787-735f6149d41e service swift] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:17.594723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713909b-6410-4c3a-9787-735f6149d41e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:17.598073 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-e713909b-6410-4c3a-9787-735f6149d41e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:17.652481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac2b34-f31b-4809-a6de-569942bb30db None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:17.664945 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39ec96-74af-4a74-96c8-66ab992e0b0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:17.665647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39ec96-74af-4a74-96c8-66ab992e0b0d service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:17.666243 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39ec96-74af-4a74-96c8-66ab992e0b0d service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:17.666531 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39ec96-74af-4a74-96c8-66ab992e0b0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:17.679797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39ec96-74af-4a74-96c8-66ab992e0b0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:17.681267 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39ec96-74af-4a74-96c8-66ab992e0b0d service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:17.695535 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713909b-6410-4c3a-9787-735f6149d41e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:17.697495 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713909b-6410-4c3a-9787-735f6149d41e service swift] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:17.704969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1245/2478] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:30:17.709624 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1234/2479] 10.222.0.71 () {60 vars in 1384 bytes} [Mon May 16 20:30:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 20:30:18.191580 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39ec96-74af-4a74-96c8-66ab992e0b0d service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:18.193147 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-dc39ec96-74af-4a74-96c8-66ab992e0b0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:18.209987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39ec96-74af-4a74-96c8-66ab992e0b0d service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:18.215158 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c553cd2-bbec-498e-a518-82aa5acfa98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:18.216527 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c553cd2-bbec-498e-a518-82aa5acfa98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:18.217026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c553cd2-bbec-498e-a518-82aa5acfa98d admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:18.217921 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c553cd2-bbec-498e-a518-82aa5acfa98d admin admin] PATH_INFO: `/v3/projects/fcbed4620d73422bb18326ea991806f8` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:18.221925 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c553cd2-bbec-498e-a518-82aa5acfa98d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcbed4620d73422bb18326ea991806f8)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:18.225306 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c553cd2-bbec-498e-a518-82aa5acfa98d admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:18.301100 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-5c553cd2-bbec-498e-a518-82aa5acfa98d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcbed4620d73422bb18326ea991806f8', 'request_id': 'req-5c553cd2-bbec-498e-a518-82aa5acfa98d'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:18.326437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-5c553cd2-bbec-498e-a518-82aa5acfa98d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcbed4620d73422bb18326ea991806f8', 'request_id': 'req-5c553cd2-bbec-498e-a518-82aa5acfa98d'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:18.334495 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-5c553cd2-bbec-498e-a518-82aa5acfa98d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcbed4620d73422bb18326ea991806f8', 'request_id': 'req-5c553cd2-bbec-498e-a518-82aa5acfa98d'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:18.346438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-5c553cd2-bbec-498e-a518-82aa5acfa98d admin admin] The token cache is being invalidate because project fcbed4620d73422bb18326ea991806f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:30:18.347030 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-5c553cd2-bbec-498e-a518-82aa5acfa98d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:18.347880 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-5c553cd2-bbec-498e-a518-82aa5acfa98d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:30:18.350248 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1246/2480] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:30:18 2022] DELETE /identity/v3/projects/fcbed4620d73422bb18326ea991806f8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:30:18.354901 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c725744-c3f9-4c93-b75a-0256770528e4 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:18.355468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c725744-c3f9-4c93-b75a-0256770528e4 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:18.355468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c725744-c3f9-4c93-b75a-0256770528e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:18.388282 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-7c725744-c3f9-4c93-b75a-0256770528e4 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:18.389728 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-7c725744-c3f9-4c93-b75a-0256770528e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:18.466847 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1235/2481] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:18.475738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6b669-db99-4025-af8f-d90405fa2861 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:18.476385 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6b669-db99-4025-af8f-d90405fa2861 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:18.476385 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6b669-db99-4025-af8f-d90405fa2861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:18.500695 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-01a6b669-db99-4025-af8f-d90405fa2861 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:18.501943 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-01a6b669-db99-4025-af8f-d90405fa2861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:18.512454 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1247/2482] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:18.517159 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c725744-c3f9-4c93-b75a-0256770528e4 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:18.529891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c725744-c3f9-4c93-b75a-0256770528e4 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:18.535997 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec1dc7-f377-44f3-a7dd-f1990681f08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:18.536790 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec1dc7-f377-44f3-a7dd-f1990681f08b admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:18.537171 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec1dc7-f377-44f3-a7dd-f1990681f08b admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:18.537528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec1dc7-f377-44f3-a7dd-f1990681f08b admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:18.538337 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec1dc7-f377-44f3-a7dd-f1990681f08b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:30:18.538724 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec1dc7-f377-44f3-a7dd-f1990681f08b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:18.540513 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec1dc7-f377-44f3-a7dd-f1990681f08b admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:18.555245 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1236/2483] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:30:18.561145 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6b669-db99-4025-af8f-d90405fa2861 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:18.570683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6b669-db99-4025-af8f-d90405fa2861 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:18.580287 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff405f4-46e0-49f3-8047-6279def56b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:18.581322 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff405f4-46e0-49f3-8047-6279def56b7c admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:18.581833 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff405f4-46e0-49f3-8047-6279def56b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:18.582307 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff405f4-46e0-49f3-8047-6279def56b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:18.583229 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff405f4-46e0-49f3-8047-6279def56b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:18.585358 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff405f4-46e0-49f3-8047-6279def56b7c admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:18.626934 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1248/2484] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:30:18 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:30:18.632224 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec1dc7-f377-44f3-a7dd-f1990681f08b admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:18.643000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec1dc7-f377-44f3-a7dd-f1990681f08b admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:18.725231 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262e5db-cdac-4e11-b4c7-97c76ce71968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:18.726364 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262e5db-cdac-4e11-b4c7-97c76ce71968 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:18.727124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262e5db-cdac-4e11-b4c7-97c76ce71968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:18.727475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262e5db-cdac-4e11-b4c7-97c76ce71968 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:18.728286 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262e5db-cdac-4e11-b4c7-97c76ce71968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:18.732626 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262e5db-cdac-4e11-b4c7-97c76ce71968 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:18.760320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1237/2485] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:30:18 2022] POST /identity/v3/users => generated 286 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:30:18.763386 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff405f4-46e0-49f3-8047-6279def56b7c admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:18.774163 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff405f4-46e0-49f3-8047-6279def56b7c admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:18.779061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45406be0-1b76-4452-ae4a-4effcd5f55d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:18.779719 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45406be0-1b76-4452-ae4a-4effcd5f55d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:18.780014 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45406be0-1b76-4452-ae4a-4effcd5f55d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:18.780313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45406be0-1b76-4452-ae4a-4effcd5f55d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:18.781058 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45406be0-1b76-4452-ae4a-4effcd5f55d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:18.782651 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45406be0-1b76-4452-ae4a-4effcd5f55d4 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:18.795518 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1249/2486] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:30:18.800002 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262e5db-cdac-4e11-b4c7-97c76ce71968 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:18.811143 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262e5db-cdac-4e11-b4c7-97c76ce71968 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:18.815870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7685a-e943-440d-9e1b-606a433fd4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:18.816565 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7685a-e943-440d-9e1b-606a433fd4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:18.816852 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7685a-e943-440d-9e1b-606a433fd4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:18.817126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7685a-e943-440d-9e1b-606a433fd4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:18.817847 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7685a-e943-440d-9e1b-606a433fd4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:18.820699 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7685a-e943-440d-9e1b-606a433fd4c4 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:18.832184 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1238/2487] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:30:18.834899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45406be0-1b76-4452-ae4a-4effcd5f55d4 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:18.847858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45406be0-1b76-4452-ae4a-4effcd5f55d4 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:18.854900 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db6063-8469-4041-b319-b5b691ef6b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:18.854900 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db6063-8469-4041-b319-b5b691ef6b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:18.854900 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db6063-8469-4041-b319-b5b691ef6b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:18.855242 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db6063-8469-4041-b319-b5b691ef6b03 admin admin] PATH_INFO: `/v3/projects/4dd508b1a1d544cd982cf0b2db5ccdb5/users/9b1836429585450c8430d03cb5d1db18/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:18.878301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db6063-8469-4041-b319-b5b691ef6b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd508b1a1d544cd982cf0b2db5ccdb5, user_id=9b1836429585450c8430d03cb5d1db18, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:18.881133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db6063-8469-4041-b319-b5b691ef6b03 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:18.902991 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1250/2488] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:30:18 2022] PUT /identity/v3/projects/4dd508b1a1d544cd982cf0b2db5ccdb5/users/9b1836429585450c8430d03cb5d1db18/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:30:18.911212 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5467b5-3131-441e-8b1f-f86b714c8c08 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:18.911684 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5467b5-3131-441e-8b1f-f86b714c8c08 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:18.912071 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5467b5-3131-441e-8b1f-f86b714c8c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:18.930952 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-9b5467b5-3131-441e-8b1f-f86b714c8c08 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:18.933213 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-9b5467b5-3131-441e-8b1f-f86b714c8c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:19.005593 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1239/2489] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:19.015859 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db6063-8469-4041-b319-b5b691ef6b03 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:19.017906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f6db6063-8469-4041-b319-b5b691ef6b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:19.085532 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db6063-8469-4041-b319-b5b691ef6b03 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:19.089305 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28f1ad-f177-4559-a7f3-02854696aea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:19.090489 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28f1ad-f177-4559-a7f3-02854696aea4 service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:19.091229 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28f1ad-f177-4559-a7f3-02854696aea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:19.091509 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28f1ad-f177-4559-a7f3-02854696aea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:19.101815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28f1ad-f177-4559-a7f3-02854696aea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:19.103425 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28f1ad-f177-4559-a7f3-02854696aea4 service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:19.120589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1251/2490] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:30:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:20.186452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb6e50-2c34-4542-8f3e-b0782d1c1854 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:20.187528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb6e50-2c34-4542-8f3e-b0782d1c1854 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:20.188084 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb6e50-2c34-4542-8f3e-b0782d1c1854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:20.235071 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-26cb6e50-2c34-4542-8f3e-b0782d1c1854 None None] MFA Rules not processed for user `9b1836429585450c8430d03cb5d1db18`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:20.236311 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-26cb6e50-2c34-4542-8f3e-b0782d1c1854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:20.348960 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1240/2491] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:30:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:20.360349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28f1ad-f177-4559-a7f3-02854696aea4 service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:20.361761 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-4b28f1ad-f177-4559-a7f3-02854696aea4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:20.442813 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28f1ad-f177-4559-a7f3-02854696aea4 service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:20.447196 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d7b38-9281-48c4-ba99-472f35dded4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:20.447936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d7b38-9281-48c4-ba99-472f35dded4e service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:20.448321 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d7b38-9281-48c4-ba99-472f35dded4e service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:20.448670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d7b38-9281-48c4-ba99-472f35dded4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:20.459185 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d7b38-9281-48c4-ba99-472f35dded4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:20.460734 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d7b38-9281-48c4-ba99-472f35dded4e service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:20.473039 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1252/2492] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:30:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:30:21.887349 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b06cc6-6918-4ef1-b8ae-0103e192c1c3 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:21.887928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b06cc6-6918-4ef1-b8ae-0103e192c1c3 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:21.888031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b06cc6-6918-4ef1-b8ae-0103e192c1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:21.915825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-80b06cc6-6918-4ef1-b8ae-0103e192c1c3 None None] MFA Rules not processed for user `9b1836429585450c8430d03cb5d1db18`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:21.917048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-80b06cc6-6918-4ef1-b8ae-0103e192c1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:21.924770 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1241/2493] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:30:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:22.429614 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d7b38-9281-48c4-ba99-472f35dded4e service cinder] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:22.433319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-ff9d7b38-9281-48c4-ba99-472f35dded4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:22.447197 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d7b38-9281-48c4-ba99-472f35dded4e service cinder] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:22.453305 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485e2ec-638c-442d-af43-93afaa16daba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:22.454049 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485e2ec-638c-442d-af43-93afaa16daba service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:22.454443 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485e2ec-638c-442d-af43-93afaa16daba service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:22.454995 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485e2ec-638c-442d-af43-93afaa16daba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:22.456984 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-6485e2ec-638c-442d-af43-93afaa16daba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:22.469067 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485e2ec-638c-442d-af43-93afaa16daba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:22.470705 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485e2ec-638c-442d-af43-93afaa16daba service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:22.480016 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1253/2494] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:30:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:22.849351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b06cc6-6918-4ef1-b8ae-0103e192c1c3 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:22.850750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-80b06cc6-6918-4ef1-b8ae-0103e192c1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:22.939811 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b06cc6-6918-4ef1-b8ae-0103e192c1c3 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:22.945074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db2d02-a802-4a4c-9c2e-7af5619b1a6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e2c8b4ff2349919750aa0f3f7309bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:22.945869 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db2d02-a802-4a4c-9c2e-7af5619b1a6b service placement] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:22.946267 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db2d02-a802-4a4c-9c2e-7af5619b1a6b service placement] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:22.946688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db2d02-a802-4a4c-9c2e-7af5619b1a6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:22.948764 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f6db2d02-a802-4a4c-9c2e-7af5619b1a6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:22.963478 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db2d02-a802-4a4c-9c2e-7af5619b1a6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:22.966970 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db2d02-a802-4a4c-9c2e-7af5619b1a6b service placement] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:22.978554 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1242/2495] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:30:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:23.288125 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485e2ec-638c-442d-af43-93afaa16daba service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:23.290288 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-6485e2ec-638c-442d-af43-93afaa16daba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:23.394326 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485e2ec-638c-442d-af43-93afaa16daba service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:23.401600 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a573a-9f25-409a-8aba-fb634ad5220b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:23.402384 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a573a-9f25-409a-8aba-fb634ad5220b service nova] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:23.402666 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a573a-9f25-409a-8aba-fb634ad5220b service nova] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:23.402956 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a573a-9f25-409a-8aba-fb634ad5220b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:23.404933 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-eb3a573a-9f25-409a-8aba-fb634ad5220b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:23.508059 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a573a-9f25-409a-8aba-fb634ad5220b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:23.509827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a573a-9f25-409a-8aba-fb634ad5220b service nova] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:23.523227 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1254/2496] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:30:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:24.983619 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db2d02-a802-4a4c-9c2e-7af5619b1a6b service placement] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:24.993385 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db2d02-a802-4a4c-9c2e-7af5619b1a6b service placement] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:25.010593 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3142b5-c96f-4cc7-aebb-a9bcbd8372e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:25.015865 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3142b5-c96f-4cc7-aebb-a9bcbd8372e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:25.018033 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3142b5-c96f-4cc7-aebb-a9bcbd8372e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:25.018530 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3142b5-c96f-4cc7-aebb-a9bcbd8372e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:25.020727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-dd3142b5-c96f-4cc7-aebb-a9bcbd8372e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:25.036839 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3142b5-c96f-4cc7-aebb-a9bcbd8372e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:25.039260 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3142b5-c96f-4cc7-aebb-a9bcbd8372e2 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:25.052127 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1243/2497] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:30:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:27.504883 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a573a-9f25-409a-8aba-fb634ad5220b service nova] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:27.506428 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-eb3a573a-9f25-409a-8aba-fb634ad5220b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:27.616215 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a573a-9f25-409a-8aba-fb634ad5220b service nova] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:27.620095 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d0965-41f2-408f-b007-aa262e9f256b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62c3f9351a4181a4fc2930570171b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:27.620825 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d0965-41f2-408f-b007-aa262e9f256b service glance] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:27.621429 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d0965-41f2-408f-b007-aa262e9f256b service glance] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:27.621810 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d0965-41f2-408f-b007-aa262e9f256b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:27.623970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-605d0965-41f2-408f-b007-aa262e9f256b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:27.705271 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d0965-41f2-408f-b007-aa262e9f256b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:27.707143 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d0965-41f2-408f-b007-aa262e9f256b service glance] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:27.717519 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1255/2498] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:30:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:35.180858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca595b56-4898-447a-9b9d-b2116b19d175 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:35.181815 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca595b56-4898-447a-9b9d-b2116b19d175 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:35.182098 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca595b56-4898-447a-9b9d-b2116b19d175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:35.200004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-ca595b56-4898-447a-9b9d-b2116b19d175 None None] MFA Rules not processed for user `38a56f3572874938ad4642fa34751a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:35.201237 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-ca595b56-4898-447a-9b9d-b2116b19d175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:35.272433 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1244/2499] 10.222.0.71 () {58 vars in 1009 bytes} [Mon May 16 20:30:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:35.284791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d0965-41f2-408f-b007-aa262e9f256b service glance] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:35.286195 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-605d0965-41f2-408f-b007-aa262e9f256b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:35.360513 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d0965-41f2-408f-b007-aa262e9f256b service glance] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:35.365452 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce194b9-e691-48df-8c02-30bbaf06ef07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e701cf55d13410aa259ec72578ed27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:35.366086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce194b9-e691-48df-8c02-30bbaf06ef07 service swift] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:35.366568 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce194b9-e691-48df-8c02-30bbaf06ef07 service swift] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:35.366848 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce194b9-e691-48df-8c02-30bbaf06ef07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:35.374706 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce194b9-e691-48df-8c02-30bbaf06ef07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:35.377598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce194b9-e691-48df-8c02-30bbaf06ef07 service swift] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:35.390181 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1256/2500] 10.222.0.71 () {60 vars in 1384 bytes} [Mon May 16 20:30:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:30:46.241911 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca595b56-4898-447a-9b9d-b2116b19d175 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:46.243328 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-ca595b56-4898-447a-9b9d-b2116b19d175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:46.259718 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca595b56-4898-447a-9b9d-b2116b19d175 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:46.265260 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa31811-d856-4dc7-84bc-7e424750cda9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:46.266229 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa31811-d856-4dc7-84bc-7e424750cda9 service nova] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:46.266526 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa31811-d856-4dc7-84bc-7e424750cda9 service nova] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:46.266808 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa31811-d856-4dc7-84bc-7e424750cda9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:46.269899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-8aa31811-d856-4dc7-84bc-7e424750cda9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:46.282088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa31811-d856-4dc7-84bc-7e424750cda9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:46.284736 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa31811-d856-4dc7-84bc-7e424750cda9 service nova] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:46.295496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1245/2501] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:30:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:47.702295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fdc27-1c80-4735-a302-3210a2c7da95 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:47.702854 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fdc27-1c80-4735-a302-3210a2c7da95 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:47.702854 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fdc27-1c80-4735-a302-3210a2c7da95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:47.721775 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-254fdc27-1c80-4735-a302-3210a2c7da95 None None] MFA Rules not processed for user `9b1836429585450c8430d03cb5d1db18`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:47.723167 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-254fdc27-1c80-4735-a302-3210a2c7da95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:47.732481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1257/2502] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:30:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:50.122047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa31811-d856-4dc7-84bc-7e424750cda9 service nova] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:50.141743 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa31811-d856-4dc7-84bc-7e424750cda9 service nova] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:50.164729 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e1b82-1abe-4523-b1c2-c17dfa03a9f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:50.165645 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e1b82-1abe-4523-b1c2-c17dfa03a9f5 service nova] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:50.166094 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e1b82-1abe-4523-b1c2-c17dfa03a9f5 service nova] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:50.167999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e1b82-1abe-4523-b1c2-c17dfa03a9f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:50.174129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-369e1b82-1abe-4523-b1c2-c17dfa03a9f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:50.200972 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e1b82-1abe-4523-b1c2-c17dfa03a9f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:50.202683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e1b82-1abe-4523-b1c2-c17dfa03a9f5 service nova] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:50.219716 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1246/2503] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:30:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:30:52.768499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb7656-8f58-46ed-9f64-5f0c7b0749f3 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:52.769368 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb7656-8f58-46ed-9f64-5f0c7b0749f3 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:52.769645 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb7656-8f58-46ed-9f64-5f0c7b0749f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:52.787308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-61bb7656-8f58-46ed-9f64-5f0c7b0749f3 None None] MFA Rules not processed for user `38a56f3572874938ad4642fa34751a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:30:52.788533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-61bb7656-8f58-46ed-9f64-5f0c7b0749f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:52.795638 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1258/2504] 10.222.0.71 () {58 vars in 967 bytes} [Mon May 16 20:30:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:30:52.808983 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e1b82-1abe-4523-b1c2-c17dfa03a9f5 service nova] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:52.821164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e1b82-1abe-4523-b1c2-c17dfa03a9f5 service nova] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:52.826056 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcab13e-1363-4fdb-b659-7f3ca3440f51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e701cf55d13410aa259ec72578ed27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:52.826723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcab13e-1363-4fdb-b659-7f3ca3440f51 service swift] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:52.827005 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcab13e-1363-4fdb-b659-7f3ca3440f51 service swift] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:52.827280 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcab13e-1363-4fdb-b659-7f3ca3440f51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:52.835353 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcab13e-1363-4fdb-b659-7f3ca3440f51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:52.836950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcab13e-1363-4fdb-b659-7f3ca3440f51 service swift] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:52.844728 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1247/2505] 10.222.0.71 () {60 vars in 1384 bytes} [Mon May 16 20:30:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:30:54.341734 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb7656-8f58-46ed-9f64-5f0c7b0749f3 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:30:54.355519 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb7656-8f58-46ed-9f64-5f0c7b0749f3 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:30:54.361676 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc20ae-c10d-4f28-9c23-062254b2ee51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:30:54.362363 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc20ae-c10d-4f28-9c23-062254b2ee51 service nova] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:30:54.362647 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc20ae-c10d-4f28-9c23-062254b2ee51 service nova] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:30:54.362921 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc20ae-c10d-4f28-9c23-062254b2ee51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:30:54.364780 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-bccc20ae-c10d-4f28-9c23-062254b2ee51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:30:54.377711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc20ae-c10d-4f28-9c23-062254b2ee51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:30:54.387107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc20ae-c10d-4f28-9c23-062254b2ee51 service nova] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:30:54.400078 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1259/2506] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:30:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:31:00.029366 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcab13e-1363-4fdb-b659-7f3ca3440f51 service swift] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:00.040226 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcab13e-1363-4fdb-b659-7f3ca3440f51 service swift] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:00.043873 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc755d-ccf5-4214-a526-a5f9d8c4fb61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:00.044688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc755d-ccf5-4214-a526-a5f9d8c4fb61 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:00.044996 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc755d-ccf5-4214-a526-a5f9d8c4fb61 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:00.045270 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc755d-ccf5-4214-a526-a5f9d8c4fb61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:00.047697 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-d1fc755d-ccf5-4214-a526-a5f9d8c4fb61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:00.062676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc755d-ccf5-4214-a526-a5f9d8c4fb61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:00.064882 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc755d-ccf5-4214-a526-a5f9d8c4fb61 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:00.075734 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1248/2507] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:31:04.399370 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc20ae-c10d-4f28-9c23-062254b2ee51 service nova] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:04.400842 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-bccc20ae-c10d-4f28-9c23-062254b2ee51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:04.414859 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc20ae-c10d-4f28-9c23-062254b2ee51 service nova] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:04.419466 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28b7e8-6405-4b8d-b5f5-eec1b3e1e7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:04.420245 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28b7e8-6405-4b8d-b5f5-eec1b3e1e7df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:04.420744 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28b7e8-6405-4b8d-b5f5-eec1b3e1e7df admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:04.420972 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28b7e8-6405-4b8d-b5f5-eec1b3e1e7df admin admin] PATH_INFO: `/v3/users/4bf4652bf6ac4713ab4931365b943d3f` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:04.422152 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28b7e8-6405-4b8d-b5f5-eec1b3e1e7df admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bf4652bf6ac4713ab4931365b943d3f)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:04.426637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28b7e8-6405-4b8d-b5f5-eec1b3e1e7df admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:04.472239 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-fa28b7e8-6405-4b8d-b5f5-eec1b3e1e7df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bf4652bf6ac4713ab4931365b943d3f'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:04.472944 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-fa28b7e8-6405-4b8d-b5f5-eec1b3e1e7df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bf4652bf6ac4713ab4931365b943d3f'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:04.480016 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-fa28b7e8-6405-4b8d-b5f5-eec1b3e1e7df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bf4652bf6ac4713ab4931365b943d3f'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:04.489388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-fa28b7e8-6405-4b8d-b5f5-eec1b3e1e7df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bf4652bf6ac4713ab4931365b943d3f'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:04.503613 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-fa28b7e8-6405-4b8d-b5f5-eec1b3e1e7df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bf4652bf6ac4713ab4931365b943d3f'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:04.509569 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1260/2508] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:31:04 2022] DELETE /identity/v3/users/4bf4652bf6ac4713ab4931365b943d3f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:31:04.698164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc755d-ccf5-4214-a526-a5f9d8c4fb61 service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:04.711410 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc755d-ccf5-4214-a526-a5f9d8c4fb61 service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:04.774187 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881e406-c1fe-4763-891f-582f6a1e7725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:04.775045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881e406-c1fe-4763-891f-582f6a1e7725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:04.775329 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881e406-c1fe-4763-891f-582f6a1e7725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:04.775603 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881e406-c1fe-4763-891f-582f6a1e7725 admin admin] PATH_INFO: `/v3/projects/10f3494602c84c748ead115d649fc9cc` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:04.776783 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881e406-c1fe-4763-891f-582f6a1e7725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10f3494602c84c748ead115d649fc9cc)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:04.778713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881e406-c1fe-4763-891f-582f6a1e7725 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:04.823290 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-e881e406-c1fe-4763-891f-582f6a1e7725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10f3494602c84c748ead115d649fc9cc', 'request_id': 'req-e881e406-c1fe-4763-891f-582f6a1e7725'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:04.828896 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-e881e406-c1fe-4763-891f-582f6a1e7725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10f3494602c84c748ead115d649fc9cc', 'request_id': 'req-e881e406-c1fe-4763-891f-582f6a1e7725'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:04.837618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-e881e406-c1fe-4763-891f-582f6a1e7725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10f3494602c84c748ead115d649fc9cc', 'request_id': 'req-e881e406-c1fe-4763-891f-582f6a1e7725'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:04.852567 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-e881e406-c1fe-4763-891f-582f6a1e7725 admin admin] The token cache is being invalidate because project 10f3494602c84c748ead115d649fc9cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:31:04.852856 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-e881e406-c1fe-4763-891f-582f6a1e7725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:04.853702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-e881e406-c1fe-4763-891f-582f6a1e7725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:04.855227 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1249/2509] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:31:04 2022] DELETE /identity/v3/projects/10f3494602c84c748ead115d649fc9cc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:31:04.860181 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583616c9-4b05-4573-9d44-0d2c69a10841 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:04.861331 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583616c9-4b05-4573-9d44-0d2c69a10841 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:04.861683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583616c9-4b05-4573-9d44-0d2c69a10841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:04.880495 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-583616c9-4b05-4573-9d44-0d2c69a10841 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:04.881688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-583616c9-4b05-4573-9d44-0d2c69a10841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:04.941378 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1261/2510] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:04.949968 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90ea4c-a3c0-4547-9f43-1293f16c4cf9 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:04.950365 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90ea4c-a3c0-4547-9f43-1293f16c4cf9 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:04.950720 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90ea4c-a3c0-4547-9f43-1293f16c4cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:04.969626 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-fd90ea4c-a3c0-4547-9f43-1293f16c4cf9 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:04.971408 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-fd90ea4c-a3c0-4547-9f43-1293f16c4cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:04.981866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1250/2511] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:04.986020 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583616c9-4b05-4573-9d44-0d2c69a10841 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:04.995765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583616c9-4b05-4573-9d44-0d2c69a10841 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:05.000358 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91afa9f-b18c-48ed-9cc4-f4e62aa96421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:05.001079 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91afa9f-b18c-48ed-9cc4-f4e62aa96421 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:05.001643 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91afa9f-b18c-48ed-9cc4-f4e62aa96421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:05.002098 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91afa9f-b18c-48ed-9cc4-f4e62aa96421 admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:05.002987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91afa9f-b18c-48ed-9cc4-f4e62aa96421 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:31:05.003351 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91afa9f-b18c-48ed-9cc4-f4e62aa96421 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:05.004982 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91afa9f-b18c-48ed-9cc4-f4e62aa96421 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:05.019938 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1262/2512] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:31:05.024545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90ea4c-a3c0-4547-9f43-1293f16c4cf9 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:05.034058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90ea4c-a3c0-4547-9f43-1293f16c4cf9 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:05.038910 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53045e7-1d81-4a6b-8621-29d9f7e9701e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:05.039569 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53045e7-1d81-4a6b-8621-29d9f7e9701e admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:05.039854 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53045e7-1d81-4a6b-8621-29d9f7e9701e admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:05.040129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53045e7-1d81-4a6b-8621-29d9f7e9701e admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:05.040863 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53045e7-1d81-4a6b-8621-29d9f7e9701e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:05.042784 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53045e7-1d81-4a6b-8621-29d9f7e9701e admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:05.072854 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1251/2513] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:31:05 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:31:05.077110 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91afa9f-b18c-48ed-9cc4-f4e62aa96421 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:05.087003 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91afa9f-b18c-48ed-9cc4-f4e62aa96421 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:05.144268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79ea73-3790-41d7-9f9f-4c3cf6f96c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:05.144934 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79ea73-3790-41d7-9f9f-4c3cf6f96c1a admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:05.145218 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79ea73-3790-41d7-9f9f-4c3cf6f96c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:05.145495 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79ea73-3790-41d7-9f9f-4c3cf6f96c1a admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:05.146187 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79ea73-3790-41d7-9f9f-4c3cf6f96c1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:05.148110 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79ea73-3790-41d7-9f9f-4c3cf6f96c1a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:05.170721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1263/2514] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:31:05 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:31:05.171823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53045e7-1d81-4a6b-8621-29d9f7e9701e admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:05.182220 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53045e7-1d81-4a6b-8621-29d9f7e9701e admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:05.186902 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831ef62-6166-4779-be58-a4b871f86903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:05.187564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831ef62-6166-4779-be58-a4b871f86903 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:05.187852 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831ef62-6166-4779-be58-a4b871f86903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:05.188170 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831ef62-6166-4779-be58-a4b871f86903 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:05.189666 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831ef62-6166-4779-be58-a4b871f86903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:05.191411 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831ef62-6166-4779-be58-a4b871f86903 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:05.202024 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1252/2515] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:31:05.208245 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79ea73-3790-41d7-9f9f-4c3cf6f96c1a admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:05.218440 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79ea73-3790-41d7-9f9f-4c3cf6f96c1a admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:05.224031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3ebb9-bfe6-4674-930e-4d999642846f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:05.224792 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3ebb9-bfe6-4674-930e-4d999642846f admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:05.225146 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3ebb9-bfe6-4674-930e-4d999642846f admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:05.225425 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3ebb9-bfe6-4674-930e-4d999642846f admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:05.226158 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3ebb9-bfe6-4674-930e-4d999642846f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:05.230695 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3ebb9-bfe6-4674-930e-4d999642846f admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:05.242167 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1264/2516] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:31:05.245703 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831ef62-6166-4779-be58-a4b871f86903 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:05.257442 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831ef62-6166-4779-be58-a4b871f86903 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:05.262726 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00f582-0743-4c53-a06a-4c13af077564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:05.263604 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00f582-0743-4c53-a06a-4c13af077564 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:05.263916 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00f582-0743-4c53-a06a-4c13af077564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:05.264301 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00f582-0743-4c53-a06a-4c13af077564 admin admin] PATH_INFO: `/v3/projects/fe3e2f287b3d4b9ebc28058364ba7ae5/users/7d226a515393444ba48e44e0e270d870/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:05.279844 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00f582-0743-4c53-a06a-4c13af077564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe3e2f287b3d4b9ebc28058364ba7ae5, user_id=7d226a515393444ba48e44e0e270d870, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:05.282667 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00f582-0743-4c53-a06a-4c13af077564 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:05.295421 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1253/2517] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:31:05 2022] PUT /identity/v3/projects/fe3e2f287b3d4b9ebc28058364ba7ae5/users/7d226a515393444ba48e44e0e270d870/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:31:05.306301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9b7ff-f7ce-4d41-9456-cc1db0f28b0a None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:05.306677 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9b7ff-f7ce-4d41-9456-cc1db0f28b0a None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:05.307014 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9b7ff-f7ce-4d41-9456-cc1db0f28b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:05.333721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-1bc9b7ff-f7ce-4d41-9456-cc1db0f28b0a None None] MFA Rules not processed for user `7d226a515393444ba48e44e0e270d870`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:05.334969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-1bc9b7ff-f7ce-4d41-9456-cc1db0f28b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:05.397646 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1265/2518] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:31:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:05.402075 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00f582-0743-4c53-a06a-4c13af077564 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:05.462434 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00f582-0743-4c53-a06a-4c13af077564 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:05.467229 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb6f88-fe0b-4f46-844c-bd4cacf5d193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:05.467880 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb6f88-fe0b-4f46-844c-bd4cacf5d193 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:05.468175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb6f88-fe0b-4f46-844c-bd4cacf5d193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:05.468447 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb6f88-fe0b-4f46-844c-bd4cacf5d193 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:05.469117 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb6f88-fe0b-4f46-844c-bd4cacf5d193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:05.471755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb6f88-fe0b-4f46-844c-bd4cacf5d193 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:05.500184 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1254/2519] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:31:05 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:31:05.502052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9b7ff-f7ce-4d41-9456-cc1db0f28b0a None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:05.512359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9b7ff-f7ce-4d41-9456-cc1db0f28b0a None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:05.565366 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ba672-6130-4314-a2df-d920dd1b85f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:05.566014 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ba672-6130-4314-a2df-d920dd1b85f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:05.566290 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ba672-6130-4314-a2df-d920dd1b85f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:05.566558 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ba672-6130-4314-a2df-d920dd1b85f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:05.567260 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ba672-6130-4314-a2df-d920dd1b85f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:05.569199 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ba672-6130-4314-a2df-d920dd1b85f0 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:05.587715 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1266/2520] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:31:05 2022] POST /identity/v3/users => generated 293 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:31:05.591761 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb6f88-fe0b-4f46-844c-bd4cacf5d193 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:05.603614 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb6f88-fe0b-4f46-844c-bd4cacf5d193 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:05.608224 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3e6f9-427c-41ac-8c52-5f01bc8e4492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:05.608891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3e6f9-427c-41ac-8c52-5f01bc8e4492 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:05.609201 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3e6f9-427c-41ac-8c52-5f01bc8e4492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:05.609480 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3e6f9-427c-41ac-8c52-5f01bc8e4492 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:05.610203 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3e6f9-427c-41ac-8c52-5f01bc8e4492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:05.612052 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3e6f9-427c-41ac-8c52-5f01bc8e4492 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:05.623573 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1255/2521] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:31:05.628235 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ba672-6130-4314-a2df-d920dd1b85f0 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:05.638024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ba672-6130-4314-a2df-d920dd1b85f0 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:05.644014 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6891d3-6921-45d1-821e-3da148284a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:05.644974 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6891d3-6921-45d1-821e-3da148284a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:05.645260 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6891d3-6921-45d1-821e-3da148284a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:05.645534 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6891d3-6921-45d1-821e-3da148284a0b admin admin] PATH_INFO: `/v3/projects/6f9f9eab19924a91a6f30aadede17884/users/c3dbc39a1acc47399e6b677709273616/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:05.661496 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6891d3-6921-45d1-821e-3da148284a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f9f9eab19924a91a6f30aadede17884, user_id=c3dbc39a1acc47399e6b677709273616, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:05.664221 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6891d3-6921-45d1-821e-3da148284a0b admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:05.677370 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1267/2522] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:31:05 2022] PUT /identity/v3/projects/6f9f9eab19924a91a6f30aadede17884/users/c3dbc39a1acc47399e6b677709273616/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:31:05.681364 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3e6f9-427c-41ac-8c52-5f01bc8e4492 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:05.691598 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3e6f9-427c-41ac-8c52-5f01bc8e4492 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:05.746717 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9612f2e-8cb4-41db-9057-df133bcd155d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:05.747381 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9612f2e-8cb4-41db-9057-df133bcd155d admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:05.747742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9612f2e-8cb4-41db-9057-df133bcd155d admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:05.748123 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9612f2e-8cb4-41db-9057-df133bcd155d admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:05.748729 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9612f2e-8cb4-41db-9057-df133bcd155d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:05.750300 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9612f2e-8cb4-41db-9057-df133bcd155d admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:05.760376 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1256/2523] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:31:05.764417 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6891d3-6921-45d1-821e-3da148284a0b admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:05.775071 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6891d3-6921-45d1-821e-3da148284a0b admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:05.779625 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b654a-74cf-4ad8-9679-3c046193e682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:05.780505 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b654a-74cf-4ad8-9679-3c046193e682 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:05.780780 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b654a-74cf-4ad8-9679-3c046193e682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:05.781045 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b654a-74cf-4ad8-9679-3c046193e682 admin admin] PATH_INFO: `/v3/projects/6f9f9eab19924a91a6f30aadede17884/users/c3dbc39a1acc47399e6b677709273616/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:05.783550 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b654a-74cf-4ad8-9679-3c046193e682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f9f9eab19924a91a6f30aadede17884, user_id=c3dbc39a1acc47399e6b677709273616, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:05.786186 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b654a-74cf-4ad8-9679-3c046193e682 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:05.796358 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1268/2524] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:31:05 2022] PUT /identity/v3/projects/6f9f9eab19924a91a6f30aadede17884/users/c3dbc39a1acc47399e6b677709273616/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:31:05.807321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75e2bf-83c8-404b-819c-c671eee9ed8a None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:05.807616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75e2bf-83c8-404b-819c-c671eee9ed8a None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:05.807897 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75e2bf-83c8-404b-819c-c671eee9ed8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:05.835351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-8c75e2bf-83c8-404b-819c-c671eee9ed8a None None] MFA Rules not processed for user `c3dbc39a1acc47399e6b677709273616`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:05.836589 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-8c75e2bf-83c8-404b-819c-c671eee9ed8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:05.903848 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1257/2525] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:31:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:05.915463 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b654a-74cf-4ad8-9679-3c046193e682 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:05.917197 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c63b654a-74cf-4ad8-9679-3c046193e682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:05.973912 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b654a-74cf-4ad8-9679-3c046193e682 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:05.977560 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72b888-0c76-48fc-9769-c726642107e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:05.978191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72b888-0c76-48fc-9769-c726642107e1 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:05.978471 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72b888-0c76-48fc-9769-c726642107e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:05.978838 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72b888-0c76-48fc-9769-c726642107e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:05.988205 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72b888-0c76-48fc-9769-c726642107e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:05.989573 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72b888-0c76-48fc-9769-c726642107e1 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:05.998684 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1269/2526] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:31:05 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:31:06.069419 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75e2bf-83c8-404b-819c-c671eee9ed8a None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:06.078819 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75e2bf-83c8-404b-819c-c671eee9ed8a None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:06.083147 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df413e36-a3a5-47dc-9ea5-94fb909cc201 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:06.083784 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df413e36-a3a5-47dc-9ea5-94fb909cc201 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:06.084065 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df413e36-a3a5-47dc-9ea5-94fb909cc201 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:06.084370 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df413e36-a3a5-47dc-9ea5-94fb909cc201 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:06.138541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df413e36-a3a5-47dc-9ea5-94fb909cc201 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:06.140499 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df413e36-a3a5-47dc-9ea5-94fb909cc201 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:06.151237 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1258/2527] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:31:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:31:09.196405 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728e185-d6e9-421b-ba99-6648a75bfdd5 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:09.196889 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728e185-d6e9-421b-ba99-6648a75bfdd5 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:09.196969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728e185-d6e9-421b-ba99-6648a75bfdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:09.217182 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-8728e185-d6e9-421b-ba99-6648a75bfdd5 None None] MFA Rules not processed for user `38a56f3572874938ad4642fa34751a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:09.218795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8728e185-d6e9-421b-ba99-6648a75bfdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:09.293350 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1270/2528] 10.222.0.71 () {58 vars in 1009 bytes} [Mon May 16 20:31:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:09.306258 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df413e36-a3a5-47dc-9ea5-94fb909cc201 service cinder] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:09.307654 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-df413e36-a3a5-47dc-9ea5-94fb909cc201 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:09.377839 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df413e36-a3a5-47dc-9ea5-94fb909cc201 service cinder] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:09.383453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72cf7d-0c1f-4891-b601-563632404a4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e701cf55d13410aa259ec72578ed27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:09.384219 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72cf7d-0c1f-4891-b601-563632404a4c service swift] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:09.384527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72cf7d-0c1f-4891-b601-563632404a4c service swift] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:09.384844 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72cf7d-0c1f-4891-b601-563632404a4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:09.394511 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72cf7d-0c1f-4891-b601-563632404a4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:09.396122 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72cf7d-0c1f-4891-b601-563632404a4c service swift] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:09.403950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1259/2529] 10.222.0.71 () {60 vars in 1384 bytes} [Mon May 16 20:31:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:31:24.839638 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b7e4e-ec0a-4e27-8c07-549fbb7535b8 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:24.840137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b7e4e-ec0a-4e27-8c07-549fbb7535b8 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:24.840287 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b7e4e-ec0a-4e27-8c07-549fbb7535b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:24.858071 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-021b7e4e-ec0a-4e27-8c07-549fbb7535b8 None None] MFA Rules not processed for user `38a56f3572874938ad4642fa34751a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:24.859260 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-021b7e4e-ec0a-4e27-8c07-549fbb7535b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:24.867029 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1271/2530] 10.222.0.71 () {58 vars in 967 bytes} [Mon May 16 20:31:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:24.879227 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72cf7d-0c1f-4891-b601-563632404a4c service swift] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:24.889342 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72cf7d-0c1f-4891-b601-563632404a4c service swift] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:24.894625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f697c9-0aab-49a0-98f9-817b03bb34ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e701cf55d13410aa259ec72578ed27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:24.895243 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f697c9-0aab-49a0-98f9-817b03bb34ca service swift] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:24.895523 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f697c9-0aab-49a0-98f9-817b03bb34ca service swift] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:24.895796 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f697c9-0aab-49a0-98f9-817b03bb34ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:24.903508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f697c9-0aab-49a0-98f9-817b03bb34ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:24.905088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f697c9-0aab-49a0-98f9-817b03bb34ca service swift] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:24.913388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1260/2531] 10.222.0.71 () {60 vars in 1384 bytes} [Mon May 16 20:31:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:31:26.802186 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b7e4e-ec0a-4e27-8c07-549fbb7535b8 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:26.803639 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-021b7e4e-ec0a-4e27-8c07-549fbb7535b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:26.869739 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b7e4e-ec0a-4e27-8c07-549fbb7535b8 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:26.874282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e35eb-2b99-4ecf-93cb-c2283cc95ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:26.875139 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e35eb-2b99-4ecf-93cb-c2283cc95ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:26.875422 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e35eb-2b99-4ecf-93cb-c2283cc95ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:26.875699 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e35eb-2b99-4ecf-93cb-c2283cc95ab8 admin admin] PATH_INFO: `/v3/users/9b1836429585450c8430d03cb5d1db18` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:26.876911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e35eb-2b99-4ecf-93cb-c2283cc95ab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b1836429585450c8430d03cb5d1db18)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:26.879993 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e35eb-2b99-4ecf-93cb-c2283cc95ab8 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:26.926455 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-277e35eb-2b99-4ecf-93cb-c2283cc95ab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b1836429585450c8430d03cb5d1db18'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:26.927123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-277e35eb-2b99-4ecf-93cb-c2283cc95ab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b1836429585450c8430d03cb5d1db18'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:26.933910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-277e35eb-2b99-4ecf-93cb-c2283cc95ab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b1836429585450c8430d03cb5d1db18'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:26.941362 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-277e35eb-2b99-4ecf-93cb-c2283cc95ab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b1836429585450c8430d03cb5d1db18'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:26.952583 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-277e35eb-2b99-4ecf-93cb-c2283cc95ab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b1836429585450c8430d03cb5d1db18'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:26.958593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1272/2532] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:31:26 2022] DELETE /identity/v3/users/9b1836429585450c8430d03cb5d1db18 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:31:27.129681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f697c9-0aab-49a0-98f9-817b03bb34ca service swift] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:27.140575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f697c9-0aab-49a0-98f9-817b03bb34ca service swift] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:27.196690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880820c-ab24-46a7-a741-589a86f63f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:27.197540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880820c-ab24-46a7-a741-589a86f63f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:27.197823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880820c-ab24-46a7-a741-589a86f63f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:27.198097 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880820c-ab24-46a7-a741-589a86f63f80 admin admin] PATH_INFO: `/v3/projects/4dd508b1a1d544cd982cf0b2db5ccdb5` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:27.199255 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880820c-ab24-46a7-a741-589a86f63f80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dd508b1a1d544cd982cf0b2db5ccdb5)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:27.201177 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880820c-ab24-46a7-a741-589a86f63f80 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:27.246906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c880820c-ab24-46a7-a741-589a86f63f80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dd508b1a1d544cd982cf0b2db5ccdb5', 'request_id': 'req-c880820c-ab24-46a7-a741-589a86f63f80'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:27.252005 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c880820c-ab24-46a7-a741-589a86f63f80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dd508b1a1d544cd982cf0b2db5ccdb5', 'request_id': 'req-c880820c-ab24-46a7-a741-589a86f63f80'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:27.260070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c880820c-ab24-46a7-a741-589a86f63f80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dd508b1a1d544cd982cf0b2db5ccdb5', 'request_id': 'req-c880820c-ab24-46a7-a741-589a86f63f80'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:27.271601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c880820c-ab24-46a7-a741-589a86f63f80 admin admin] The token cache is being invalidate because project 4dd508b1a1d544cd982cf0b2db5ccdb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:31:27.271881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c880820c-ab24-46a7-a741-589a86f63f80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:27.272527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c880820c-ab24-46a7-a741-589a86f63f80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:27.274049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1261/2533] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:31:27 2022] DELETE /identity/v3/projects/4dd508b1a1d544cd982cf0b2db5ccdb5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:31:27.278955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2800c-2c6c-42ce-bd49-21287d66d2bf None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:27.279246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2800c-2c6c-42ce-bd49-21287d66d2bf None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:27.279551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2800c-2c6c-42ce-bd49-21287d66d2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:27.297429 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-f8a2800c-2c6c-42ce-bd49-21287d66d2bf None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:27.298608 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f8a2800c-2c6c-42ce-bd49-21287d66d2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:27.355160 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1273/2534] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:27.362954 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc154fea-e828-475f-94b4-bb22532e1966 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:27.363248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc154fea-e828-475f-94b4-bb22532e1966 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:27.363530 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc154fea-e828-475f-94b4-bb22532e1966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:27.382135 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-dc154fea-e828-475f-94b4-bb22532e1966 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:27.383345 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-dc154fea-e828-475f-94b4-bb22532e1966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:27.391339 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1262/2535] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:27.396212 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2800c-2c6c-42ce-bd49-21287d66d2bf None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:27.405603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2800c-2c6c-42ce-bd49-21287d66d2bf None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:27.410217 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add730e-d7c2-4ddf-baed-9448dcc2c8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:27.410851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add730e-d7c2-4ddf-baed-9448dcc2c8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:27.411130 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add730e-d7c2-4ddf-baed-9448dcc2c8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:27.411396 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add730e-d7c2-4ddf-baed-9448dcc2c8a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:27.412115 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add730e-d7c2-4ddf-baed-9448dcc2c8a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:31:27.412442 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add730e-d7c2-4ddf-baed-9448dcc2c8a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:27.414012 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add730e-d7c2-4ddf-baed-9448dcc2c8a3 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:27.425549 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1274/2536] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:31:27.429679 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc154fea-e828-475f-94b4-bb22532e1966 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:27.441083 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc154fea-e828-475f-94b4-bb22532e1966 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:27.445778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97aa26-783d-45ff-aeb2-cbb4d1b70e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:27.446425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97aa26-783d-45ff-aeb2-cbb4d1b70e0a admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:27.446738 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97aa26-783d-45ff-aeb2-cbb4d1b70e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:27.447015 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97aa26-783d-45ff-aeb2-cbb4d1b70e0a admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:27.447712 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97aa26-783d-45ff-aeb2-cbb4d1b70e0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:27.449637 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97aa26-783d-45ff-aeb2-cbb4d1b70e0a admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:27.487118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1263/2537] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:31:27 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:31:27.488322 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add730e-d7c2-4ddf-baed-9448dcc2c8a3 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:27.498308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add730e-d7c2-4ddf-baed-9448dcc2c8a3 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:27.553133 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf94f2-a850-46f4-97e8-ab807d8b2a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:27.553712 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf94f2-a850-46f4-97e8-ab807d8b2a45 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:27.553994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf94f2-a850-46f4-97e8-ab807d8b2a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:27.554267 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf94f2-a850-46f4-97e8-ab807d8b2a45 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:27.554982 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf94f2-a850-46f4-97e8-ab807d8b2a45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:27.556937 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf94f2-a850-46f4-97e8-ab807d8b2a45 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:27.577034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1275/2538] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:31:27 2022] POST /identity/v3/users => generated 282 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:31:27.581474 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97aa26-783d-45ff-aeb2-cbb4d1b70e0a admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:27.591878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97aa26-783d-45ff-aeb2-cbb4d1b70e0a admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:27.596449 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cca828-cce8-4899-9684-011d4c94cc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:27.597096 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cca828-cce8-4899-9684-011d4c94cc22 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:27.597814 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cca828-cce8-4899-9684-011d4c94cc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:27.597814 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cca828-cce8-4899-9684-011d4c94cc22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:27.598325 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cca828-cce8-4899-9684-011d4c94cc22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:27.599898 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cca828-cce8-4899-9684-011d4c94cc22 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:27.609807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1264/2539] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:31:27.613801 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf94f2-a850-46f4-97e8-ab807d8b2a45 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:27.623706 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf94f2-a850-46f4-97e8-ab807d8b2a45 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:27.629706 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc5ca7-5578-4320-a36d-94204c428f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:27.630473 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc5ca7-5578-4320-a36d-94204c428f2f admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:27.630756 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc5ca7-5578-4320-a36d-94204c428f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:27.631048 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc5ca7-5578-4320-a36d-94204c428f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:27.631772 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc5ca7-5578-4320-a36d-94204c428f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:27.633473 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc5ca7-5578-4320-a36d-94204c428f2f admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:27.648561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1276/2540] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:31:27.652683 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cca828-cce8-4899-9684-011d4c94cc22 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:27.667852 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cca828-cce8-4899-9684-011d4c94cc22 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:27.672663 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fc7cb-c71f-4671-a2ad-3ae46e30758d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:27.673554 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fc7cb-c71f-4671-a2ad-3ae46e30758d admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:27.673839 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fc7cb-c71f-4671-a2ad-3ae46e30758d admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:27.674782 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fc7cb-c71f-4671-a2ad-3ae46e30758d admin admin] PATH_INFO: `/v3/projects/6bd78f22004f47f69fc9d6390173c87f/users/e72b162fcda049839acfc9b05b073305/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:27.689370 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7fc7cb-c71f-4671-a2ad-3ae46e30758d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd78f22004f47f69fc9d6390173c87f, user_id=e72b162fcda049839acfc9b05b073305, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:27.692876 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7fc7cb-c71f-4671-a2ad-3ae46e30758d admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:27.707192 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1265/2541] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:31:27 2022] PUT /identity/v3/projects/6bd78f22004f47f69fc9d6390173c87f/users/e72b162fcda049839acfc9b05b073305/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:31:27.717289 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6dce3-a268-44d1-b5fd-eb07e2c049ff None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:27.717584 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6dce3-a268-44d1-b5fd-eb07e2c049ff None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:27.717866 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6dce3-a268-44d1-b5fd-eb07e2c049ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:27.744828 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-aff6dce3-a268-44d1-b5fd-eb07e2c049ff None None] MFA Rules not processed for user `e72b162fcda049839acfc9b05b073305`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:27.746024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-aff6dce3-a268-44d1-b5fd-eb07e2c049ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:27.810355 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1277/2542] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:31:27 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:27.822507 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fc7cb-c71f-4671-a2ad-3ae46e30758d admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:27.824335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-5a7fc7cb-c71f-4671-a2ad-3ae46e30758d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:27.884044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fc7cb-c71f-4671-a2ad-3ae46e30758d admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:27.887676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bf5fa-56e2-4f47-b958-40006bc64124 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:27.888352 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bf5fa-56e2-4f47-b958-40006bc64124 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:27.888636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bf5fa-56e2-4f47-b958-40006bc64124 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:27.888909 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bf5fa-56e2-4f47-b958-40006bc64124 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:27.898051 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479bf5fa-56e2-4f47-b958-40006bc64124 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:27.899463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479bf5fa-56e2-4f47-b958-40006bc64124 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:27.908215 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1266/2543] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:31:27 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:31:45.822403 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6dce3-a268-44d1-b5fd-eb07e2c049ff None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:45.823822 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-aff6dce3-a268-44d1-b5fd-eb07e2c049ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:45.880841 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6dce3-a268-44d1-b5fd-eb07e2c049ff None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:45.884370 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d9386-2e9c-428a-830d-dac54f82daaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:45.885001 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d9386-2e9c-428a-830d-dac54f82daaa service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:45.885277 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d9386-2e9c-428a-830d-dac54f82daaa service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:45.885546 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d9386-2e9c-428a-830d-dac54f82daaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:45.887260 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-824d9386-2e9c-428a-830d-dac54f82daaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:45.947281 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d9386-2e9c-428a-830d-dac54f82daaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:45.948748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d9386-2e9c-428a-830d-dac54f82daaa service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:45.958711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1278/2544] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:31:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:31:47.898866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bf5fa-56e2-4f47-b958-40006bc64124 service cinder] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:47.901188 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-479bf5fa-56e2-4f47-b958-40006bc64124 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:47.917220 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bf5fa-56e2-4f47-b958-40006bc64124 service cinder] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:47.921858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03838f98-9365-46d3-8dc7-6e6c129d933b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:47.922791 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03838f98-9365-46d3-8dc7-6e6c129d933b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:47.923175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03838f98-9365-46d3-8dc7-6e6c129d933b admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:47.923989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03838f98-9365-46d3-8dc7-6e6c129d933b admin admin] PATH_INFO: `/v3/users/7d226a515393444ba48e44e0e270d870` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:47.925531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03838f98-9365-46d3-8dc7-6e6c129d933b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d226a515393444ba48e44e0e270d870)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:47.927531 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03838f98-9365-46d3-8dc7-6e6c129d933b admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:47.977601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-03838f98-9365-46d3-8dc7-6e6c129d933b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d226a515393444ba48e44e0e270d870'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:47.990253 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-03838f98-9365-46d3-8dc7-6e6c129d933b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d226a515393444ba48e44e0e270d870'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:47.998025 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-03838f98-9365-46d3-8dc7-6e6c129d933b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d226a515393444ba48e44e0e270d870'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:47.998813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-03838f98-9365-46d3-8dc7-6e6c129d933b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d226a515393444ba48e44e0e270d870'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:48.006361 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-03838f98-9365-46d3-8dc7-6e6c129d933b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d226a515393444ba48e44e0e270d870'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:48.012740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1267/2545] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:31:47 2022] DELETE /identity/v3/users/7d226a515393444ba48e44e0e270d870 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:31:48.018204 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359f799-1330-41e5-ad97-1fffdae80b2e None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:48.018729 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359f799-1330-41e5-ad97-1fffdae80b2e None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:48.018882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359f799-1330-41e5-ad97-1fffdae80b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:48.036590 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-1359f799-1330-41e5-ad97-1fffdae80b2e None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:48.037916 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-1359f799-1330-41e5-ad97-1fffdae80b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:48.102194 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1279/2546] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:48.109889 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03838f98-9365-46d3-8dc7-6e6c129d933b admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:48.111926 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-03838f98-9365-46d3-8dc7-6e6c129d933b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:48.169693 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03838f98-9365-46d3-8dc7-6e6c129d933b admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:48.173378 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebc851-da48-4025-8899-00df1e670624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:48.174950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebc851-da48-4025-8899-00df1e670624 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:48.175237 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebc851-da48-4025-8899-00df1e670624 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:48.175513 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebc851-da48-4025-8899-00df1e670624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:48.184778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebc851-da48-4025-8899-00df1e670624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:48.186219 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebc851-da48-4025-8899-00df1e670624 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:48.196698 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1268/2547] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:31:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:31:48.522698 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359f799-1330-41e5-ad97-1fffdae80b2e None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:48.524251 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-1359f799-1330-41e5-ad97-1fffdae80b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:48.538289 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359f799-1330-41e5-ad97-1fffdae80b2e None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:48.543501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453ae42-dc8e-4032-999e-73c47739b95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:48.544465 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453ae42-dc8e-4032-999e-73c47739b95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:48.544749 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453ae42-dc8e-4032-999e-73c47739b95f admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:48.545023 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453ae42-dc8e-4032-999e-73c47739b95f admin admin] PATH_INFO: `/v3/projects/fe3e2f287b3d4b9ebc28058364ba7ae5` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:48.546336 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453ae42-dc8e-4032-999e-73c47739b95f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe3e2f287b3d4b9ebc28058364ba7ae5)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:48.548490 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453ae42-dc8e-4032-999e-73c47739b95f admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:48.599394 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b453ae42-dc8e-4032-999e-73c47739b95f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe3e2f287b3d4b9ebc28058364ba7ae5', 'request_id': 'req-b453ae42-dc8e-4032-999e-73c47739b95f'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:48.606599 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b453ae42-dc8e-4032-999e-73c47739b95f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe3e2f287b3d4b9ebc28058364ba7ae5', 'request_id': 'req-b453ae42-dc8e-4032-999e-73c47739b95f'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:48.613285 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b453ae42-dc8e-4032-999e-73c47739b95f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe3e2f287b3d4b9ebc28058364ba7ae5', 'request_id': 'req-b453ae42-dc8e-4032-999e-73c47739b95f'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:48.623702 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b453ae42-dc8e-4032-999e-73c47739b95f admin admin] The token cache is being invalidate because project fe3e2f287b3d4b9ebc28058364ba7ae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:31:48.624083 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b453ae42-dc8e-4032-999e-73c47739b95f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:48.627775 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b453ae42-dc8e-4032-999e-73c47739b95f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:48.627775 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1280/2548] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:31:48 2022] DELETE /identity/v3/projects/fe3e2f287b3d4b9ebc28058364ba7ae5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:31:48.631993 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebc851-da48-4025-8899-00df1e670624 service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:48.643114 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebc851-da48-4025-8899-00df1e670624 service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:48.711834 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5faa5-6019-416b-8423-fa4c7c8d5c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:48.712252 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5faa5-6019-416b-8423-fa4c7c8d5c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:48.712535 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5faa5-6019-416b-8423-fa4c7c8d5c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:48.712805 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5faa5-6019-416b-8423-fa4c7c8d5c89 admin admin] PATH_INFO: `/v3/users/c3dbc39a1acc47399e6b677709273616` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:48.714005 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5faa5-6019-416b-8423-fa4c7c8d5c89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3dbc39a1acc47399e6b677709273616)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:48.716003 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5faa5-6019-416b-8423-fa4c7c8d5c89 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:48.774678 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-3db5faa5-6019-416b-8423-fa4c7c8d5c89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3dbc39a1acc47399e6b677709273616'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:48.789863 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-3db5faa5-6019-416b-8423-fa4c7c8d5c89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3dbc39a1acc47399e6b677709273616'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:48.798979 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-3db5faa5-6019-416b-8423-fa4c7c8d5c89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3dbc39a1acc47399e6b677709273616'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:48.800116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-3db5faa5-6019-416b-8423-fa4c7c8d5c89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3dbc39a1acc47399e6b677709273616'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:48.810847 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-3db5faa5-6019-416b-8423-fa4c7c8d5c89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3dbc39a1acc47399e6b677709273616'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:48.821589 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1269/2549] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:31:48 2022] DELETE /identity/v3/users/c3dbc39a1acc47399e6b677709273616 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:31:49.178172 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453ae42-dc8e-4032-999e-73c47739b95f admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:49.180038 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-b453ae42-dc8e-4032-999e-73c47739b95f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:49.185014 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5faa5-6019-416b-8423-fa4c7c8d5c89 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:49.187121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-3db5faa5-6019-416b-8423-fa4c7c8d5c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:49.205816 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453ae42-dc8e-4032-999e-73c47739b95f admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:49.274791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f8b3f-a48f-478b-9855-0363b01235fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:49.275634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f8b3f-a48f-478b-9855-0363b01235fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:49.275921 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f8b3f-a48f-478b-9855-0363b01235fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:49.276218 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f8b3f-a48f-478b-9855-0363b01235fe admin admin] PATH_INFO: `/v3/projects/6f9f9eab19924a91a6f30aadede17884` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:49.277403 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f8b3f-a48f-478b-9855-0363b01235fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f9f9eab19924a91a6f30aadede17884)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:49.280897 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5faa5-6019-416b-8423-fa4c7c8d5c89 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:49.281341 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f8b3f-a48f-478b-9855-0363b01235fe admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:49.287673 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2c875-6269-4314-a057-68720c5020ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:49.288721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2c875-6269-4314-a057-68720c5020ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:49.289060 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2c875-6269-4314-a057-68720c5020ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:49.289698 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2c875-6269-4314-a057-68720c5020ee admin admin] PATH_INFO: `/v3/users/c330fcea8dda449ab5e125b741d49ef4` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:49.291030 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2c875-6269-4314-a057-68720c5020ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=c330fcea8dda449ab5e125b741d49ef4)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:49.293457 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2c875-6269-4314-a057-68720c5020ee admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:49.334523 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-890f8b3f-a48f-478b-9855-0363b01235fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f9f9eab19924a91a6f30aadede17884', 'request_id': 'req-890f8b3f-a48f-478b-9855-0363b01235fe'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:49.342686 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-890f8b3f-a48f-478b-9855-0363b01235fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f9f9eab19924a91a6f30aadede17884', 'request_id': 'req-890f8b3f-a48f-478b-9855-0363b01235fe'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:49.349755 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-890f8b3f-a48f-478b-9855-0363b01235fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f9f9eab19924a91a6f30aadede17884', 'request_id': 'req-890f8b3f-a48f-478b-9855-0363b01235fe'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:49.355057 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-09f2c875-6269-4314-a057-68720c5020ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c330fcea8dda449ab5e125b741d49ef4'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:49.361093 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-890f8b3f-a48f-478b-9855-0363b01235fe admin admin] The token cache is being invalidate because project 6f9f9eab19924a91a6f30aadede17884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:31:49.361897 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-890f8b3f-a48f-478b-9855-0363b01235fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:49.362546 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-890f8b3f-a48f-478b-9855-0363b01235fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:49.364089 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1281/2550] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:31:49 2022] DELETE /identity/v3/projects/6f9f9eab19924a91a6f30aadede17884 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:31:49.368651 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31981a65-39fe-48de-8ec3-ef767bbc1c9f None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:49.368927 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31981a65-39fe-48de-8ec3-ef767bbc1c9f None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:49.369202 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31981a65-39fe-48de-8ec3-ef767bbc1c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:49.369737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-09f2c875-6269-4314-a057-68720c5020ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c330fcea8dda449ab5e125b741d49ef4'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:49.376973 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-09f2c875-6269-4314-a057-68720c5020ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c330fcea8dda449ab5e125b741d49ef4'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:49.377686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-09f2c875-6269-4314-a057-68720c5020ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c330fcea8dda449ab5e125b741d49ef4'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:49.387277 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-31981a65-39fe-48de-8ec3-ef767bbc1c9f None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:49.388512 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-31981a65-39fe-48de-8ec3-ef767bbc1c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:49.390025 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-09f2c875-6269-4314-a057-68720c5020ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c330fcea8dda449ab5e125b741d49ef4'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:49.398187 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1270/2551] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:31:49 2022] DELETE /identity/v3/users/c330fcea8dda449ab5e125b741d49ef4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:31:49.453504 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1282/2552] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:31:49.461839 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2dfdc-56bb-4c9a-b685-559a89e01bc0 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:49.462154 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2dfdc-56bb-4c9a-b685-559a89e01bc0 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:49.462434 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2dfdc-56bb-4c9a-b685-559a89e01bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:49.481353 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-41e2dfdc-56bb-4c9a-b685-559a89e01bc0 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:49.482682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-41e2dfdc-56bb-4c9a-b685-559a89e01bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:49.543714 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1271/2553] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:49.547794 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31981a65-39fe-48de-8ec3-ef767bbc1c9f None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:49.558884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31981a65-39fe-48de-8ec3-ef767bbc1c9f None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:49.563745 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ade44a-efe6-4b68-9e21-a0190b2b7b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:49.564490 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ade44a-efe6-4b68-9e21-a0190b2b7b4e admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:49.564751 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ade44a-efe6-4b68-9e21-a0190b2b7b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:49.565166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ade44a-efe6-4b68-9e21-a0190b2b7b4e admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:49.565936 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ade44a-efe6-4b68-9e21-a0190b2b7b4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:31:49.566322 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ade44a-efe6-4b68-9e21-a0190b2b7b4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:49.567914 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ade44a-efe6-4b68-9e21-a0190b2b7b4e admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:49.574191 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2dfdc-56bb-4c9a-b685-559a89e01bc0 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:49.576239 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-41e2dfdc-56bb-4c9a-b685-559a89e01bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:49.581310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1283/2554] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:31:49.585279 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ade44a-efe6-4b68-9e21-a0190b2b7b4e admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:49.594963 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ade44a-efe6-4b68-9e21-a0190b2b7b4e admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:49.595264 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2dfdc-56bb-4c9a-b685-559a89e01bc0 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:49.600426 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163bb995-ee25-4223-b8a5-a5300c0b3aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:49.600643 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3bfb8-4fa0-46e1-a1a8-a660cb4c1a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:49.601295 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3bfb8-4fa0-46e1-a1a8-a660cb4c1a39 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:49.601460 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bb995-ee25-4223-b8a5-a5300c0b3aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:49.601593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3bfb8-4fa0-46e1-a1a8-a660cb4c1a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:49.601871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3bfb8-4fa0-46e1-a1a8-a660cb4c1a39 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:49.602292 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bb995-ee25-4223-b8a5-a5300c0b3aba admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:49.602642 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bb995-ee25-4223-b8a5-a5300c0b3aba admin admin] PATH_INFO: `/v3/projects/c5e9d68ebf234ca98d0bedb214585f87` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:49.603138 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3bfb8-4fa0-46e1-a1a8-a660cb4c1a39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:49.604078 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163bb995-ee25-4223-b8a5-a5300c0b3aba admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5e9d68ebf234ca98d0bedb214585f87)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:49.605157 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3bfb8-4fa0-46e1-a1a8-a660cb4c1a39 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:49.606508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163bb995-ee25-4223-b8a5-a5300c0b3aba admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:49.640025 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1284/2555] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:31:49 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:31:49.641364 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3bfb8-4fa0-46e1-a1a8-a660cb4c1a39 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:49.659496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-163bb995-ee25-4223-b8a5-a5300c0b3aba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e9d68ebf234ca98d0bedb214585f87', 'request_id': 'req-163bb995-ee25-4223-b8a5-a5300c0b3aba'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:49.666210 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-163bb995-ee25-4223-b8a5-a5300c0b3aba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e9d68ebf234ca98d0bedb214585f87', 'request_id': 'req-163bb995-ee25-4223-b8a5-a5300c0b3aba'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:49.674123 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-163bb995-ee25-4223-b8a5-a5300c0b3aba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e9d68ebf234ca98d0bedb214585f87', 'request_id': 'req-163bb995-ee25-4223-b8a5-a5300c0b3aba'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:49.685282 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-163bb995-ee25-4223-b8a5-a5300c0b3aba admin admin] The token cache is being invalidate because project c5e9d68ebf234ca98d0bedb214585f87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:31:49.685573 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-163bb995-ee25-4223-b8a5-a5300c0b3aba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:49.686228 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-163bb995-ee25-4223-b8a5-a5300c0b3aba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:49.688025 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1272/2556] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:31:49 2022] DELETE /identity/v3/projects/c5e9d68ebf234ca98d0bedb214585f87 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:31:49.693646 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35a5b8-a69b-4df1-8a1a-e10e0dceb04e None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:49.693944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35a5b8-a69b-4df1-8a1a-e10e0dceb04e None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:49.694221 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35a5b8-a69b-4df1-8a1a-e10e0dceb04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:49.705620 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3bfb8-4fa0-46e1-a1a8-a660cb4c1a39 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:49.712812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-9a35a5b8-a69b-4df1-8a1a-e10e0dceb04e None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:49.714007 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-9a35a5b8-a69b-4df1-8a1a-e10e0dceb04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:49.761104 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ab408-0a59-4852-b391-16e86dd6d9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:49.761769 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ab408-0a59-4852-b391-16e86dd6d9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:49.762049 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ab408-0a59-4852-b391-16e86dd6d9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:49.762322 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ab408-0a59-4852-b391-16e86dd6d9e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:49.763007 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ab408-0a59-4852-b391-16e86dd6d9e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:49.764941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ab408-0a59-4852-b391-16e86dd6d9e6 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:49.771259 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1273/2557] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:31:49.779637 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a556e3-f02e-45af-9deb-392ada2d29d0 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:49.779970 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a556e3-f02e-45af-9deb-392ada2d29d0 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:49.780288 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a556e3-f02e-45af-9deb-392ada2d29d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:49.788501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1285/2558] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:31:49 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:31:49.789906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ab408-0a59-4852-b391-16e86dd6d9e6 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:49.791522 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-1f4ab408-0a59-4852-b391-16e86dd6d9e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:49.799745 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-b5a556e3-f02e-45af-9deb-392ada2d29d0 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:49.801074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-b5a556e3-f02e-45af-9deb-392ada2d29d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:49.803619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ab408-0a59-4852-b391-16e86dd6d9e6 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:49.808462 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec401c8-c246-4aa2-912d-81080127bb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:49.809107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec401c8-c246-4aa2-912d-81080127bb94 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:49.809390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec401c8-c246-4aa2-912d-81080127bb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:49.809656 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1274/2559] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:31:49.809759 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec401c8-c246-4aa2-912d-81080127bb94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:49.810374 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec401c8-c246-4aa2-912d-81080127bb94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:49.811960 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec401c8-c246-4aa2-912d-81080127bb94 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:49.813369 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a556e3-f02e-45af-9deb-392ada2d29d0 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:49.824792 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1286/2560] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:31:49.824960 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a556e3-f02e-45af-9deb-392ada2d29d0 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:49.825884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec401c8-c246-4aa2-912d-81080127bb94 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:49.827522 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b75682-ce83-492c-ad67-b733ae3f0be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:49.828197 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b75682-ce83-492c-ad67-b733ae3f0be1 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:49.828475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b75682-ce83-492c-ad67-b733ae3f0be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:49.828747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b75682-ce83-492c-ad67-b733ae3f0be1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:49.829468 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b75682-ce83-492c-ad67-b733ae3f0be1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:31:49.829821 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b75682-ce83-492c-ad67-b733ae3f0be1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:49.831414 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b75682-ce83-492c-ad67-b733ae3f0be1 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:49.835892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec401c8-c246-4aa2-912d-81080127bb94 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:49.840621 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc87159-564b-4378-aaff-cf6a05e2aca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:49.841247 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc87159-564b-4378-aaff-cf6a05e2aca9 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:49.841524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc87159-564b-4378-aaff-cf6a05e2aca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:49.841793 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc87159-564b-4378-aaff-cf6a05e2aca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:49.842495 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc87159-564b-4378-aaff-cf6a05e2aca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:49.843193 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1275/2561] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:31:49.844048 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc87159-564b-4378-aaff-cf6a05e2aca9 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:49.847849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b75682-ce83-492c-ad67-b733ae3f0be1 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:49.855625 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1287/2562] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:31:49.857324 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b75682-ce83-492c-ad67-b733ae3f0be1 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:49.859412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc87159-564b-4378-aaff-cf6a05e2aca9 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:49.862472 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c7fe3-2f45-4637-a1df-08c83cae748f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:49.863117 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c7fe3-2f45-4637-a1df-08c83cae748f admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:49.863405 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c7fe3-2f45-4637-a1df-08c83cae748f admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:49.863686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c7fe3-2f45-4637-a1df-08c83cae748f admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:49.864524 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c7fe3-2f45-4637-a1df-08c83cae748f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:49.866423 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c7fe3-2f45-4637-a1df-08c83cae748f admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:49.868928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc87159-564b-4378-aaff-cf6a05e2aca9 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:49.873508 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce6972-3f4a-4338-8fd5-d0024f7f94a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:49.874786 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce6972-3f4a-4338-8fd5-d0024f7f94a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:49.875065 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce6972-3f4a-4338-8fd5-d0024f7f94a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:49.875337 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce6972-3f4a-4338-8fd5-d0024f7f94a8 admin admin] PATH_INFO: `/v3/projects/5536b886140640d0952034fe7d6e837e/users/7070e089f24e42349294fad6854ea7a3/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:49.890951 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce6972-3f4a-4338-8fd5-d0024f7f94a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5536b886140640d0952034fe7d6e837e, user_id=7070e089f24e42349294fad6854ea7a3, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:49.893935 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce6972-3f4a-4338-8fd5-d0024f7f94a8 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:49.894089 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1276/2563] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:31:49 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:31:49.898033 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c7fe3-2f45-4637-a1df-08c83cae748f admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:49.907195 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1288/2564] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:31:49 2022] PUT /identity/v3/projects/5536b886140640d0952034fe7d6e837e/users/7070e089f24e42349294fad6854ea7a3/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:31:49.918638 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce5852-bb0f-4985-b60f-633d80b2ca4d None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:49.918921 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce5852-bb0f-4985-b60f-633d80b2ca4d None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:49.919193 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce5852-bb0f-4985-b60f-633d80b2ca4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:49.948244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-30ce5852-bb0f-4985-b60f-633d80b2ca4d None None] MFA Rules not processed for user `7070e089f24e42349294fad6854ea7a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:49.949513 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-30ce5852-bb0f-4985-b60f-633d80b2ca4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:49.960894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c7fe3-2f45-4637-a1df-08c83cae748f admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:50.015870 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1289/2565] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:31:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:31:50.020614 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c3b98-188a-4af2-a550-7bba5f4c3f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:50.021124 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce5852-bb0f-4985-b60f-633d80b2ca4d None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:50.021300 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c3b98-188a-4af2-a550-7bba5f4c3f82 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:50.021589 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c3b98-188a-4af2-a550-7bba5f4c3f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:50.021869 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c3b98-188a-4af2-a550-7bba5f4c3f82 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:50.022556 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c3b98-188a-4af2-a550-7bba5f4c3f82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:50.024529 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c3b98-188a-4af2-a550-7bba5f4c3f82 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:50.031024 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce5852-bb0f-4985-b60f-633d80b2ca4d None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:50.036598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957f1e4-f1ba-4254-886f-a16d05817f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:50.037391 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957f1e4-f1ba-4254-886f-a16d05817f75 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:50.037675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957f1e4-f1ba-4254-886f-a16d05817f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:50.037952 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957f1e4-f1ba-4254-886f-a16d05817f75 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:50.038721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957f1e4-f1ba-4254-886f-a16d05817f75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:50.040768 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957f1e4-f1ba-4254-886f-a16d05817f75 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:50.044340 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1277/2566] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:31:49 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:31:50.048117 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c3b98-188a-4af2-a550-7bba5f4c3f82 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:50.058491 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c3b98-188a-4af2-a550-7bba5f4c3f82 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:50.063685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d03abc-5a5e-416b-86ee-38061eefae79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:50.064403 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d03abc-5a5e-416b-86ee-38061eefae79 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:50.064788 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d03abc-5a5e-416b-86ee-38061eefae79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:50.065069 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d03abc-5a5e-416b-86ee-38061eefae79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:50.065779 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d03abc-5a5e-416b-86ee-38061eefae79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:50.067352 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d03abc-5a5e-416b-86ee-38061eefae79 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:50.067764 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1290/2567] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:31:50 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:31:50.071416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957f1e4-f1ba-4254-886f-a16d05817f75 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:50.077559 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1278/2568] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:31:50.081534 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d03abc-5a5e-416b-86ee-38061eefae79 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:50.090773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d03abc-5a5e-416b-86ee-38061eefae79 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:50.137390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957f1e4-f1ba-4254-886f-a16d05817f75 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:50.140396 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a50c2-0627-4977-a0d3-b43da40583ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:50.141141 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a50c2-0627-4977-a0d3-b43da40583ba admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:50.141499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a50c2-0627-4977-a0d3-b43da40583ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:50.142096 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a50c2-0627-4977-a0d3-b43da40583ba admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:50.143999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a50c2-0627-4977-a0d3-b43da40583ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:50.146028 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a50c2-0627-4977-a0d3-b43da40583ba admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:50.149628 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd1893-b21d-4e30-9ba4-af0155e6dbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:50.150295 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd1893-b21d-4e30-9ba4-af0155e6dbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:50.150578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd1893-b21d-4e30-9ba4-af0155e6dbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:50.150857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd1893-b21d-4e30-9ba4-af0155e6dbc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:50.151590 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd1893-b21d-4e30-9ba4-af0155e6dbc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:50.153192 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd1893-b21d-4e30-9ba4-af0155e6dbc0 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:50.164356 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1279/2569] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:31:50.168223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd1893-b21d-4e30-9ba4-af0155e6dbc0 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:50.176244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1291/2570] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:31:50 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:31:50.178504 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a50c2-0627-4977-a0d3-b43da40583ba admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:50.179430 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd1893-b21d-4e30-9ba4-af0155e6dbc0 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:50.184192 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf2ec2-bcce-42da-8178-60e78d78a707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:50.185286 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf2ec2-bcce-42da-8178-60e78d78a707 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:50.185843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf2ec2-bcce-42da-8178-60e78d78a707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:50.185945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf2ec2-bcce-42da-8178-60e78d78a707 admin admin] PATH_INFO: `/v3/projects/2e74299322ca4cedabe873822eda95ae/users/bdeae37d6dfb4c0a95c6c9b07c2b5ad3/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:50.190353 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a50c2-0627-4977-a0d3-b43da40583ba admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:50.196049 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9d286-7b50-4d4f-98db-4fa025aa870a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:50.196899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9d286-7b50-4d4f-98db-4fa025aa870a admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:50.197249 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9d286-7b50-4d4f-98db-4fa025aa870a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:50.197543 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9d286-7b50-4d4f-98db-4fa025aa870a admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:50.198334 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9d286-7b50-4d4f-98db-4fa025aa870a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:50.199947 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9d286-7b50-4d4f-98db-4fa025aa870a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:50.203540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf2ec2-bcce-42da-8178-60e78d78a707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e74299322ca4cedabe873822eda95ae, user_id=bdeae37d6dfb4c0a95c6c9b07c2b5ad3, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:50.207057 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf2ec2-bcce-42da-8178-60e78d78a707 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:50.211551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1292/2571] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:31:50.215767 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9d286-7b50-4d4f-98db-4fa025aa870a admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:50.224883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1280/2572] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:31:50 2022] PUT /identity/v3/projects/2e74299322ca4cedabe873822eda95ae/users/bdeae37d6dfb4c0a95c6c9b07c2b5ad3/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:31:50.227392 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9d286-7b50-4d4f-98db-4fa025aa870a admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:50.230554 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859894d-37d4-4a98-a100-0f770a95a096 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:50.231229 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859894d-37d4-4a98-a100-0f770a95a096 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:50.231512 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859894d-37d4-4a98-a100-0f770a95a096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:50.250582 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-4859894d-37d4-4a98-a100-0f770a95a096 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:50.252050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-4859894d-37d4-4a98-a100-0f770a95a096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:50.292793 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03265d5-59a4-4a0b-8d76-e17307f8e820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:50.293815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03265d5-59a4-4a0b-8d76-e17307f8e820 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:50.294212 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03265d5-59a4-4a0b-8d76-e17307f8e820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:50.294492 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03265d5-59a4-4a0b-8d76-e17307f8e820 admin admin] PATH_INFO: `/v3/projects/2ef75fcf19a24c298faf6e88fd0f27c7/users/eb41793384d84d63bbc8944e2f1a527f/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:50.311263 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03265d5-59a4-4a0b-8d76-e17307f8e820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef75fcf19a24c298faf6e88fd0f27c7, user_id=eb41793384d84d63bbc8944e2f1a527f, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:50.312449 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03265d5-59a4-4a0b-8d76-e17307f8e820 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:50.317397 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1281/2573] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:50.327436 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859894d-37d4-4a98-a100-0f770a95a096 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:50.328872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-4859894d-37d4-4a98-a100-0f770a95a096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:50.331057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1293/2574] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:31:50 2022] PUT /identity/v3/projects/2ef75fcf19a24c298faf6e88fd0f27c7/users/eb41793384d84d63bbc8944e2f1a527f/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:31:50.334754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03265d5-59a4-4a0b-8d76-e17307f8e820 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:50.395920 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859894d-37d4-4a98-a100-0f770a95a096 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:50.396964 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03265d5-59a4-4a0b-8d76-e17307f8e820 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:50.401770 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cd4b3-605a-41fa-9399-09e911efd66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:50.402432 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cd4b3-605a-41fa-9399-09e911efd66f admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:50.402709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cd4b3-605a-41fa-9399-09e911efd66f admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:50.403168 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cd4b3-605a-41fa-9399-09e911efd66f admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:50.404023 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cd4b3-605a-41fa-9399-09e911efd66f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:50.405688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cd4b3-605a-41fa-9399-09e911efd66f admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:50.415989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1294/2575] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:31:50.420003 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cd4b3-605a-41fa-9399-09e911efd66f admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:50.431766 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cd4b3-605a-41fa-9399-09e911efd66f admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:50.438241 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf50f2-887d-4e6c-a32b-d9cbbf37863b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:50.439881 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf50f2-887d-4e6c-a32b-d9cbbf37863b admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:50.440468 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf50f2-887d-4e6c-a32b-d9cbbf37863b admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:50.440791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf50f2-887d-4e6c-a32b-d9cbbf37863b admin admin] PATH_INFO: `/v3/projects/2ef75fcf19a24c298faf6e88fd0f27c7/users/eb41793384d84d63bbc8944e2f1a527f/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:50.443570 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf50f2-887d-4e6c-a32b-d9cbbf37863b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef75fcf19a24c298faf6e88fd0f27c7, user_id=eb41793384d84d63bbc8944e2f1a527f, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:50.446483 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf50f2-887d-4e6c-a32b-d9cbbf37863b admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:50.450639 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb89e3a-f2c8-4135-881f-e6dcd5fdaf59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:50.451310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb89e3a-f2c8-4135-881f-e6dcd5fdaf59 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:50.451573 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb89e3a-f2c8-4135-881f-e6dcd5fdaf59 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:50.451850 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb89e3a-f2c8-4135-881f-e6dcd5fdaf59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:50.458251 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1295/2576] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:31:50 2022] PUT /identity/v3/projects/2ef75fcf19a24c298faf6e88fd0f27c7/users/eb41793384d84d63bbc8944e2f1a527f/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:31:50.468190 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb89e3a-f2c8-4135-881f-e6dcd5fdaf59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:50.469481 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb89e3a-f2c8-4135-881f-e6dcd5fdaf59 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:50.469733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa5a35-ba94-4316-b71c-5475c8e0fa0e None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:50.469990 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa5a35-ba94-4316-b71c-5475c8e0fa0e None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:50.470272 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa5a35-ba94-4316-b71c-5475c8e0fa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:50.481045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1282/2577] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:31:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:31:50.499107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-a5fa5a35-ba94-4316-b71c-5475c8e0fa0e None None] MFA Rules not processed for user `eb41793384d84d63bbc8944e2f1a527f`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:50.500374 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-a5fa5a35-ba94-4316-b71c-5475c8e0fa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:50.597212 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1296/2578] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:31:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:50.609211 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb89e3a-f2c8-4135-881f-e6dcd5fdaf59 service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:50.610990 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-7eb89e3a-f2c8-4135-881f-e6dcd5fdaf59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:50.677143 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb89e3a-f2c8-4135-881f-e6dcd5fdaf59 service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:50.728318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22f373-56be-4f58-98eb-ce33024a578e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:50.729092 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22f373-56be-4f58-98eb-ce33024a578e service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:50.729283 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22f373-56be-4f58-98eb-ce33024a578e service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:50.729506 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22f373-56be-4f58-98eb-ce33024a578e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:50.739682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22f373-56be-4f58-98eb-ce33024a578e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:50.741355 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22f373-56be-4f58-98eb-ce33024a578e service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:50.753404 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1283/2579] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:31:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:31:50.784716 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa5a35-ba94-4316-b71c-5475c8e0fa0e None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:50.861281 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa5a35-ba94-4316-b71c-5475c8e0fa0e None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:50.867540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626f4e5-3566-4153-a04b-ab0e715782d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:50.868831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626f4e5-3566-4153-a04b-ab0e715782d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:50.869107 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626f4e5-3566-4153-a04b-ab0e715782d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:50.869387 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626f4e5-3566-4153-a04b-ab0e715782d5 admin admin] PATH_INFO: `/v3/users/7070e089f24e42349294fad6854ea7a3` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:50.870614 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626f4e5-3566-4153-a04b-ab0e715782d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7070e089f24e42349294fad6854ea7a3)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:50.872572 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626f4e5-3566-4153-a04b-ab0e715782d5 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:50.933561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8626f4e5-3566-4153-a04b-ab0e715782d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7070e089f24e42349294fad6854ea7a3'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:50.934234 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8626f4e5-3566-4153-a04b-ab0e715782d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7070e089f24e42349294fad6854ea7a3'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:50.942383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8626f4e5-3566-4153-a04b-ab0e715782d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7070e089f24e42349294fad6854ea7a3'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:50.949892 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8626f4e5-3566-4153-a04b-ab0e715782d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7070e089f24e42349294fad6854ea7a3'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:50.965374 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8626f4e5-3566-4153-a04b-ab0e715782d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7070e089f24e42349294fad6854ea7a3'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:50.972690 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1297/2580] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:31:50 2022] DELETE /identity/v3/users/7070e089f24e42349294fad6854ea7a3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:31:50.978520 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5bbd2-045e-41f2-a6ea-e44bde75011c None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:50.978816 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5bbd2-045e-41f2-a6ea-e44bde75011c None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:50.979486 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5bbd2-045e-41f2-a6ea-e44bde75011c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:50.998867 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-01b5bbd2-045e-41f2-a6ea-e44bde75011c None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:51.000171 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-01b5bbd2-045e-41f2-a6ea-e44bde75011c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:51.070387 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1284/2581] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:31:51.080655 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626f4e5-3566-4153-a04b-ab0e715782d5 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:51.082069 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8626f4e5-3566-4153-a04b-ab0e715782d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:51.152268 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626f4e5-3566-4153-a04b-ab0e715782d5 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:51.156502 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60fddb-23d7-4aa3-adf2-713d949ee6ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:51.157207 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60fddb-23d7-4aa3-adf2-713d949ee6ae service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:51.157490 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60fddb-23d7-4aa3-adf2-713d949ee6ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:51.157755 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60fddb-23d7-4aa3-adf2-713d949ee6ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:51.169220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60fddb-23d7-4aa3-adf2-713d949ee6ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:51.171194 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60fddb-23d7-4aa3-adf2-713d949ee6ae service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:51.181913 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1298/2582] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:31:51.708837 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5bbd2-045e-41f2-a6ea-e44bde75011c None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:51.710307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-01b5bbd2-045e-41f2-a6ea-e44bde75011c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:51.726527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5bbd2-045e-41f2-a6ea-e44bde75011c None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:51.731903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4131b-8bd5-4da9-b774-60addcbae5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:51.733058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4131b-8bd5-4da9-b774-60addcbae5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:51.734025 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4131b-8bd5-4da9-b774-60addcbae5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:51.734141 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4131b-8bd5-4da9-b774-60addcbae5fd admin admin] PATH_INFO: `/v3/projects/5536b886140640d0952034fe7d6e837e` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:51.735291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4131b-8bd5-4da9-b774-60addcbae5fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5536b886140640d0952034fe7d6e837e)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:51.737840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4131b-8bd5-4da9-b774-60addcbae5fd admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:51.804989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-62d4131b-8bd5-4da9-b774-60addcbae5fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5536b886140640d0952034fe7d6e837e', 'request_id': 'req-62d4131b-8bd5-4da9-b774-60addcbae5fd'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:51.813144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-62d4131b-8bd5-4da9-b774-60addcbae5fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5536b886140640d0952034fe7d6e837e', 'request_id': 'req-62d4131b-8bd5-4da9-b774-60addcbae5fd'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:51.822505 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-62d4131b-8bd5-4da9-b774-60addcbae5fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5536b886140640d0952034fe7d6e837e', 'request_id': 'req-62d4131b-8bd5-4da9-b774-60addcbae5fd'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:51.835197 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-62d4131b-8bd5-4da9-b774-60addcbae5fd admin admin] The token cache is being invalidate because project 5536b886140640d0952034fe7d6e837e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:31:51.835616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-62d4131b-8bd5-4da9-b774-60addcbae5fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:51.836557 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-62d4131b-8bd5-4da9-b774-60addcbae5fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:51.838317 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1285/2583] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:31:51 2022] DELETE /identity/v3/projects/5536b886140640d0952034fe7d6e837e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:31:51.843153 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60fddb-23d7-4aa3-adf2-713d949ee6ae service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:51.855315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60fddb-23d7-4aa3-adf2-713d949ee6ae service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:51.919803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775931b2-3787-4473-bf5d-6c570f387458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:51.920628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775931b2-3787-4473-bf5d-6c570f387458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:51.920906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775931b2-3787-4473-bf5d-6c570f387458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:51.921183 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775931b2-3787-4473-bf5d-6c570f387458 admin admin] PATH_INFO: `/v3/users/eb41793384d84d63bbc8944e2f1a527f` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:51.922398 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775931b2-3787-4473-bf5d-6c570f387458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb41793384d84d63bbc8944e2f1a527f)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:51.925474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775931b2-3787-4473-bf5d-6c570f387458 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:51.989684 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-775931b2-3787-4473-bf5d-6c570f387458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb41793384d84d63bbc8944e2f1a527f'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:51.990966 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-775931b2-3787-4473-bf5d-6c570f387458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb41793384d84d63bbc8944e2f1a527f'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:51.999636 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-775931b2-3787-4473-bf5d-6c570f387458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb41793384d84d63bbc8944e2f1a527f'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:52.011841 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-775931b2-3787-4473-bf5d-6c570f387458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb41793384d84d63bbc8944e2f1a527f'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:52.031858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-775931b2-3787-4473-bf5d-6c570f387458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb41793384d84d63bbc8944e2f1a527f'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:52.038780 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1299/2584] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:31:51 2022] DELETE /identity/v3/users/eb41793384d84d63bbc8944e2f1a527f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:31:52.436847 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4131b-8bd5-4da9-b774-60addcbae5fd admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:52.438685 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-62d4131b-8bd5-4da9-b774-60addcbae5fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:52.459471 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4131b-8bd5-4da9-b774-60addcbae5fd admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:52.524404 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c5e58-e438-4b9d-9f14-0d591e677854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:52.525290 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c5e58-e438-4b9d-9f14-0d591e677854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:52.525572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c5e58-e438-4b9d-9f14-0d591e677854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:52.525916 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c5e58-e438-4b9d-9f14-0d591e677854 admin admin] PATH_INFO: `/v3/projects/2ef75fcf19a24c298faf6e88fd0f27c7` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:52.527213 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c5e58-e438-4b9d-9f14-0d591e677854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ef75fcf19a24c298faf6e88fd0f27c7)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:52.529179 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c5e58-e438-4b9d-9f14-0d591e677854 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:52.581492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-ad5c5e58-e438-4b9d-9f14-0d591e677854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ef75fcf19a24c298faf6e88fd0f27c7', 'request_id': 'req-ad5c5e58-e438-4b9d-9f14-0d591e677854'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:52.586966 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-ad5c5e58-e438-4b9d-9f14-0d591e677854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ef75fcf19a24c298faf6e88fd0f27c7', 'request_id': 'req-ad5c5e58-e438-4b9d-9f14-0d591e677854'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:52.595373 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-ad5c5e58-e438-4b9d-9f14-0d591e677854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ef75fcf19a24c298faf6e88fd0f27c7', 'request_id': 'req-ad5c5e58-e438-4b9d-9f14-0d591e677854'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:52.607102 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-ad5c5e58-e438-4b9d-9f14-0d591e677854 admin admin] The token cache is being invalidate because project 2ef75fcf19a24c298faf6e88fd0f27c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:31:52.607406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-ad5c5e58-e438-4b9d-9f14-0d591e677854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:52.608054 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-ad5c5e58-e438-4b9d-9f14-0d591e677854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:52.609636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1286/2585] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:31:52 2022] DELETE /identity/v3/projects/2ef75fcf19a24c298faf6e88fd0f27c7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:31:52.615754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127536d-a3f3-414c-b57c-598faa1d0839 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:52.616356 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127536d-a3f3-414c-b57c-598faa1d0839 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:52.616356 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127536d-a3f3-414c-b57c-598faa1d0839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:52.635803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-9127536d-a3f3-414c-b57c-598faa1d0839 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:52.637021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-9127536d-a3f3-414c-b57c-598faa1d0839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:52.706716 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1300/2586] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:52.716140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ebe1b-2762-4228-80f6-407d91927ddc None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:52.716706 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ebe1b-2762-4228-80f6-407d91927ddc None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:52.716706 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ebe1b-2762-4228-80f6-407d91927ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:52.737499 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-852ebe1b-2762-4228-80f6-407d91927ddc None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:52.738871 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-852ebe1b-2762-4228-80f6-407d91927ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:52.747686 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1287/2587] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:52.751761 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127536d-a3f3-414c-b57c-598faa1d0839 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:52.764897 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127536d-a3f3-414c-b57c-598faa1d0839 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:52.772046 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc6eee-ed92-42d8-87f0-d59577e0c501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:52.772900 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc6eee-ed92-42d8-87f0-d59577e0c501 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:52.773239 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc6eee-ed92-42d8-87f0-d59577e0c501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:52.773524 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc6eee-ed92-42d8-87f0-d59577e0c501 admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:52.774296 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc6eee-ed92-42d8-87f0-d59577e0c501 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:31:52.774606 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc6eee-ed92-42d8-87f0-d59577e0c501 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:52.776459 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc6eee-ed92-42d8-87f0-d59577e0c501 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:52.789848 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1301/2588] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:31:52.794353 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ebe1b-2762-4228-80f6-407d91927ddc None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:52.805360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ebe1b-2762-4228-80f6-407d91927ddc None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:52.811029 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e6a38-0bbd-4b3c-8234-6a140864aced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:52.811706 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e6a38-0bbd-4b3c-8234-6a140864aced admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:52.811989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e6a38-0bbd-4b3c-8234-6a140864aced admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:52.812353 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e6a38-0bbd-4b3c-8234-6a140864aced admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:52.813223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e6a38-0bbd-4b3c-8234-6a140864aced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:52.815412 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e6a38-0bbd-4b3c-8234-6a140864aced admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:52.851307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1288/2589] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:31:52 2022] POST /identity/v3/projects => generated 401 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:31:52.852553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc6eee-ed92-42d8-87f0-d59577e0c501 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:52.864512 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc6eee-ed92-42d8-87f0-d59577e0c501 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:52.952128 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8645df-d54c-42ab-b8c9-1bddf7020c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:52.953136 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8645df-d54c-42ab-b8c9-1bddf7020c58 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:52.953136 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8645df-d54c-42ab-b8c9-1bddf7020c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:52.953519 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8645df-d54c-42ab-b8c9-1bddf7020c58 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:52.954282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8645df-d54c-42ab-b8c9-1bddf7020c58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:52.957741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8645df-d54c-42ab-b8c9-1bddf7020c58 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:52.988901 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1302/2590] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:31:52 2022] POST /identity/v3/users => generated 301 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:31:52.990370 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e6a38-0bbd-4b3c-8234-6a140864aced admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:53.013481 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e6a38-0bbd-4b3c-8234-6a140864aced admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:53.021670 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb664a1-fc0c-497d-aa6a-192367dd09a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:53.022514 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb664a1-fc0c-497d-aa6a-192367dd09a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:53.023039 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb664a1-fc0c-497d-aa6a-192367dd09a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:53.023422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb664a1-fc0c-497d-aa6a-192367dd09a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:53.024301 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb664a1-fc0c-497d-aa6a-192367dd09a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:53.026644 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb664a1-fc0c-497d-aa6a-192367dd09a3 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:53.040482 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1289/2591] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:31:53.044969 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8645df-d54c-42ab-b8c9-1bddf7020c58 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:53.056966 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8645df-d54c-42ab-b8c9-1bddf7020c58 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:53.062288 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0126d9-3a51-415a-a767-77c2c82747e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:53.062954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0126d9-3a51-415a-a767-77c2c82747e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:53.063233 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0126d9-3a51-415a-a767-77c2c82747e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:53.063502 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0126d9-3a51-415a-a767-77c2c82747e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:53.064618 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0126d9-3a51-415a-a767-77c2c82747e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:53.066259 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0126d9-3a51-415a-a767-77c2c82747e2 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:53.083846 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1303/2592] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:31:53.088638 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb664a1-fc0c-497d-aa6a-192367dd09a3 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:53.101866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb664a1-fc0c-497d-aa6a-192367dd09a3 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:53.107308 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613e52a-3c9e-4646-8231-567306ec3eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:53.108617 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613e52a-3c9e-4646-8231-567306ec3eab admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:53.109114 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613e52a-3c9e-4646-8231-567306ec3eab admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:53.109586 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613e52a-3c9e-4646-8231-567306ec3eab admin admin] PATH_INFO: `/v3/projects/701ccd3797cf4288b847e579b85e3c19/users/bb7fca8ddee2414cb3cb89cfb498058d/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:53.126272 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3613e52a-3c9e-4646-8231-567306ec3eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=701ccd3797cf4288b847e579b85e3c19, user_id=bb7fca8ddee2414cb3cb89cfb498058d, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:53.130682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3613e52a-3c9e-4646-8231-567306ec3eab admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:53.158167 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1290/2593] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:31:53 2022] PUT /identity/v3/projects/701ccd3797cf4288b847e579b85e3c19/users/bb7fca8ddee2414cb3cb89cfb498058d/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:31:53.160033 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a219fe-d64b-4da6-8326-4cb4f0c7782d None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:53.160346 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a219fe-d64b-4da6-8326-4cb4f0c7782d None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:53.160639 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a219fe-d64b-4da6-8326-4cb4f0c7782d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:53.203227 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-56a219fe-d64b-4da6-8326-4cb4f0c7782d None None] MFA Rules not processed for user `bb7fca8ddee2414cb3cb89cfb498058d`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:53.205140 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-56a219fe-d64b-4da6-8326-4cb4f0c7782d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:53.317513 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1304/2594] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:31:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:53.321482 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613e52a-3c9e-4646-8231-567306ec3eab admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:53.432474 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613e52a-3c9e-4646-8231-567306ec3eab admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:53.451327 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a2149-0459-42c8-9d7d-54241036c0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:53.452181 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a2149-0459-42c8-9d7d-54241036c0ab admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:53.452572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a2149-0459-42c8-9d7d-54241036c0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:53.453906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a2149-0459-42c8-9d7d-54241036c0ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:53.454801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a2149-0459-42c8-9d7d-54241036c0ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:53.459702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a2149-0459-42c8-9d7d-54241036c0ab admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:53.508037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1291/2595] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:31:53 2022] POST /identity/v3/projects => generated 399 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:31:53.512241 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a219fe-d64b-4da6-8326-4cb4f0c7782d None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:53.525328 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a219fe-d64b-4da6-8326-4cb4f0c7782d None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:53.596102 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b6f71-bc01-40b8-b9fb-98088368c3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:53.597229 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b6f71-bc01-40b8-b9fb-98088368c3fa admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:53.604659 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b6f71-bc01-40b8-b9fb-98088368c3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:53.605370 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b6f71-bc01-40b8-b9fb-98088368c3fa admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:53.606920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b6f71-bc01-40b8-b9fb-98088368c3fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:53.609567 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b6f71-bc01-40b8-b9fb-98088368c3fa admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:53.643414 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1305/2596] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:31:53 2022] POST /identity/v3/users => generated 306 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:31:53.648501 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a2149-0459-42c8-9d7d-54241036c0ab admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:53.672797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a2149-0459-42c8-9d7d-54241036c0ab admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:53.685424 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61a97b-6aba-4ec0-83c3-5b5e1146d29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:53.686197 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61a97b-6aba-4ec0-83c3-5b5e1146d29e admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:53.687964 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61a97b-6aba-4ec0-83c3-5b5e1146d29e admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:53.688281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61a97b-6aba-4ec0-83c3-5b5e1146d29e admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:53.689906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61a97b-6aba-4ec0-83c3-5b5e1146d29e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:53.694134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61a97b-6aba-4ec0-83c3-5b5e1146d29e admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:53.716176 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1292/2597] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:31:53.721126 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b6f71-bc01-40b8-b9fb-98088368c3fa admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:53.742995 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b6f71-bc01-40b8-b9fb-98088368c3fa admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:53.756601 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6561d6-4e6d-4abe-ac44-442569d05659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:53.757523 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6561d6-4e6d-4abe-ac44-442569d05659 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:53.757805 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6561d6-4e6d-4abe-ac44-442569d05659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:53.758132 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6561d6-4e6d-4abe-ac44-442569d05659 admin admin] PATH_INFO: `/v3/projects/c808a4f9ffa84f7e85f4b092a6284566/users/f613ee3f3a7848bf98d3893e140f2ca4/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:53.782476 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6561d6-4e6d-4abe-ac44-442569d05659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c808a4f9ffa84f7e85f4b092a6284566, user_id=f613ee3f3a7848bf98d3893e140f2ca4, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:53.786447 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6561d6-4e6d-4abe-ac44-442569d05659 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:53.815464 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1306/2598] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:31:53 2022] PUT /identity/v3/projects/c808a4f9ffa84f7e85f4b092a6284566/users/f613ee3f3a7848bf98d3893e140f2ca4/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:31:53.819695 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61a97b-6aba-4ec0-83c3-5b5e1146d29e admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:53.847364 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61a97b-6aba-4ec0-83c3-5b5e1146d29e admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:53.977909 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9eb1d5-67e7-427d-a865-9b0b118d8cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:53.983043 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9eb1d5-67e7-427d-a865-9b0b118d8cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:53.983882 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9eb1d5-67e7-427d-a865-9b0b118d8cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:53.984620 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9eb1d5-67e7-427d-a865-9b0b118d8cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:53.985887 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9eb1d5-67e7-427d-a865-9b0b118d8cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:53.989452 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9eb1d5-67e7-427d-a865-9b0b118d8cf2 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:54.004078 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1293/2599] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:31:54.008005 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6561d6-4e6d-4abe-ac44-442569d05659 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:54.024009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6561d6-4e6d-4abe-ac44-442569d05659 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:54.027721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da179b-efad-423c-9c6a-857d58194bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:54.029002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da179b-efad-423c-9c6a-857d58194bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:54.029364 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da179b-efad-423c-9c6a-857d58194bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:54.034159 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da179b-efad-423c-9c6a-857d58194bdd admin admin] PATH_INFO: `/v3/projects/c808a4f9ffa84f7e85f4b092a6284566/users/f613ee3f3a7848bf98d3893e140f2ca4/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:54.043365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da179b-efad-423c-9c6a-857d58194bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c808a4f9ffa84f7e85f4b092a6284566, user_id=f613ee3f3a7848bf98d3893e140f2ca4, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:54.060476 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da179b-efad-423c-9c6a-857d58194bdd admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:54.083393 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1307/2600] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:31:54 2022] PUT /identity/v3/projects/c808a4f9ffa84f7e85f4b092a6284566/users/f613ee3f3a7848bf98d3893e140f2ca4/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:31:54.096227 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c68e45-48ef-4772-9f13-bb060fde31bf None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:54.096729 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c68e45-48ef-4772-9f13-bb060fde31bf None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:54.097093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c68e45-48ef-4772-9f13-bb060fde31bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:54.144190 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-e7c68e45-48ef-4772-9f13-bb060fde31bf None None] MFA Rules not processed for user `f613ee3f3a7848bf98d3893e140f2ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:54.146289 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-e7c68e45-48ef-4772-9f13-bb060fde31bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:54.255318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1294/2601] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:31:54 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:54.265922 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da179b-efad-423c-9c6a-857d58194bdd admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:54.268778 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-d9da179b-efad-423c-9c6a-857d58194bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:54.351958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da179b-efad-423c-9c6a-857d58194bdd admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:54.356443 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4b5cc-4a55-4b88-bf96-d6775a10e823 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:54.357180 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4b5cc-4a55-4b88-bf96-d6775a10e823 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:54.357557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4b5cc-4a55-4b88-bf96-d6775a10e823 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:54.358434 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4b5cc-4a55-4b88-bf96-d6775a10e823 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:54.368784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4b5cc-4a55-4b88-bf96-d6775a10e823 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:54.370845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4b5cc-4a55-4b88-bf96-d6775a10e823 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:54.388676 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1308/2602] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:31:54 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:31:54.481041 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c68e45-48ef-4772-9f13-bb060fde31bf None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:54.496187 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c68e45-48ef-4772-9f13-bb060fde31bf None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:54.508598 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da092db7-37da-4778-894b-fb65fd85d921 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:54.509433 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da092db7-37da-4778-894b-fb65fd85d921 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:54.509967 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da092db7-37da-4778-894b-fb65fd85d921 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:54.510318 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da092db7-37da-4778-894b-fb65fd85d921 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:54.578831 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da092db7-37da-4778-894b-fb65fd85d921 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:54.581607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da092db7-37da-4778-894b-fb65fd85d921 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:54.591431 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1295/2603] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:31:54 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:31:55.240310 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2b00e-c111-4d89-ac10-751815d2017c None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:55.240832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2b00e-c111-4d89-ac10-751815d2017c None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:55.240832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2b00e-c111-4d89-ac10-751815d2017c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:55.272077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-c8c2b00e-c111-4d89-ac10-751815d2017c None None] MFA Rules not processed for user `bdeae37d6dfb4c0a95c6c9b07c2b5ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:55.273665 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c8c2b00e-c111-4d89-ac10-751815d2017c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:55.368532 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1309/2604] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:31:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:55.383274 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da092db7-37da-4778-894b-fb65fd85d921 service cinder] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:55.384696 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-da092db7-37da-4778-894b-fb65fd85d921 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:55.486611 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da092db7-37da-4778-894b-fb65fd85d921 service cinder] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:55.492947 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff271f9d-fb39-483e-bd09-c68b1df37944 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:55.493608 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff271f9d-fb39-483e-bd09-c68b1df37944 service nova] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:55.494058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff271f9d-fb39-483e-bd09-c68b1df37944 service nova] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:55.494333 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff271f9d-fb39-483e-bd09-c68b1df37944 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:55.503196 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff271f9d-fb39-483e-bd09-c68b1df37944 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:55.504781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff271f9d-fb39-483e-bd09-c68b1df37944 service nova] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:55.514066 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1296/2605] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:31:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:31:57.008771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256db46-0a32-494d-9a83-ac5977ced7ff None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:57.009238 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256db46-0a32-494d-9a83-ac5977ced7ff None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:57.009333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256db46-0a32-494d-9a83-ac5977ced7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:57.034909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-d256db46-0a32-494d-9a83-ac5977ced7ff None None] MFA Rules not processed for user `bdeae37d6dfb4c0a95c6c9b07c2b5ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:57.036184 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-d256db46-0a32-494d-9a83-ac5977ced7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:57.043136 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1310/2606] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:31:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:57.465886 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff271f9d-fb39-483e-bd09-c68b1df37944 service nova] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:57.467599 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-ff271f9d-fb39-483e-bd09-c68b1df37944 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:57.586466 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff271f9d-fb39-483e-bd09-c68b1df37944 service nova] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:57.609749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b4e98-127d-4548-8396-1a3e85eb0801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:57.610753 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b4e98-127d-4548-8396-1a3e85eb0801 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:57.612232 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b4e98-127d-4548-8396-1a3e85eb0801 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:57.612720 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b4e98-127d-4548-8396-1a3e85eb0801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:57.615766 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-762b4e98-127d-4548-8396-1a3e85eb0801 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:57.628754 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256db46-0a32-494d-9a83-ac5977ced7ff None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:57.639540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256db46-0a32-494d-9a83-ac5977ced7ff None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:57.640614 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b4e98-127d-4548-8396-1a3e85eb0801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:57.643815 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b4e98-127d-4548-8396-1a3e85eb0801 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:57.644740 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1eb73-1ebe-4c7e-bebc-8e5490fa164a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:57.645388 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1eb73-1ebe-4c7e-bebc-8e5490fa164a service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:57.645667 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1eb73-1ebe-4c7e-bebc-8e5490fa164a service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:57.645939 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1eb73-1ebe-4c7e-bebc-8e5490fa164a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:57.647710 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-63f1eb73-1ebe-4c7e-bebc-8e5490fa164a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:57.659272 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1297/2607] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:31:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:31:57.744908 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1eb73-1ebe-4c7e-bebc-8e5490fa164a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:57.746725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1eb73-1ebe-4c7e-bebc-8e5490fa164a service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:57.759356 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1311/2608] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:31:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:31:59.123207 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b4e98-127d-4548-8396-1a3e85eb0801 service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:59.196080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b4e98-127d-4548-8396-1a3e85eb0801 service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:59.200657 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff946e7-f153-4bf1-b1e1-97992bd60122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:59.201557 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff946e7-f153-4bf1-b1e1-97992bd60122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:59.201847 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff946e7-f153-4bf1-b1e1-97992bd60122 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:59.202124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff946e7-f153-4bf1-b1e1-97992bd60122 admin admin] PATH_INFO: `/v3/users/bb7fca8ddee2414cb3cb89cfb498058d` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:59.203321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff946e7-f153-4bf1-b1e1-97992bd60122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb7fca8ddee2414cb3cb89cfb498058d)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:59.205825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff946e7-f153-4bf1-b1e1-97992bd60122 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:59.260905 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-dff946e7-f153-4bf1-b1e1-97992bd60122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb7fca8ddee2414cb3cb89cfb498058d'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:59.272874 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-dff946e7-f153-4bf1-b1e1-97992bd60122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb7fca8ddee2414cb3cb89cfb498058d'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:59.280330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-dff946e7-f153-4bf1-b1e1-97992bd60122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb7fca8ddee2414cb3cb89cfb498058d'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:59.280498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-dff946e7-f153-4bf1-b1e1-97992bd60122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb7fca8ddee2414cb3cb89cfb498058d'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:59.289613 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-dff946e7-f153-4bf1-b1e1-97992bd60122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb7fca8ddee2414cb3cb89cfb498058d'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:59.296100 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1298/2609] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:31:59 2022] DELETE /identity/v3/users/bb7fca8ddee2414cb3cb89cfb498058d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:31:59.302421 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53040796-0088-4594-8e17-b72e752458a1 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:59.302886 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53040796-0088-4594-8e17-b72e752458a1 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:59.302989 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53040796-0088-4594-8e17-b72e752458a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:59.335366 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-53040796-0088-4594-8e17-b72e752458a1 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:31:59.336620 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-53040796-0088-4594-8e17-b72e752458a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:59.421843 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1312/2610] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:31:59.432979 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff946e7-f153-4bf1-b1e1-97992bd60122 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:59.434546 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-dff946e7-f153-4bf1-b1e1-97992bd60122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:59.494757 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff946e7-f153-4bf1-b1e1-97992bd60122 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:59.498492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872470e8-3fca-49a2-be8c-65e4ca2556a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:59.499156 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872470e8-3fca-49a2-be8c-65e4ca2556a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:59.499445 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872470e8-3fca-49a2-be8c-65e4ca2556a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:59.500063 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872470e8-3fca-49a2-be8c-65e4ca2556a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:59.509865 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872470e8-3fca-49a2-be8c-65e4ca2556a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:59.511268 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872470e8-3fca-49a2-be8c-65e4ca2556a2 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:59.523631 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1299/2611] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:31:59.793637 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53040796-0088-4594-8e17-b72e752458a1 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:59.795054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-53040796-0088-4594-8e17-b72e752458a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:31:59.807419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53040796-0088-4594-8e17-b72e752458a1 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:59.812717 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32447bf7-5f8e-4597-b6fa-96042638c11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:59.813700 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32447bf7-5f8e-4597-b6fa-96042638c11f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:59.814046 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32447bf7-5f8e-4597-b6fa-96042638c11f admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:59.814319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32447bf7-5f8e-4597-b6fa-96042638c11f admin admin] PATH_INFO: `/v3/projects/701ccd3797cf4288b847e579b85e3c19` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:59.815577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32447bf7-5f8e-4597-b6fa-96042638c11f admin admin] RBAC: Authorizing `identity:delete_project(project_id=701ccd3797cf4288b847e579b85e3c19)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:59.817587 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32447bf7-5f8e-4597-b6fa-96042638c11f admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:31:59.865723 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-32447bf7-5f8e-4597-b6fa-96042638c11f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '701ccd3797cf4288b847e579b85e3c19', 'request_id': 'req-32447bf7-5f8e-4597-b6fa-96042638c11f'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:59.872307 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-32447bf7-5f8e-4597-b6fa-96042638c11f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '701ccd3797cf4288b847e579b85e3c19', 'request_id': 'req-32447bf7-5f8e-4597-b6fa-96042638c11f'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:59.878516 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-32447bf7-5f8e-4597-b6fa-96042638c11f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '701ccd3797cf4288b847e579b85e3c19', 'request_id': 'req-32447bf7-5f8e-4597-b6fa-96042638c11f'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:59.888281 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-32447bf7-5f8e-4597-b6fa-96042638c11f admin admin] The token cache is being invalidate because project 701ccd3797cf4288b847e579b85e3c19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:31:59.888565 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-32447bf7-5f8e-4597-b6fa-96042638c11f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:59.889194 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-32447bf7-5f8e-4597-b6fa-96042638c11f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:31:59.890724 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1313/2612] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:31:59 2022] DELETE /identity/v3/projects/701ccd3797cf4288b847e579b85e3c19 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:31:59.895691 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872470e8-3fca-49a2-be8c-65e4ca2556a2 service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:31:59.905341 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872470e8-3fca-49a2-be8c-65e4ca2556a2 service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:31:59.961303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a35d3-dead-4032-ac63-a15e345a0efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:31:59.962167 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a35d3-dead-4032-ac63-a15e345a0efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:31:59.962453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a35d3-dead-4032-ac63-a15e345a0efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:31:59.962727 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a35d3-dead-4032-ac63-a15e345a0efb admin admin] PATH_INFO: `/v3/users/f613ee3f3a7848bf98d3893e140f2ca4` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:31:59.963894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a35d3-dead-4032-ac63-a15e345a0efb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f613ee3f3a7848bf98d3893e140f2ca4)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:31:59.965807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a35d3-dead-4032-ac63-a15e345a0efb admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:00.012662 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f71a35d3-dead-4032-ac63-a15e345a0efb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f613ee3f3a7848bf98d3893e140f2ca4'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:00.025963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f71a35d3-dead-4032-ac63-a15e345a0efb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f613ee3f3a7848bf98d3893e140f2ca4'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:00.032539 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f71a35d3-dead-4032-ac63-a15e345a0efb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f613ee3f3a7848bf98d3893e140f2ca4'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:00.033860 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f71a35d3-dead-4032-ac63-a15e345a0efb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f613ee3f3a7848bf98d3893e140f2ca4'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:00.041266 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f71a35d3-dead-4032-ac63-a15e345a0efb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f613ee3f3a7848bf98d3893e140f2ca4'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:00.047158 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1300/2613] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:31:59 2022] DELETE /identity/v3/users/f613ee3f3a7848bf98d3893e140f2ca4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:00.326960 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32447bf7-5f8e-4597-b6fa-96042638c11f admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:00.328521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-32447bf7-5f8e-4597-b6fa-96042638c11f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:00.342065 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32447bf7-5f8e-4597-b6fa-96042638c11f admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:00.399225 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3399e-eec3-46c1-be80-5985fbccc861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:00.400074 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3399e-eec3-46c1-be80-5985fbccc861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:00.400383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3399e-eec3-46c1-be80-5985fbccc861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:00.400655 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3399e-eec3-46c1-be80-5985fbccc861 admin admin] PATH_INFO: `/v3/projects/c808a4f9ffa84f7e85f4b092a6284566` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:00.401809 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3399e-eec3-46c1-be80-5985fbccc861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c808a4f9ffa84f7e85f4b092a6284566)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:00.403713 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3399e-eec3-46c1-be80-5985fbccc861 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:00.451030 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-0ea3399e-eec3-46c1-be80-5985fbccc861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c808a4f9ffa84f7e85f4b092a6284566', 'request_id': 'req-0ea3399e-eec3-46c1-be80-5985fbccc861'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:00.458731 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-0ea3399e-eec3-46c1-be80-5985fbccc861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c808a4f9ffa84f7e85f4b092a6284566', 'request_id': 'req-0ea3399e-eec3-46c1-be80-5985fbccc861'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:00.464912 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-0ea3399e-eec3-46c1-be80-5985fbccc861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c808a4f9ffa84f7e85f4b092a6284566', 'request_id': 'req-0ea3399e-eec3-46c1-be80-5985fbccc861'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:00.476139 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-0ea3399e-eec3-46c1-be80-5985fbccc861 admin admin] The token cache is being invalidate because project c808a4f9ffa84f7e85f4b092a6284566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:32:00.476470 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-0ea3399e-eec3-46c1-be80-5985fbccc861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:00.477131 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-0ea3399e-eec3-46c1-be80-5985fbccc861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:00.478680 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1314/2614] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:32:00 2022] DELETE /identity/v3/projects/c808a4f9ffa84f7e85f4b092a6284566 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:00.483508 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9106777-fd22-49e5-a0c6-2d2b1d8cc641 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:00.484020 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9106777-fd22-49e5-a0c6-2d2b1d8cc641 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:00.484124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9106777-fd22-49e5-a0c6-2d2b1d8cc641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:00.502235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-e9106777-fd22-49e5-a0c6-2d2b1d8cc641 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:00.503437 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-e9106777-fd22-49e5-a0c6-2d2b1d8cc641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:00.564007 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1301/2615] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:00.572901 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1094f16-6e1a-4c9a-ad2e-005fee466a89 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:00.573123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1094f16-6e1a-4c9a-ad2e-005fee466a89 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:00.573397 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1094f16-6e1a-4c9a-ad2e-005fee466a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:00.591296 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-f1094f16-6e1a-4c9a-ad2e-005fee466a89 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:00.592517 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f1094f16-6e1a-4c9a-ad2e-005fee466a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:00.600881 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1315/2616] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:00.605065 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9106777-fd22-49e5-a0c6-2d2b1d8cc641 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:00.615176 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9106777-fd22-49e5-a0c6-2d2b1d8cc641 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:00.619738 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdaadd-c232-4cc2-9c82-c9b5a2849e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:00.620420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdaadd-c232-4cc2-9c82-c9b5a2849e81 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:00.620710 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdaadd-c232-4cc2-9c82-c9b5a2849e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:00.620986 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdaadd-c232-4cc2-9c82-c9b5a2849e81 admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:00.621736 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdaadd-c232-4cc2-9c82-c9b5a2849e81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:32:00.622068 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdaadd-c232-4cc2-9c82-c9b5a2849e81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:00.623640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdaadd-c232-4cc2-9c82-c9b5a2849e81 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:00.634985 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1302/2617] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:32:00.639078 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1094f16-6e1a-4c9a-ad2e-005fee466a89 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:00.648960 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1094f16-6e1a-4c9a-ad2e-005fee466a89 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:00.653627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5d88d-7515-49ab-8122-dfaa4a59f692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:00.654266 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5d88d-7515-49ab-8122-dfaa4a59f692 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:00.654547 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5d88d-7515-49ab-8122-dfaa4a59f692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:00.654821 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5d88d-7515-49ab-8122-dfaa4a59f692 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:00.655501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5d88d-7515-49ab-8122-dfaa4a59f692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:00.657534 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5d88d-7515-49ab-8122-dfaa4a59f692 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:00.682702 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1316/2618] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:32:00 2022] POST /identity/v3/projects => generated 389 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:32:00.686883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdaadd-c232-4cc2-9c82-c9b5a2849e81 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:00.696537 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdaadd-c232-4cc2-9c82-c9b5a2849e81 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:00.750734 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f495cf4-b8ea-4f1f-ac48-f2483ba3a18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:00.751401 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f495cf4-b8ea-4f1f-ac48-f2483ba3a18a admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:00.752122 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f495cf4-b8ea-4f1f-ac48-f2483ba3a18a admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:00.752454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f495cf4-b8ea-4f1f-ac48-f2483ba3a18a admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:00.753134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f495cf4-b8ea-4f1f-ac48-f2483ba3a18a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:00.755047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f495cf4-b8ea-4f1f-ac48-f2483ba3a18a admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:00.774485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1303/2619] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:32:00 2022] POST /identity/v3/users => generated 295 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:32:00.778717 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5d88d-7515-49ab-8122-dfaa4a59f692 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:00.790144 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5d88d-7515-49ab-8122-dfaa4a59f692 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:00.794834 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61654dea-67ad-46ad-bb48-ff5074f489e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:00.795487 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61654dea-67ad-46ad-bb48-ff5074f489e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:00.795769 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61654dea-67ad-46ad-bb48-ff5074f489e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:00.796043 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61654dea-67ad-46ad-bb48-ff5074f489e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:00.796826 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61654dea-67ad-46ad-bb48-ff5074f489e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:00.798440 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61654dea-67ad-46ad-bb48-ff5074f489e6 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:00.808610 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1317/2620] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:32:00.812402 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f495cf4-b8ea-4f1f-ac48-f2483ba3a18a admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:00.822233 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f495cf4-b8ea-4f1f-ac48-f2483ba3a18a admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:00.826866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c0494-4652-4336-95aa-627e7704bf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:00.827455 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c0494-4652-4336-95aa-627e7704bf93 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:00.827740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c0494-4652-4336-95aa-627e7704bf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:00.828018 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c0494-4652-4336-95aa-627e7704bf93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:00.828774 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c0494-4652-4336-95aa-627e7704bf93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:00.830960 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c0494-4652-4336-95aa-627e7704bf93 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:00.841196 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1304/2621] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:32:00.845053 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61654dea-67ad-46ad-bb48-ff5074f489e6 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:00.855349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61654dea-67ad-46ad-bb48-ff5074f489e6 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:00.859940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c40f1-9177-4a8e-8622-1b25deff7b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:00.860843 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c40f1-9177-4a8e-8622-1b25deff7b6d admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:00.861150 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c40f1-9177-4a8e-8622-1b25deff7b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:00.861426 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c40f1-9177-4a8e-8622-1b25deff7b6d admin admin] PATH_INFO: `/v3/projects/d489d03e213c4f86b9711498763a40fc/users/24504ecf4b6944b7ab3a4568caf9bde4/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:00.875372 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c40f1-9177-4a8e-8622-1b25deff7b6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d489d03e213c4f86b9711498763a40fc, user_id=24504ecf4b6944b7ab3a4568caf9bde4, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:00.878175 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c40f1-9177-4a8e-8622-1b25deff7b6d admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:00.890395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1318/2622] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:32:00 2022] PUT /identity/v3/projects/d489d03e213c4f86b9711498763a40fc/users/24504ecf4b6944b7ab3a4568caf9bde4/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:32:00.901621 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a604a1-2d77-4510-84be-beaa284c8975 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:00.901907 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a604a1-2d77-4510-84be-beaa284c8975 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:00.902181 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a604a1-2d77-4510-84be-beaa284c8975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:00.928083 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-a2a604a1-2d77-4510-84be-beaa284c8975 None None] MFA Rules not processed for user `24504ecf4b6944b7ab3a4568caf9bde4`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:00.929287 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-a2a604a1-2d77-4510-84be-beaa284c8975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:00.991079 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1305/2623] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:00.995546 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c40f1-9177-4a8e-8622-1b25deff7b6d admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:01.063944 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c40f1-9177-4a8e-8622-1b25deff7b6d admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:01.069837 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840a60a-2894-488b-9738-2a4e1f23aa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:01.070503 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840a60a-2894-488b-9738-2a4e1f23aa10 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:01.070785 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840a60a-2894-488b-9738-2a4e1f23aa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:01.071061 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840a60a-2894-488b-9738-2a4e1f23aa10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:01.071759 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840a60a-2894-488b-9738-2a4e1f23aa10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:01.073787 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840a60a-2894-488b-9738-2a4e1f23aa10 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:01.102504 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1319/2624] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:32:00 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:32:01.103915 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a604a1-2d77-4510-84be-beaa284c8975 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:01.114973 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a604a1-2d77-4510-84be-beaa284c8975 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:01.170512 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08919ff-2d69-4931-97e7-0710b5398ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:01.171180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08919ff-2d69-4931-97e7-0710b5398ced admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:01.171466 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08919ff-2d69-4931-97e7-0710b5398ced admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:01.171746 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08919ff-2d69-4931-97e7-0710b5398ced admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:01.172459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08919ff-2d69-4931-97e7-0710b5398ced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:01.174473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08919ff-2d69-4931-97e7-0710b5398ced admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:01.194117 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1306/2625] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:32:01 2022] POST /identity/v3/users => generated 301 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:32:01.198308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840a60a-2894-488b-9738-2a4e1f23aa10 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:01.212232 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840a60a-2894-488b-9738-2a4e1f23aa10 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:01.224247 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc33f7-596a-43b2-a9a3-1d9a2cfd88ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:01.225038 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc33f7-596a-43b2-a9a3-1d9a2cfd88ed admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:01.225488 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc33f7-596a-43b2-a9a3-1d9a2cfd88ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:01.225845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc33f7-596a-43b2-a9a3-1d9a2cfd88ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:01.226757 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc33f7-596a-43b2-a9a3-1d9a2cfd88ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:01.228521 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc33f7-596a-43b2-a9a3-1d9a2cfd88ed admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:01.244684 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1320/2626] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:32:01.248870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08919ff-2d69-4931-97e7-0710b5398ced admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:01.260723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08919ff-2d69-4931-97e7-0710b5398ced admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:01.265908 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106712d-6109-4a7b-8cad-9d7d987b50ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:01.266786 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106712d-6109-4a7b-8cad-9d7d987b50ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:01.267070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106712d-6109-4a7b-8cad-9d7d987b50ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:01.268484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106712d-6109-4a7b-8cad-9d7d987b50ba admin admin] PATH_INFO: `/v3/projects/6cb5e888f6a44e65a92ea8ca1db8e738/users/2b44d1a78bda4cf6a43c46396265f651/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:01.284358 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106712d-6109-4a7b-8cad-9d7d987b50ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb5e888f6a44e65a92ea8ca1db8e738, user_id=2b44d1a78bda4cf6a43c46396265f651, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:01.287009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106712d-6109-4a7b-8cad-9d7d987b50ba admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:01.298975 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1307/2627] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:32:01 2022] PUT /identity/v3/projects/6cb5e888f6a44e65a92ea8ca1db8e738/users/2b44d1a78bda4cf6a43c46396265f651/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:01.302960 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc33f7-596a-43b2-a9a3-1d9a2cfd88ed admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:01.313035 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc33f7-596a-43b2-a9a3-1d9a2cfd88ed admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:01.371366 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f408e-1e53-4092-a915-e4030d4965dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:01.372091 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f408e-1e53-4092-a915-e4030d4965dd admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:01.372359 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f408e-1e53-4092-a915-e4030d4965dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:01.372552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f408e-1e53-4092-a915-e4030d4965dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:01.373281 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f408e-1e53-4092-a915-e4030d4965dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:01.374909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f408e-1e53-4092-a915-e4030d4965dd admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:01.385888 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1321/2628] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:32:01.389856 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106712d-6109-4a7b-8cad-9d7d987b50ba admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:01.401680 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106712d-6109-4a7b-8cad-9d7d987b50ba admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:01.406358 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ad6fe-42dd-4a2c-abe2-859dca35046c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:01.407246 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ad6fe-42dd-4a2c-abe2-859dca35046c admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:01.407526 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ad6fe-42dd-4a2c-abe2-859dca35046c admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:01.407801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ad6fe-42dd-4a2c-abe2-859dca35046c admin admin] PATH_INFO: `/v3/projects/6cb5e888f6a44e65a92ea8ca1db8e738/users/2b44d1a78bda4cf6a43c46396265f651/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:01.410428 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ad6fe-42dd-4a2c-abe2-859dca35046c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb5e888f6a44e65a92ea8ca1db8e738, user_id=2b44d1a78bda4cf6a43c46396265f651, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:01.413475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ad6fe-42dd-4a2c-abe2-859dca35046c admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:01.426557 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1308/2629] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:32:01 2022] PUT /identity/v3/projects/6cb5e888f6a44e65a92ea8ca1db8e738/users/2b44d1a78bda4cf6a43c46396265f651/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:01.438789 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796ba67-7482-42e9-a8a4-bb5b5cdd1d1d None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:01.439946 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796ba67-7482-42e9-a8a4-bb5b5cdd1d1d None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:01.439946 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796ba67-7482-42e9-a8a4-bb5b5cdd1d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:01.468775 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-3796ba67-7482-42e9-a8a4-bb5b5cdd1d1d None None] MFA Rules not processed for user `2b44d1a78bda4cf6a43c46396265f651`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:01.470030 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-3796ba67-7482-42e9-a8a4-bb5b5cdd1d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:01.557201 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1322/2630] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:01 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:32:01.570933 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ad6fe-42dd-4a2c-abe2-859dca35046c admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:01.573930 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-de3ad6fe-42dd-4a2c-abe2-859dca35046c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:01.641649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ad6fe-42dd-4a2c-abe2-859dca35046c admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:01.647139 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7d48f-aa2a-4be6-9f80-1bada80da3f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:01.647869 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7d48f-aa2a-4be6-9f80-1bada80da3f4 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:01.648293 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7d48f-aa2a-4be6-9f80-1bada80da3f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:01.648658 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7d48f-aa2a-4be6-9f80-1bada80da3f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:01.659259 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7d48f-aa2a-4be6-9f80-1bada80da3f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:01.660726 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7d48f-aa2a-4be6-9f80-1bada80da3f4 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:01.669990 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1309/2631] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:32:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:32:01.799425 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796ba67-7482-42e9-a8a4-bb5b5cdd1d1d None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:01.863228 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796ba67-7482-42e9-a8a4-bb5b5cdd1d1d None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:01.868089 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6673fb-139b-465e-b9ae-fa5e3e219250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:01.868982 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6673fb-139b-465e-b9ae-fa5e3e219250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:01.869260 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6673fb-139b-465e-b9ae-fa5e3e219250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:01.869526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6673fb-139b-465e-b9ae-fa5e3e219250 admin admin] PATH_INFO: `/v3/users/24504ecf4b6944b7ab3a4568caf9bde4` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:01.870693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6673fb-139b-465e-b9ae-fa5e3e219250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24504ecf4b6944b7ab3a4568caf9bde4)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:01.872792 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6673fb-139b-465e-b9ae-fa5e3e219250 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:01.916639 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8e6673fb-139b-465e-b9ae-fa5e3e219250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24504ecf4b6944b7ab3a4568caf9bde4'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:01.917360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8e6673fb-139b-465e-b9ae-fa5e3e219250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24504ecf4b6944b7ab3a4568caf9bde4'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:01.924571 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8e6673fb-139b-465e-b9ae-fa5e3e219250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24504ecf4b6944b7ab3a4568caf9bde4'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:01.931735 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8e6673fb-139b-465e-b9ae-fa5e3e219250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24504ecf4b6944b7ab3a4568caf9bde4'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:01.943492 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8e6673fb-139b-465e-b9ae-fa5e3e219250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24504ecf4b6944b7ab3a4568caf9bde4'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:01.949405 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1323/2632] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:32:01 2022] DELETE /identity/v3/users/24504ecf4b6944b7ab3a4568caf9bde4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:32:01.953878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750a784-6863-413d-9ff3-23d58588eb2a None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:01.954192 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750a784-6863-413d-9ff3-23d58588eb2a None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:01.954509 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750a784-6863-413d-9ff3-23d58588eb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:01.973328 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-6750a784-6863-413d-9ff3-23d58588eb2a None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:01.974535 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-6750a784-6863-413d-9ff3-23d58588eb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:02.035457 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1310/2633] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:02.045373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6673fb-139b-465e-b9ae-fa5e3e219250 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:02.046822 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8e6673fb-139b-465e-b9ae-fa5e3e219250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:02.103641 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6673fb-139b-465e-b9ae-fa5e3e219250 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:02.107320 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a0d47-c429-484c-8174-9315a2e23669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:02.108018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a0d47-c429-484c-8174-9315a2e23669 service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:02.108341 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a0d47-c429-484c-8174-9315a2e23669 service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:02.108639 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a0d47-c429-484c-8174-9315a2e23669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:02.118416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a0d47-c429-484c-8174-9315a2e23669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:02.119964 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a0d47-c429-484c-8174-9315a2e23669 service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:02.134544 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1324/2634] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:32:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:32:02.487744 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750a784-6863-413d-9ff3-23d58588eb2a None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:02.489572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-6750a784-6863-413d-9ff3-23d58588eb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:02.509296 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750a784-6863-413d-9ff3-23d58588eb2a None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:02.518512 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bd8ff-9dec-4ceb-a143-6c4386fb3405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:02.519656 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bd8ff-9dec-4ceb-a143-6c4386fb3405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:02.520013 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bd8ff-9dec-4ceb-a143-6c4386fb3405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:02.520405 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bd8ff-9dec-4ceb-a143-6c4386fb3405 admin admin] PATH_INFO: `/v3/projects/d489d03e213c4f86b9711498763a40fc` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:02.521722 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bd8ff-9dec-4ceb-a143-6c4386fb3405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d489d03e213c4f86b9711498763a40fc)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:02.523903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bd8ff-9dec-4ceb-a143-6c4386fb3405 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:02.578855 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-4e4bd8ff-9dec-4ceb-a143-6c4386fb3405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd489d03e213c4f86b9711498763a40fc', 'request_id': 'req-4e4bd8ff-9dec-4ceb-a143-6c4386fb3405'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:02.586120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-4e4bd8ff-9dec-4ceb-a143-6c4386fb3405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd489d03e213c4f86b9711498763a40fc', 'request_id': 'req-4e4bd8ff-9dec-4ceb-a143-6c4386fb3405'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:02.595166 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-4e4bd8ff-9dec-4ceb-a143-6c4386fb3405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd489d03e213c4f86b9711498763a40fc', 'request_id': 'req-4e4bd8ff-9dec-4ceb-a143-6c4386fb3405'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:02.614386 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-4e4bd8ff-9dec-4ceb-a143-6c4386fb3405 admin admin] The token cache is being invalidate because project d489d03e213c4f86b9711498763a40fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:32:02.614700 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-4e4bd8ff-9dec-4ceb-a143-6c4386fb3405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:02.615386 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-4e4bd8ff-9dec-4ceb-a143-6c4386fb3405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:02.617306 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1311/2635] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:32:02 2022] DELETE /identity/v3/projects/d489d03e213c4f86b9711498763a40fc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:02.621730 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a0d47-c429-484c-8174-9315a2e23669 service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:02.633530 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a0d47-c429-484c-8174-9315a2e23669 service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:02.708263 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f430cc5-9d0e-4b50-a78d-c6af3809fd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:02.709126 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f430cc5-9d0e-4b50-a78d-c6af3809fd9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:02.709407 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f430cc5-9d0e-4b50-a78d-c6af3809fd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:02.709681 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f430cc5-9d0e-4b50-a78d-c6af3809fd9c admin admin] PATH_INFO: `/v3/users/2b44d1a78bda4cf6a43c46396265f651` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:02.711232 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f430cc5-9d0e-4b50-a78d-c6af3809fd9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b44d1a78bda4cf6a43c46396265f651)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:02.713698 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f430cc5-9d0e-4b50-a78d-c6af3809fd9c admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:02.785896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-9f430cc5-9d0e-4b50-a78d-c6af3809fd9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b44d1a78bda4cf6a43c46396265f651'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:02.786528 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-9f430cc5-9d0e-4b50-a78d-c6af3809fd9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b44d1a78bda4cf6a43c46396265f651'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:02.795239 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-9f430cc5-9d0e-4b50-a78d-c6af3809fd9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b44d1a78bda4cf6a43c46396265f651'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:02.805818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-9f430cc5-9d0e-4b50-a78d-c6af3809fd9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b44d1a78bda4cf6a43c46396265f651'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:02.820894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-9f430cc5-9d0e-4b50-a78d-c6af3809fd9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b44d1a78bda4cf6a43c46396265f651'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:02.828438 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1325/2636] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:32:02 2022] DELETE /identity/v3/users/2b44d1a78bda4cf6a43c46396265f651 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:03.263031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bd8ff-9dec-4ceb-a143-6c4386fb3405 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:03.264496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-4e4bd8ff-9dec-4ceb-a143-6c4386fb3405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:03.278658 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bd8ff-9dec-4ceb-a143-6c4386fb3405 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:03.352860 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cae8c7-8d9e-4d65-abaf-61c43e746852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:03.353738 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cae8c7-8d9e-4d65-abaf-61c43e746852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:03.354024 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cae8c7-8d9e-4d65-abaf-61c43e746852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:03.354299 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cae8c7-8d9e-4d65-abaf-61c43e746852 admin admin] PATH_INFO: `/v3/projects/6cb5e888f6a44e65a92ea8ca1db8e738` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:03.355541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cae8c7-8d9e-4d65-abaf-61c43e746852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cb5e888f6a44e65a92ea8ca1db8e738)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:03.357528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cae8c7-8d9e-4d65-abaf-61c43e746852 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:03.407126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-a8cae8c7-8d9e-4d65-abaf-61c43e746852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cb5e888f6a44e65a92ea8ca1db8e738', 'request_id': 'req-a8cae8c7-8d9e-4d65-abaf-61c43e746852'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:03.412928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-a8cae8c7-8d9e-4d65-abaf-61c43e746852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cb5e888f6a44e65a92ea8ca1db8e738', 'request_id': 'req-a8cae8c7-8d9e-4d65-abaf-61c43e746852'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:03.420401 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-a8cae8c7-8d9e-4d65-abaf-61c43e746852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cb5e888f6a44e65a92ea8ca1db8e738', 'request_id': 'req-a8cae8c7-8d9e-4d65-abaf-61c43e746852'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:03.433149 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-a8cae8c7-8d9e-4d65-abaf-61c43e746852 admin admin] The token cache is being invalidate because project 6cb5e888f6a44e65a92ea8ca1db8e738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:32:03.433371 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-a8cae8c7-8d9e-4d65-abaf-61c43e746852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:03.434070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-a8cae8c7-8d9e-4d65-abaf-61c43e746852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:03.435898 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1312/2637] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:32:03 2022] DELETE /identity/v3/projects/6cb5e888f6a44e65a92ea8ca1db8e738 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:03.441243 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ab095-a056-4cce-8a5f-df517f36448c None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:03.441571 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ab095-a056-4cce-8a5f-df517f36448c None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:03.441843 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ab095-a056-4cce-8a5f-df517f36448c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:03.459773 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-814ab095-a056-4cce-8a5f-df517f36448c None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:03.461021 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-814ab095-a056-4cce-8a5f-df517f36448c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:03.519808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1326/2638] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:03.527373 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be182f-a080-4862-8ac2-ed7bf11899d5 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:03.527660 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be182f-a080-4862-8ac2-ed7bf11899d5 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:03.527931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be182f-a080-4862-8ac2-ed7bf11899d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:03.546107 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-83be182f-a080-4862-8ac2-ed7bf11899d5 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:03.547307 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-83be182f-a080-4862-8ac2-ed7bf11899d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:03.555898 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1313/2639] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:03.559994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ab095-a056-4cce-8a5f-df517f36448c None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:03.569419 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ab095-a056-4cce-8a5f-df517f36448c None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:03.574657 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7894b-395c-472d-ba22-ca10da93507e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:03.575338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7894b-395c-472d-ba22-ca10da93507e admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:03.575626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7894b-395c-472d-ba22-ca10da93507e admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:03.575905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7894b-395c-472d-ba22-ca10da93507e admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:03.576677 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7894b-395c-472d-ba22-ca10da93507e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:32:03.576985 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7894b-395c-472d-ba22-ca10da93507e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:03.578612 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7894b-395c-472d-ba22-ca10da93507e admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:03.593802 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1327/2640] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:32:03.594892 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be182f-a080-4862-8ac2-ed7bf11899d5 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:03.605504 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be182f-a080-4862-8ac2-ed7bf11899d5 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:03.610586 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a32d9-ca3e-4d8d-8291-6092f1570eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:03.612440 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a32d9-ca3e-4d8d-8291-6092f1570eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:03.612732 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a32d9-ca3e-4d8d-8291-6092f1570eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:03.613004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a32d9-ca3e-4d8d-8291-6092f1570eb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:03.613765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a32d9-ca3e-4d8d-8291-6092f1570eb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:03.615592 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a32d9-ca3e-4d8d-8291-6092f1570eb6 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:03.640042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1314/2641] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:32:03 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:32:03.644569 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7894b-395c-472d-ba22-ca10da93507e admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:03.654393 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7894b-395c-472d-ba22-ca10da93507e admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:03.722200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c6db9-6723-4e33-8e73-b8820cd2a304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:03.722865 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c6db9-6723-4e33-8e73-b8820cd2a304 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:03.723149 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c6db9-6723-4e33-8e73-b8820cd2a304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:03.723421 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c6db9-6723-4e33-8e73-b8820cd2a304 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:03.724139 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c6db9-6723-4e33-8e73-b8820cd2a304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:03.726112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c6db9-6723-4e33-8e73-b8820cd2a304 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:03.745220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1328/2642] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:32:03 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:32:03.749450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a32d9-ca3e-4d8d-8291-6092f1570eb6 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:03.760084 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a32d9-ca3e-4d8d-8291-6092f1570eb6 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:03.765365 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79e3f7-572e-4438-b7b9-000130a45e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:03.766022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79e3f7-572e-4438-b7b9-000130a45e22 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:03.766302 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79e3f7-572e-4438-b7b9-000130a45e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:03.766575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79e3f7-572e-4438-b7b9-000130a45e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:03.767582 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79e3f7-572e-4438-b7b9-000130a45e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:03.769225 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79e3f7-572e-4438-b7b9-000130a45e22 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:03.779296 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1315/2643] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:32:03.783165 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c6db9-6723-4e33-8e73-b8820cd2a304 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:03.792830 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c6db9-6723-4e33-8e73-b8820cd2a304 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:03.797309 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6909d-9c1c-4870-aa49-45021130f5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:03.797948 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6909d-9c1c-4870-aa49-45021130f5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:03.798221 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6909d-9c1c-4870-aa49-45021130f5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:03.799069 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6909d-9c1c-4870-aa49-45021130f5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:03.799758 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6909d-9c1c-4870-aa49-45021130f5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:03.801370 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6909d-9c1c-4870-aa49-45021130f5c6 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:03.810818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1329/2644] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:32:03.815499 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79e3f7-572e-4438-b7b9-000130a45e22 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:03.825437 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79e3f7-572e-4438-b7b9-000130a45e22 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:03.830208 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbef09-450f-4584-b8a7-8d2b19cf51cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:03.831088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbef09-450f-4584-b8a7-8d2b19cf51cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:03.831368 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbef09-450f-4584-b8a7-8d2b19cf51cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:03.831641 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbef09-450f-4584-b8a7-8d2b19cf51cc admin admin] PATH_INFO: `/v3/projects/cfa773e378db4843bd892b75fdf10a60/users/0fbe8a331803411896e2c61c3f96ab8c/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:03.846733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bbef09-450f-4584-b8a7-8d2b19cf51cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa773e378db4843bd892b75fdf10a60, user_id=0fbe8a331803411896e2c61c3f96ab8c, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:03.849425 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bbef09-450f-4584-b8a7-8d2b19cf51cc admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:03.863216 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1316/2645] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:32:03 2022] PUT /identity/v3/projects/cfa773e378db4843bd892b75fdf10a60/users/0fbe8a331803411896e2c61c3f96ab8c/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:03.873652 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27176f-d64f-4904-a3ac-dfe990be316f None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:03.873941 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27176f-d64f-4904-a3ac-dfe990be316f None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:03.874218 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27176f-d64f-4904-a3ac-dfe990be316f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:03.901342 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-1f27176f-d64f-4904-a3ac-dfe990be316f None None] MFA Rules not processed for user `0fbe8a331803411896e2c61c3f96ab8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:03.902548 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-1f27176f-d64f-4904-a3ac-dfe990be316f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:03.967007 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1330/2646] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:03.972336 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbef09-450f-4584-b8a7-8d2b19cf51cc admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:04.032111 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbef09-450f-4584-b8a7-8d2b19cf51cc admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:04.037480 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d3a60-baf0-4d3e-8c5a-17f32fcf476e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:04.038131 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d3a60-baf0-4d3e-8c5a-17f32fcf476e admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:04.038412 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d3a60-baf0-4d3e-8c5a-17f32fcf476e admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:04.038688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d3a60-baf0-4d3e-8c5a-17f32fcf476e admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:04.039362 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d3a60-baf0-4d3e-8c5a-17f32fcf476e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:04.041282 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d3a60-baf0-4d3e-8c5a-17f32fcf476e admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:04.066424 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1317/2647] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:32:03 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:32:04.070103 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27176f-d64f-4904-a3ac-dfe990be316f None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:04.080477 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27176f-d64f-4904-a3ac-dfe990be316f None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:04.134260 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9b6af-206f-4aba-ac55-68d818c0724f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:04.134997 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9b6af-206f-4aba-ac55-68d818c0724f admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:04.135328 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9b6af-206f-4aba-ac55-68d818c0724f admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:04.135642 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9b6af-206f-4aba-ac55-68d818c0724f admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:04.136362 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9b6af-206f-4aba-ac55-68d818c0724f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:04.138279 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9b6af-206f-4aba-ac55-68d818c0724f admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:04.157496 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1331/2648] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:32:04 2022] POST /identity/v3/users => generated 296 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:32:04.161994 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d3a60-baf0-4d3e-8c5a-17f32fcf476e admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:04.172309 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d3a60-baf0-4d3e-8c5a-17f32fcf476e admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:04.177446 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42397b-1d58-4a41-9374-43c22a5d016b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:04.178110 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42397b-1d58-4a41-9374-43c22a5d016b admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:04.178421 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42397b-1d58-4a41-9374-43c22a5d016b admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:04.178721 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42397b-1d58-4a41-9374-43c22a5d016b admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:04.179467 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42397b-1d58-4a41-9374-43c22a5d016b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:04.181119 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42397b-1d58-4a41-9374-43c22a5d016b admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:04.192445 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1318/2649] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:32:04.196298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9b6af-206f-4aba-ac55-68d818c0724f admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:04.206357 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9b6af-206f-4aba-ac55-68d818c0724f admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:04.211085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e1d5b-7522-4937-96b1-ec81df164df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:04.211957 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e1d5b-7522-4937-96b1-ec81df164df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:04.212292 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e1d5b-7522-4937-96b1-ec81df164df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:04.212567 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e1d5b-7522-4937-96b1-ec81df164df3 admin admin] PATH_INFO: `/v3/projects/51e415d0db2148a38f491ae26ecaeb28/users/a9baed557cd04ea1a981c189b4094061/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:04.227687 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e1d5b-7522-4937-96b1-ec81df164df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51e415d0db2148a38f491ae26ecaeb28, user_id=a9baed557cd04ea1a981c189b4094061, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:04.230386 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e1d5b-7522-4937-96b1-ec81df164df3 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:04.244544 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1332/2650] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:32:04 2022] PUT /identity/v3/projects/51e415d0db2148a38f491ae26ecaeb28/users/a9baed557cd04ea1a981c189b4094061/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:32:04.248570 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42397b-1d58-4a41-9374-43c22a5d016b admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:04.258558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42397b-1d58-4a41-9374-43c22a5d016b admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:04.314779 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879faa9-67ac-4570-93d8-12f7259a54b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:04.315482 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879faa9-67ac-4570-93d8-12f7259a54b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:04.315771 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879faa9-67ac-4570-93d8-12f7259a54b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:04.316045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879faa9-67ac-4570-93d8-12f7259a54b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:04.316805 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879faa9-67ac-4570-93d8-12f7259a54b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:04.318394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879faa9-67ac-4570-93d8-12f7259a54b6 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:04.328299 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1319/2651] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:32:04.332586 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e1d5b-7522-4937-96b1-ec81df164df3 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:04.342833 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e1d5b-7522-4937-96b1-ec81df164df3 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:04.347856 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39062b2b-5c88-4b82-9ce3-0946f471d0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:04.348758 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39062b2b-5c88-4b82-9ce3-0946f471d0b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:04.349034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39062b2b-5c88-4b82-9ce3-0946f471d0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:04.349305 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39062b2b-5c88-4b82-9ce3-0946f471d0b7 admin admin] PATH_INFO: `/v3/projects/51e415d0db2148a38f491ae26ecaeb28/users/a9baed557cd04ea1a981c189b4094061/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:04.351225 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39062b2b-5c88-4b82-9ce3-0946f471d0b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51e415d0db2148a38f491ae26ecaeb28, user_id=a9baed557cd04ea1a981c189b4094061, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:04.353867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39062b2b-5c88-4b82-9ce3-0946f471d0b7 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:04.364261 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1333/2652] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:32:04 2022] PUT /identity/v3/projects/51e415d0db2148a38f491ae26ecaeb28/users/a9baed557cd04ea1a981c189b4094061/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:04.375061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b91e9-4601-4651-9858-40b955430bc1 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:04.375349 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b91e9-4601-4651-9858-40b955430bc1 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:04.375620 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b91e9-4601-4651-9858-40b955430bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:04.402075 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-937b91e9-4601-4651-9858-40b955430bc1 None None] MFA Rules not processed for user `a9baed557cd04ea1a981c189b4094061`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:04.403312 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-937b91e9-4601-4651-9858-40b955430bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:04.472837 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1320/2653] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:04.483492 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39062b2b-5c88-4b82-9ce3-0946f471d0b7 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:04.485259 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-39062b2b-5c88-4b82-9ce3-0946f471d0b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:04.540756 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39062b2b-5c88-4b82-9ce3-0946f471d0b7 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:04.544462 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61f349-1b8e-473a-b36d-4e45f68ed783 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:04.545112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61f349-1b8e-473a-b36d-4e45f68ed783 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:04.545395 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61f349-1b8e-473a-b36d-4e45f68ed783 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:04.545671 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61f349-1b8e-473a-b36d-4e45f68ed783 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:04.555293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61f349-1b8e-473a-b36d-4e45f68ed783 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:04.556761 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61f349-1b8e-473a-b36d-4e45f68ed783 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:04.566416 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1334/2654] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:32:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:32:04.928906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b91e9-4601-4651-9858-40b955430bc1 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:04.992824 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b91e9-4601-4651-9858-40b955430bc1 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:04.997365 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bde56-6dd4-4db3-807b-b9972b431ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:04.998231 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bde56-6dd4-4db3-807b-b9972b431ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:04.998510 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bde56-6dd4-4db3-807b-b9972b431ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:04.998781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bde56-6dd4-4db3-807b-b9972b431ac7 admin admin] PATH_INFO: `/v3/users/0fbe8a331803411896e2c61c3f96ab8c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:04.999979 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bde56-6dd4-4db3-807b-b9972b431ac7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fbe8a331803411896e2c61c3f96ab8c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:05.001960 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bde56-6dd4-4db3-807b-b9972b431ac7 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:05.056111 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-a41bde56-6dd4-4db3-807b-b9972b431ac7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fbe8a331803411896e2c61c3f96ab8c'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:05.068355 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-a41bde56-6dd4-4db3-807b-b9972b431ac7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fbe8a331803411896e2c61c3f96ab8c'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:05.074872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-a41bde56-6dd4-4db3-807b-b9972b431ac7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fbe8a331803411896e2c61c3f96ab8c'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:05.075584 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-a41bde56-6dd4-4db3-807b-b9972b431ac7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fbe8a331803411896e2c61c3f96ab8c'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:05.084143 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-a41bde56-6dd4-4db3-807b-b9972b431ac7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fbe8a331803411896e2c61c3f96ab8c'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:05.090504 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1321/2655] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:32:04 2022] DELETE /identity/v3/users/0fbe8a331803411896e2c61c3f96ab8c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:05.095077 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f31885-107d-4e57-9dbe-00705bcb7b67 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:05.096128 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f31885-107d-4e57-9dbe-00705bcb7b67 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:05.096250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f31885-107d-4e57-9dbe-00705bcb7b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:05.113996 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-b8f31885-107d-4e57-9dbe-00705bcb7b67 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:05.115221 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-b8f31885-107d-4e57-9dbe-00705bcb7b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:05.173272 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1335/2656] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:32:05.183275 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bde56-6dd4-4db3-807b-b9972b431ac7 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:05.184690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-a41bde56-6dd4-4db3-807b-b9972b431ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:05.240404 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bde56-6dd4-4db3-807b-b9972b431ac7 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:05.244082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7e5f7-2432-462a-bd8a-1697a8e42bb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:05.244713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7e5f7-2432-462a-bd8a-1697a8e42bb9 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:05.244978 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7e5f7-2432-462a-bd8a-1697a8e42bb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:05.245250 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7e5f7-2432-462a-bd8a-1697a8e42bb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:05.254211 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7e5f7-2432-462a-bd8a-1697a8e42bb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:05.255622 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7e5f7-2432-462a-bd8a-1697a8e42bb9 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:05.264753 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1322/2657] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:32:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:32:05.528620 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f31885-107d-4e57-9dbe-00705bcb7b67 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:05.530042 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-b8f31885-107d-4e57-9dbe-00705bcb7b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:05.544471 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f31885-107d-4e57-9dbe-00705bcb7b67 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:05.549577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810ae2e-ab0f-441d-be25-01645a82457f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:05.550440 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810ae2e-ab0f-441d-be25-01645a82457f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:05.550723 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810ae2e-ab0f-441d-be25-01645a82457f admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:05.551533 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810ae2e-ab0f-441d-be25-01645a82457f admin admin] PATH_INFO: `/v3/projects/cfa773e378db4843bd892b75fdf10a60` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:05.553428 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810ae2e-ab0f-441d-be25-01645a82457f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa773e378db4843bd892b75fdf10a60)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:05.555363 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810ae2e-ab0f-441d-be25-01645a82457f admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:05.601510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f810ae2e-ab0f-441d-be25-01645a82457f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa773e378db4843bd892b75fdf10a60', 'request_id': 'req-f810ae2e-ab0f-441d-be25-01645a82457f'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:05.608084 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f810ae2e-ab0f-441d-be25-01645a82457f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa773e378db4843bd892b75fdf10a60', 'request_id': 'req-f810ae2e-ab0f-441d-be25-01645a82457f'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:05.614246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f810ae2e-ab0f-441d-be25-01645a82457f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa773e378db4843bd892b75fdf10a60', 'request_id': 'req-f810ae2e-ab0f-441d-be25-01645a82457f'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:05.624349 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f810ae2e-ab0f-441d-be25-01645a82457f admin admin] The token cache is being invalidate because project cfa773e378db4843bd892b75fdf10a60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:32:05.624626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f810ae2e-ab0f-441d-be25-01645a82457f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:05.625256 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f810ae2e-ab0f-441d-be25-01645a82457f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:05.627396 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1336/2658] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:32:05 2022] DELETE /identity/v3/projects/cfa773e378db4843bd892b75fdf10a60 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:05.631456 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7e5f7-2432-462a-bd8a-1697a8e42bb9 service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:05.640713 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7e5f7-2432-462a-bd8a-1697a8e42bb9 service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:05.694659 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483b58d-dffa-4646-a8be-d92f652df9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:05.695514 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483b58d-dffa-4646-a8be-d92f652df9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:05.695792 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483b58d-dffa-4646-a8be-d92f652df9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:05.696064 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483b58d-dffa-4646-a8be-d92f652df9aa admin admin] PATH_INFO: `/v3/users/a9baed557cd04ea1a981c189b4094061` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:05.697248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483b58d-dffa-4646-a8be-d92f652df9aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9baed557cd04ea1a981c189b4094061)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:05.699141 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483b58d-dffa-4646-a8be-d92f652df9aa admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:05.743529 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-8483b58d-dffa-4646-a8be-d92f652df9aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9baed557cd04ea1a981c189b4094061'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:05.755387 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-8483b58d-dffa-4646-a8be-d92f652df9aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9baed557cd04ea1a981c189b4094061'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:05.762022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-8483b58d-dffa-4646-a8be-d92f652df9aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9baed557cd04ea1a981c189b4094061'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:05.762693 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-8483b58d-dffa-4646-a8be-d92f652df9aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9baed557cd04ea1a981c189b4094061'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:05.771214 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-8483b58d-dffa-4646-a8be-d92f652df9aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9baed557cd04ea1a981c189b4094061'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:05.781849 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1323/2659] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:32:05 2022] DELETE /identity/v3/users/a9baed557cd04ea1a981c189b4094061 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:05.867611 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383c714-2aef-4133-9430-71c986a7576c None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:05.867908 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383c714-2aef-4133-9430-71c986a7576c None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:05.868216 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383c714-2aef-4133-9430-71c986a7576c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:05.889267 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-9383c714-2aef-4133-9430-71c986a7576c None None] MFA Rules not processed for user `6dfbf496174e4138bfac5e1b925a0b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:05.890473 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-9383c714-2aef-4133-9430-71c986a7576c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:05.956839 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1337/2660] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:32:06.067705 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483b58d-dffa-4646-a8be-d92f652df9aa admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:06.069218 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-8483b58d-dffa-4646-a8be-d92f652df9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:06.134591 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483b58d-dffa-4646-a8be-d92f652df9aa admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:06.139208 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb730939-9b83-42d2-bb67-f39cabb89dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:06.140130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb730939-9b83-42d2-bb67-f39cabb89dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:06.140532 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb730939-9b83-42d2-bb67-f39cabb89dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:06.140812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb730939-9b83-42d2-bb67-f39cabb89dfe admin admin] PATH_INFO: `/v3/projects/51e415d0db2148a38f491ae26ecaeb28` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:06.142049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb730939-9b83-42d2-bb67-f39cabb89dfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=51e415d0db2148a38f491ae26ecaeb28)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:06.144426 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb730939-9b83-42d2-bb67-f39cabb89dfe admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:06.190278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-eb730939-9b83-42d2-bb67-f39cabb89dfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51e415d0db2148a38f491ae26ecaeb28', 'request_id': 'req-eb730939-9b83-42d2-bb67-f39cabb89dfe'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:06.196544 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-eb730939-9b83-42d2-bb67-f39cabb89dfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51e415d0db2148a38f491ae26ecaeb28', 'request_id': 'req-eb730939-9b83-42d2-bb67-f39cabb89dfe'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:06.209228 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-eb730939-9b83-42d2-bb67-f39cabb89dfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51e415d0db2148a38f491ae26ecaeb28', 'request_id': 'req-eb730939-9b83-42d2-bb67-f39cabb89dfe'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:06.223466 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-eb730939-9b83-42d2-bb67-f39cabb89dfe admin admin] The token cache is being invalidate because project 51e415d0db2148a38f491ae26ecaeb28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:32:06.223852 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-eb730939-9b83-42d2-bb67-f39cabb89dfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:06.224704 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-eb730939-9b83-42d2-bb67-f39cabb89dfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:06.227154 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1324/2661] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:32:06 2022] DELETE /identity/v3/projects/51e415d0db2148a38f491ae26ecaeb28 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:06.234490 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16810d8-eff7-4c6a-9642-07aa96f24e6c None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:06.235888 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16810d8-eff7-4c6a-9642-07aa96f24e6c None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:06.236361 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16810d8-eff7-4c6a-9642-07aa96f24e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:06.258948 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-f16810d8-eff7-4c6a-9642-07aa96f24e6c None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:06.260296 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f16810d8-eff7-4c6a-9642-07aa96f24e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:06.331272 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1338/2662] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:06.333140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b503da-064c-4d47-a1ef-1e3e5f83f862 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:06.333505 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b503da-064c-4d47-a1ef-1e3e5f83f862 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:06.333886 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b503da-064c-4d47-a1ef-1e3e5f83f862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:06.355998 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-19b503da-064c-4d47-a1ef-1e3e5f83f862 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:06.357434 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-19b503da-064c-4d47-a1ef-1e3e5f83f862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:06.367340 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1325/2663] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:06.371780 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16810d8-eff7-4c6a-9642-07aa96f24e6c None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:06.386143 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16810d8-eff7-4c6a-9642-07aa96f24e6c None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:06.391862 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09fff3-45cd-4bd0-aaa0-ee2a17fb651b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:06.393481 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09fff3-45cd-4bd0-aaa0-ee2a17fb651b admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:06.393830 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09fff3-45cd-4bd0-aaa0-ee2a17fb651b admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:06.394174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09fff3-45cd-4bd0-aaa0-ee2a17fb651b admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:06.395007 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09fff3-45cd-4bd0-aaa0-ee2a17fb651b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:32:06.395376 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09fff3-45cd-4bd0-aaa0-ee2a17fb651b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:06.397117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09fff3-45cd-4bd0-aaa0-ee2a17fb651b admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:06.410057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1339/2664] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:32:06.414600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b503da-064c-4d47-a1ef-1e3e5f83f862 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:06.424786 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b503da-064c-4d47-a1ef-1e3e5f83f862 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:06.430134 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b61e6-01e6-48b5-80a1-38592a18501b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:06.430798 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b61e6-01e6-48b5-80a1-38592a18501b admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:06.431104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b61e6-01e6-48b5-80a1-38592a18501b admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:06.431352 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b61e6-01e6-48b5-80a1-38592a18501b admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:06.432073 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b61e6-01e6-48b5-80a1-38592a18501b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:06.434470 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b61e6-01e6-48b5-80a1-38592a18501b admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:06.468227 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1326/2665] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:32:06 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:32:06.470635 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09fff3-45cd-4bd0-aaa0-ee2a17fb651b admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:06.506050 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09fff3-45cd-4bd0-aaa0-ee2a17fb651b admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:06.578798 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b970031-4302-4aa2-9837-bb1a5a0715d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:06.579526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b970031-4302-4aa2-9837-bb1a5a0715d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:06.579955 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b970031-4302-4aa2-9837-bb1a5a0715d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:06.580312 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b970031-4302-4aa2-9837-bb1a5a0715d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:06.581203 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b970031-4302-4aa2-9837-bb1a5a0715d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:06.583439 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b970031-4302-4aa2-9837-bb1a5a0715d2 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:06.612186 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1340/2666] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:32:06 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:32:06.616023 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b61e6-01e6-48b5-80a1-38592a18501b admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:06.626180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b61e6-01e6-48b5-80a1-38592a18501b admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:06.631207 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f56f6c-9cf2-421f-8987-89e38f352468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:06.631865 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f56f6c-9cf2-421f-8987-89e38f352468 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:06.632144 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f56f6c-9cf2-421f-8987-89e38f352468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:06.632440 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f56f6c-9cf2-421f-8987-89e38f352468 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:06.633198 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f56f6c-9cf2-421f-8987-89e38f352468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:06.634755 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f56f6c-9cf2-421f-8987-89e38f352468 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:06.646346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1327/2667] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:32:06.650546 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b970031-4302-4aa2-9837-bb1a5a0715d2 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:06.661154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b970031-4302-4aa2-9837-bb1a5a0715d2 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:06.665850 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0a005-a3f2-48a3-9e79-31589c3b95aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:06.666502 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0a005-a3f2-48a3-9e79-31589c3b95aa admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:06.667066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0a005-a3f2-48a3-9e79-31589c3b95aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:06.667066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0a005-a3f2-48a3-9e79-31589c3b95aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:06.667872 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0a005-a3f2-48a3-9e79-31589c3b95aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:06.669494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0a005-a3f2-48a3-9e79-31589c3b95aa admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:06.680818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1341/2668] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:32:06.684924 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f56f6c-9cf2-421f-8987-89e38f352468 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:06.694769 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f56f6c-9cf2-421f-8987-89e38f352468 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:06.699820 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494d230-e27e-41c8-84bc-308b230f930b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:06.700740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494d230-e27e-41c8-84bc-308b230f930b admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:06.701093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494d230-e27e-41c8-84bc-308b230f930b admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:06.701374 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494d230-e27e-41c8-84bc-308b230f930b admin admin] PATH_INFO: `/v3/projects/eb00a634c0474c00850e2174d5337ddd/users/b432ec556dc744e6808d30fd61fc8951/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:06.718669 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494d230-e27e-41c8-84bc-308b230f930b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb00a634c0474c00850e2174d5337ddd, user_id=b432ec556dc744e6808d30fd61fc8951, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:06.722205 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494d230-e27e-41c8-84bc-308b230f930b admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:06.742120 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1328/2669] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:32:06 2022] PUT /identity/v3/projects/eb00a634c0474c00850e2174d5337ddd/users/b432ec556dc744e6808d30fd61fc8951/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:06.752103 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43eb3d-e72c-44f9-8a1b-d393b26a7e8b None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:06.752615 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43eb3d-e72c-44f9-8a1b-d393b26a7e8b None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:06.752984 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43eb3d-e72c-44f9-8a1b-d393b26a7e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:06.780127 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-6c43eb3d-e72c-44f9-8a1b-d393b26a7e8b None None] MFA Rules not processed for user `b432ec556dc744e6808d30fd61fc8951`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:06.781343 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-6c43eb3d-e72c-44f9-8a1b-d393b26a7e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:06.864736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1342/2670] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:32:06.869403 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494d230-e27e-41c8-84bc-308b230f930b admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:06.933412 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494d230-e27e-41c8-84bc-308b230f930b admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:06.938651 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8b49f-5264-4dab-bb5e-43299813b2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:06.939895 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8b49f-5264-4dab-bb5e-43299813b2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:06.940197 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8b49f-5264-4dab-bb5e-43299813b2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:06.940521 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8b49f-5264-4dab-bb5e-43299813b2b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:06.941297 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8b49f-5264-4dab-bb5e-43299813b2b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:06.943443 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8b49f-5264-4dab-bb5e-43299813b2b4 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:06.971301 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1329/2671] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:32:06 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:32:06.975853 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43eb3d-e72c-44f9-8a1b-d393b26a7e8b None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:06.987709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43eb3d-e72c-44f9-8a1b-d393b26a7e8b None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:07.045896 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003829b-dbc6-4e07-accd-15a793271734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:07.046649 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003829b-dbc6-4e07-accd-15a793271734 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:07.046931 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003829b-dbc6-4e07-accd-15a793271734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:07.047223 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003829b-dbc6-4e07-accd-15a793271734 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:07.047922 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003829b-dbc6-4e07-accd-15a793271734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:07.050546 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003829b-dbc6-4e07-accd-15a793271734 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:07.071651 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1343/2672] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:32:06 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:32:07.075661 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8b49f-5264-4dab-bb5e-43299813b2b4 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:07.086615 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8b49f-5264-4dab-bb5e-43299813b2b4 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:07.091875 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fec07d-8a0a-4787-89e7-9d4ba0bfcd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:07.092615 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fec07d-8a0a-4787-89e7-9d4ba0bfcd6b admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:07.092909 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fec07d-8a0a-4787-89e7-9d4ba0bfcd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:07.093185 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fec07d-8a0a-4787-89e7-9d4ba0bfcd6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:07.094068 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fec07d-8a0a-4787-89e7-9d4ba0bfcd6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:07.095824 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fec07d-8a0a-4787-89e7-9d4ba0bfcd6b admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:07.106702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1330/2673] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:32:07.111159 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003829b-dbc6-4e07-accd-15a793271734 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:07.121232 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003829b-dbc6-4e07-accd-15a793271734 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:07.126289 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6d963-0f9a-4d37-a16f-668382c9b267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:07.128112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6d963-0f9a-4d37-a16f-668382c9b267 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:07.128504 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6d963-0f9a-4d37-a16f-668382c9b267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:07.128872 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6d963-0f9a-4d37-a16f-668382c9b267 admin admin] PATH_INFO: `/v3/projects/36d9ffc58674428a893c7d35c5475869/users/4030352b22a64218a1118a9add042eb7/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:07.146424 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6d963-0f9a-4d37-a16f-668382c9b267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36d9ffc58674428a893c7d35c5475869, user_id=4030352b22a64218a1118a9add042eb7, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:07.149228 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6d963-0f9a-4d37-a16f-668382c9b267 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:07.163307 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1344/2674] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:32:07 2022] PUT /identity/v3/projects/36d9ffc58674428a893c7d35c5475869/users/4030352b22a64218a1118a9add042eb7/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:07.167362 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fec07d-8a0a-4787-89e7-9d4ba0bfcd6b admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:07.177730 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fec07d-8a0a-4787-89e7-9d4ba0bfcd6b admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:07.239065 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19868071-1a3f-4384-a0b6-4b1628e8c363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:07.239739 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19868071-1a3f-4384-a0b6-4b1628e8c363 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:07.240019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19868071-1a3f-4384-a0b6-4b1628e8c363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:07.240394 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19868071-1a3f-4384-a0b6-4b1628e8c363 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:07.241074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19868071-1a3f-4384-a0b6-4b1628e8c363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:07.242651 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19868071-1a3f-4384-a0b6-4b1628e8c363 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:07.253061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1331/2675] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:32:07.257121 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6d963-0f9a-4d37-a16f-668382c9b267 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:07.268385 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6d963-0f9a-4d37-a16f-668382c9b267 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:07.273202 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aec45a-f11d-4e19-b8d9-2c0272bbc50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:07.274098 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aec45a-f11d-4e19-b8d9-2c0272bbc50d admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:07.274379 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aec45a-f11d-4e19-b8d9-2c0272bbc50d admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:07.274652 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aec45a-f11d-4e19-b8d9-2c0272bbc50d admin admin] PATH_INFO: `/v3/projects/36d9ffc58674428a893c7d35c5475869/users/4030352b22a64218a1118a9add042eb7/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:07.276696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aec45a-f11d-4e19-b8d9-2c0272bbc50d admin admin] RBAC: Authorizing `identity:create_grant(project_id=36d9ffc58674428a893c7d35c5475869, user_id=4030352b22a64218a1118a9add042eb7, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:07.279396 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aec45a-f11d-4e19-b8d9-2c0272bbc50d admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:07.291186 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1345/2676] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:32:07 2022] PUT /identity/v3/projects/36d9ffc58674428a893c7d35c5475869/users/4030352b22a64218a1118a9add042eb7/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:07.303117 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c3b4b-fcd0-44c3-83bc-b901eff31dd9 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:07.303351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c3b4b-fcd0-44c3-83bc-b901eff31dd9 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:07.303636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c3b4b-fcd0-44c3-83bc-b901eff31dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:07.332347 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-b91c3b4b-fcd0-44c3-83bc-b901eff31dd9 None None] MFA Rules not processed for user `4030352b22a64218a1118a9add042eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:07.333865 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-b91c3b4b-fcd0-44c3-83bc-b901eff31dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:07.403784 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1332/2677] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:07.414861 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aec45a-f11d-4e19-b8d9-2c0272bbc50d admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:07.416577 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-e2aec45a-f11d-4e19-b8d9-2c0272bbc50d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:07.474484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aec45a-f11d-4e19-b8d9-2c0272bbc50d admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:07.477965 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcef056-f7aa-436e-bb7f-389502077019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:07.478604 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcef056-f7aa-436e-bb7f-389502077019 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:07.478882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcef056-f7aa-436e-bb7f-389502077019 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:07.479155 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcef056-f7aa-436e-bb7f-389502077019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:07.537103 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcef056-f7aa-436e-bb7f-389502077019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:07.546194 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcef056-f7aa-436e-bb7f-389502077019 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:07.547821 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1346/2678] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:32:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:32:11.898288 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c3b4b-fcd0-44c3-83bc-b901eff31dd9 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:11.899775 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-b91c3b4b-fcd0-44c3-83bc-b901eff31dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:11.911335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c3b4b-fcd0-44c3-83bc-b901eff31dd9 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:11.914902 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c1703-8b09-43e9-aa95-103440a30cb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:11.915543 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c1703-8b09-43e9-aa95-103440a30cb0 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:11.915819 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c1703-8b09-43e9-aa95-103440a30cb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:11.916298 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c1703-8b09-43e9-aa95-103440a30cb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:11.925903 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c1703-8b09-43e9-aa95-103440a30cb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:11.927311 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c1703-8b09-43e9-aa95-103440a30cb0 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:11.936528 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1333/2679] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:32:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:32:13.813765 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcef056-f7aa-436e-bb7f-389502077019 service cinder] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:13.816097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8dcef056-f7aa-436e-bb7f-389502077019 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:13.891494 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcef056-f7aa-436e-bb7f-389502077019 service cinder] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:13.896781 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39b08a-53a7-436c-bcb0-c4cc2c8b7dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:13.897645 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39b08a-53a7-436c-bcb0-c4cc2c8b7dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:13.897922 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39b08a-53a7-436c-bcb0-c4cc2c8b7dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:13.898191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39b08a-53a7-436c-bcb0-c4cc2c8b7dc9 admin admin] PATH_INFO: `/v3/users/e72b162fcda049839acfc9b05b073305` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:13.899375 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39b08a-53a7-436c-bcb0-c4cc2c8b7dc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e72b162fcda049839acfc9b05b073305)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:13.901331 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39b08a-53a7-436c-bcb0-c4cc2c8b7dc9 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:13.954274 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-6b39b08a-53a7-436c-bcb0-c4cc2c8b7dc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e72b162fcda049839acfc9b05b073305'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:13.955744 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-6b39b08a-53a7-436c-bcb0-c4cc2c8b7dc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e72b162fcda049839acfc9b05b073305'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:13.964556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-6b39b08a-53a7-436c-bcb0-c4cc2c8b7dc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e72b162fcda049839acfc9b05b073305'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:13.973116 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-6b39b08a-53a7-436c-bcb0-c4cc2c8b7dc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e72b162fcda049839acfc9b05b073305'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:13.986372 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-6b39b08a-53a7-436c-bcb0-c4cc2c8b7dc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e72b162fcda049839acfc9b05b073305'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:13.993380 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1347/2680] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:32:13 2022] DELETE /identity/v3/users/e72b162fcda049839acfc9b05b073305 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:13.999032 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5f61b-0499-45d5-9e8c-def823be9ce8 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:14.000674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5f61b-0499-45d5-9e8c-def823be9ce8 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:14.001126 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5f61b-0499-45d5-9e8c-def823be9ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:14.022612 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-8ed5f61b-0499-45d5-9e8c-def823be9ce8 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:14.023838 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-8ed5f61b-0499-45d5-9e8c-def823be9ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:14.087240 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1334/2681] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:14.096826 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39b08a-53a7-436c-bcb0-c4cc2c8b7dc9 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:14.098257 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-6b39b08a-53a7-436c-bcb0-c4cc2c8b7dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:14.154119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39b08a-53a7-436c-bcb0-c4cc2c8b7dc9 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:14.157791 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46364f54-e47d-455c-bdee-d7cf4a66c3df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:14.158510 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46364f54-e47d-455c-bdee-d7cf4a66c3df service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:14.158805 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46364f54-e47d-455c-bdee-d7cf4a66c3df service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:14.159084 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46364f54-e47d-455c-bdee-d7cf4a66c3df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:14.167906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46364f54-e47d-455c-bdee-d7cf4a66c3df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:14.169379 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46364f54-e47d-455c-bdee-d7cf4a66c3df service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:14.179552 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1348/2682] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:32:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:32:14.437778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5f61b-0499-45d5-9e8c-def823be9ce8 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:14.439557 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-8ed5f61b-0499-45d5-9e8c-def823be9ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:14.451702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5f61b-0499-45d5-9e8c-def823be9ce8 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:14.457202 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903345c-c8d4-43c7-af00-aa087dc906f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:14.458053 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903345c-c8d4-43c7-af00-aa087dc906f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:14.458338 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903345c-c8d4-43c7-af00-aa087dc906f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:14.458617 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903345c-c8d4-43c7-af00-aa087dc906f1 admin admin] PATH_INFO: `/v3/projects/6bd78f22004f47f69fc9d6390173c87f` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:14.459844 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903345c-c8d4-43c7-af00-aa087dc906f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd78f22004f47f69fc9d6390173c87f)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:14.461858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903345c-c8d4-43c7-af00-aa087dc906f1 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:14.506434 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c903345c-c8d4-43c7-af00-aa087dc906f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd78f22004f47f69fc9d6390173c87f', 'request_id': 'req-c903345c-c8d4-43c7-af00-aa087dc906f1'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:14.511478 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c903345c-c8d4-43c7-af00-aa087dc906f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd78f22004f47f69fc9d6390173c87f', 'request_id': 'req-c903345c-c8d4-43c7-af00-aa087dc906f1'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:14.518649 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c903345c-c8d4-43c7-af00-aa087dc906f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd78f22004f47f69fc9d6390173c87f', 'request_id': 'req-c903345c-c8d4-43c7-af00-aa087dc906f1'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:14.529655 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c903345c-c8d4-43c7-af00-aa087dc906f1 admin admin] The token cache is being invalidate because project 6bd78f22004f47f69fc9d6390173c87f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:32:14.529948 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c903345c-c8d4-43c7-af00-aa087dc906f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:14.530573 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-c903345c-c8d4-43c7-af00-aa087dc906f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:14.532509 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1335/2683] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:32:14 2022] DELETE /identity/v3/projects/6bd78f22004f47f69fc9d6390173c87f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:14.537771 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7151912-0f02-4124-abcb-d4f13584a118 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:14.538057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7151912-0f02-4124-abcb-d4f13584a118 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:14.538362 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7151912-0f02-4124-abcb-d4f13584a118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:14.556238 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-c7151912-0f02-4124-abcb-d4f13584a118 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:14.557503 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c7151912-0f02-4124-abcb-d4f13584a118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:14.623179 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1349/2684] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:32:14.632057 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c1609-adb8-4f7c-9572-39632e10f443 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:14.632371 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c1609-adb8-4f7c-9572-39632e10f443 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:14.632651 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c1609-adb8-4f7c-9572-39632e10f443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:14.653314 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-5b7c1609-adb8-4f7c-9572-39632e10f443 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:14.654588 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-5b7c1609-adb8-4f7c-9572-39632e10f443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:14.663455 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1336/2685] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:14.667529 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7151912-0f02-4124-abcb-d4f13584a118 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:14.678210 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7151912-0f02-4124-abcb-d4f13584a118 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:14.682694 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b2479-5893-49a5-8952-8260622aeabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:14.683336 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b2479-5893-49a5-8952-8260622aeabb admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:14.683617 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b2479-5893-49a5-8952-8260622aeabb admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:14.683890 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b2479-5893-49a5-8952-8260622aeabb admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:14.684671 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b2479-5893-49a5-8952-8260622aeabb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:32:14.684976 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b2479-5893-49a5-8952-8260622aeabb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:14.686567 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b2479-5893-49a5-8952-8260622aeabb admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:14.697972 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1350/2686] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:32:14.702043 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c1609-adb8-4f7c-9572-39632e10f443 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:14.711490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c1609-adb8-4f7c-9572-39632e10f443 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:14.716109 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ded660-0b40-4c72-8139-1fd0af96478f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:14.716781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ded660-0b40-4c72-8139-1fd0af96478f admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:14.717064 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ded660-0b40-4c72-8139-1fd0af96478f admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:14.717339 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ded660-0b40-4c72-8139-1fd0af96478f admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:14.718019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ded660-0b40-4c72-8139-1fd0af96478f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:14.719909 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ded660-0b40-4c72-8139-1fd0af96478f admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:14.746404 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1337/2687] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:32:14 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:32:14.750511 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b2479-5893-49a5-8952-8260622aeabb admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:14.760241 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b2479-5893-49a5-8952-8260622aeabb admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:14.819099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c436e1f-baa7-4323-a949-a4886cf81405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:14.819782 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c436e1f-baa7-4323-a949-a4886cf81405 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:14.820034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c436e1f-baa7-4323-a949-a4886cf81405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:14.820328 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c436e1f-baa7-4323-a949-a4886cf81405 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:14.821014 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c436e1f-baa7-4323-a949-a4886cf81405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:14.822938 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c436e1f-baa7-4323-a949-a4886cf81405 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:14.844683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1351/2688] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:32:14 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:32:14.849868 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ded660-0b40-4c72-8139-1fd0af96478f admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:14.859879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ded660-0b40-4c72-8139-1fd0af96478f admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:14.865866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d3591-d03d-4f45-a4ac-e9c331dc1697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:14.866523 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d3591-d03d-4f45-a4ac-e9c331dc1697 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:14.866810 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d3591-d03d-4f45-a4ac-e9c331dc1697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:14.867088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d3591-d03d-4f45-a4ac-e9c331dc1697 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:14.867807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d3591-d03d-4f45-a4ac-e9c331dc1697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:14.869435 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d3591-d03d-4f45-a4ac-e9c331dc1697 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:14.880048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1338/2689] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:32:14.884052 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c436e1f-baa7-4323-a949-a4886cf81405 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:14.894598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c436e1f-baa7-4323-a949-a4886cf81405 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:14.899079 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d4ca5-adde-4b21-90de-de0c8f616d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:14.899743 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d4ca5-adde-4b21-90de-de0c8f616d19 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:14.900030 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d4ca5-adde-4b21-90de-de0c8f616d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:14.900335 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d4ca5-adde-4b21-90de-de0c8f616d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:14.901067 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d4ca5-adde-4b21-90de-de0c8f616d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:14.902695 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d4ca5-adde-4b21-90de-de0c8f616d19 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:14.913622 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1352/2690] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:32:14.917824 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d3591-d03d-4f45-a4ac-e9c331dc1697 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:14.928107 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d3591-d03d-4f45-a4ac-e9c331dc1697 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:14.932782 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b48ab-51d1-4073-805e-0dd9f9059ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:14.933640 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b48ab-51d1-4073-805e-0dd9f9059ec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:14.933920 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b48ab-51d1-4073-805e-0dd9f9059ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:14.934193 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b48ab-51d1-4073-805e-0dd9f9059ec6 admin admin] PATH_INFO: `/v3/projects/f286e7cea15c479cb4b1cdcb9f5ff527/users/5cf31d53b452402485f19ae9aa744ab2/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:14.948329 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b48ab-51d1-4073-805e-0dd9f9059ec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f286e7cea15c479cb4b1cdcb9f5ff527, user_id=5cf31d53b452402485f19ae9aa744ab2, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:14.950999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b48ab-51d1-4073-805e-0dd9f9059ec6 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:14.964450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1339/2691] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:32:14 2022] PUT /identity/v3/projects/f286e7cea15c479cb4b1cdcb9f5ff527/users/5cf31d53b452402485f19ae9aa744ab2/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:14.975698 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e72d2d-903f-4850-a377-94a9dca7bcb2 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:14.975988 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e72d2d-903f-4850-a377-94a9dca7bcb2 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:14.976303 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e72d2d-903f-4850-a377-94a9dca7bcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:15.001845 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-f2e72d2d-903f-4850-a377-94a9dca7bcb2 None None] MFA Rules not processed for user `5cf31d53b452402485f19ae9aa744ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:15.003172 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f2e72d2d-903f-4850-a377-94a9dca7bcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:15.073541 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1353/2692] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:15.084795 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b48ab-51d1-4073-805e-0dd9f9059ec6 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:15.087014 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-e39b48ab-51d1-4073-805e-0dd9f9059ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:15.148454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b48ab-51d1-4073-805e-0dd9f9059ec6 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:15.152097 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10f78c-853b-4f85-849d-aeb78ba6b139 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:15.152777 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10f78c-853b-4f85-849d-aeb78ba6b139 service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:15.153061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10f78c-853b-4f85-849d-aeb78ba6b139 service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:15.153335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10f78c-853b-4f85-849d-aeb78ba6b139 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:15.162469 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10f78c-853b-4f85-849d-aeb78ba6b139 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:15.163879 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10f78c-853b-4f85-849d-aeb78ba6b139 service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:15.172618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1340/2693] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:32:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:32:16.684282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f0b96-4d5d-4c3c-8105-40be38ff2181 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:16.684830 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f0b96-4d5d-4c3c-8105-40be38ff2181 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:16.684830 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f0b96-4d5d-4c3c-8105-40be38ff2181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:16.704384 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-4c5f0b96-4d5d-4c3c-8105-40be38ff2181 None None] MFA Rules not processed for user `5cf31d53b452402485f19ae9aa744ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:16.705593 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-4c5f0b96-4d5d-4c3c-8105-40be38ff2181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:16.713026 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1354/2694] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:32:16.806607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10f78c-853b-4f85-849d-aeb78ba6b139 service cinder] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:16.807989 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-ab10f78c-853b-4f85-849d-aeb78ba6b139 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:16.872391 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10f78c-853b-4f85-849d-aeb78ba6b139 service cinder] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:16.876928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2e3de-f205-4269-a792-736509c0e521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:16.877798 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2e3de-f205-4269-a792-736509c0e521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:16.878572 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2e3de-f205-4269-a792-736509c0e521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:16.879356 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2e3de-f205-4269-a792-736509c0e521 admin admin] PATH_INFO: `/v3/users/b432ec556dc744e6808d30fd61fc8951` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:16.880598 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2e3de-f205-4269-a792-736509c0e521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b432ec556dc744e6808d30fd61fc8951)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:16.882658 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2e3de-f205-4269-a792-736509c0e521 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:16.929269 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-6ff2e3de-f205-4269-a792-736509c0e521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b432ec556dc744e6808d30fd61fc8951'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:16.941092 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-6ff2e3de-f205-4269-a792-736509c0e521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b432ec556dc744e6808d30fd61fc8951'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:16.948737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-6ff2e3de-f205-4269-a792-736509c0e521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b432ec556dc744e6808d30fd61fc8951'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:16.949450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-6ff2e3de-f205-4269-a792-736509c0e521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b432ec556dc744e6808d30fd61fc8951'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:16.956818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-6ff2e3de-f205-4269-a792-736509c0e521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b432ec556dc744e6808d30fd61fc8951'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:16.963463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1341/2695] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:32:16 2022] DELETE /identity/v3/users/b432ec556dc744e6808d30fd61fc8951 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:16.968343 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a734ca3-fe64-49b1-ad17-f87d071b1164 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:16.968634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a734ca3-fe64-49b1-ad17-f87d071b1164 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:16.968906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a734ca3-fe64-49b1-ad17-f87d071b1164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:16.985915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-6a734ca3-fe64-49b1-ad17-f87d071b1164 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:16.987100 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-6a734ca3-fe64-49b1-ad17-f87d071b1164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:17.046430 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1355/2696] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:17.055774 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2e3de-f205-4269-a792-736509c0e521 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:17.057174 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-6ff2e3de-f205-4269-a792-736509c0e521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:17.115459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2e3de-f205-4269-a792-736509c0e521 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:17.119687 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a58eb-6b6b-4c47-abd1-bc85c53dbd1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:17.120428 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a58eb-6b6b-4c47-abd1-bc85c53dbd1c service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:17.120846 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a58eb-6b6b-4c47-abd1-bc85c53dbd1c service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:17.121048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a58eb-6b6b-4c47-abd1-bc85c53dbd1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:17.133546 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a58eb-6b6b-4c47-abd1-bc85c53dbd1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:17.135259 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a58eb-6b6b-4c47-abd1-bc85c53dbd1c service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:17.151195 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1342/2697] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:32:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:32:17.454194 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a734ca3-fe64-49b1-ad17-f87d071b1164 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:17.455741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-6a734ca3-fe64-49b1-ad17-f87d071b1164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:17.476711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a734ca3-fe64-49b1-ad17-f87d071b1164 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:17.490040 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496067f-919c-4ec0-83a2-526282e794b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:17.491087 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496067f-919c-4ec0-83a2-526282e794b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:17.491495 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496067f-919c-4ec0-83a2-526282e794b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:17.492441 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496067f-919c-4ec0-83a2-526282e794b7 admin admin] PATH_INFO: `/v3/projects/eb00a634c0474c00850e2174d5337ddd` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:17.494881 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496067f-919c-4ec0-83a2-526282e794b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb00a634c0474c00850e2174d5337ddd)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:17.497069 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496067f-919c-4ec0-83a2-526282e794b7 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:17.549358 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-0496067f-919c-4ec0-83a2-526282e794b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb00a634c0474c00850e2174d5337ddd', 'request_id': 'req-0496067f-919c-4ec0-83a2-526282e794b7'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:17.557756 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-0496067f-919c-4ec0-83a2-526282e794b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb00a634c0474c00850e2174d5337ddd', 'request_id': 'req-0496067f-919c-4ec0-83a2-526282e794b7'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:17.565324 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-0496067f-919c-4ec0-83a2-526282e794b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb00a634c0474c00850e2174d5337ddd', 'request_id': 'req-0496067f-919c-4ec0-83a2-526282e794b7'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:17.576619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-0496067f-919c-4ec0-83a2-526282e794b7 admin admin] The token cache is being invalidate because project eb00a634c0474c00850e2174d5337ddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:32:17.576899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-0496067f-919c-4ec0-83a2-526282e794b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:17.577549 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-0496067f-919c-4ec0-83a2-526282e794b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:17.579139 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1356/2698] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:32:17 2022] DELETE /identity/v3/projects/eb00a634c0474c00850e2174d5337ddd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:17.583185 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a58eb-6b6b-4c47-abd1-bc85c53dbd1c service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:17.592664 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a58eb-6b6b-4c47-abd1-bc85c53dbd1c service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:17.656759 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c942a2-9ea3-46d1-a0d8-f7c0ba3010b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:17.657641 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c942a2-9ea3-46d1-a0d8-f7c0ba3010b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:17.657925 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c942a2-9ea3-46d1-a0d8-f7c0ba3010b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:17.658201 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c942a2-9ea3-46d1-a0d8-f7c0ba3010b0 admin admin] PATH_INFO: `/v3/users/4030352b22a64218a1118a9add042eb7` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:17.659917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c942a2-9ea3-46d1-a0d8-f7c0ba3010b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4030352b22a64218a1118a9add042eb7)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:17.661898 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c942a2-9ea3-46d1-a0d8-f7c0ba3010b0 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:17.705791 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-93c942a2-9ea3-46d1-a0d8-f7c0ba3010b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4030352b22a64218a1118a9add042eb7'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:17.717559 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-93c942a2-9ea3-46d1-a0d8-f7c0ba3010b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4030352b22a64218a1118a9add042eb7'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:17.725569 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-93c942a2-9ea3-46d1-a0d8-f7c0ba3010b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4030352b22a64218a1118a9add042eb7'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:17.726376 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-93c942a2-9ea3-46d1-a0d8-f7c0ba3010b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4030352b22a64218a1118a9add042eb7'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:17.733133 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-93c942a2-9ea3-46d1-a0d8-f7c0ba3010b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4030352b22a64218a1118a9add042eb7'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:17.741583 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1343/2699] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:32:17 2022] DELETE /identity/v3/users/4030352b22a64218a1118a9add042eb7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:32:18.002847 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496067f-919c-4ec0-83a2-526282e794b7 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:18.004540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-0496067f-919c-4ec0-83a2-526282e794b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:18.030915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496067f-919c-4ec0-83a2-526282e794b7 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:18.090279 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102a7e7-7fe7-48b2-98e0-f5e90860fa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:18.091161 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102a7e7-7fe7-48b2-98e0-f5e90860fa0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:18.091437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102a7e7-7fe7-48b2-98e0-f5e90860fa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:18.091692 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102a7e7-7fe7-48b2-98e0-f5e90860fa0c admin admin] PATH_INFO: `/v3/projects/36d9ffc58674428a893c7d35c5475869` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:18.092913 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102a7e7-7fe7-48b2-98e0-f5e90860fa0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=36d9ffc58674428a893c7d35c5475869)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:18.094817 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102a7e7-7fe7-48b2-98e0-f5e90860fa0c admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:18.146991 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e102a7e7-7fe7-48b2-98e0-f5e90860fa0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36d9ffc58674428a893c7d35c5475869', 'request_id': 'req-e102a7e7-7fe7-48b2-98e0-f5e90860fa0c'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:18.155337 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e102a7e7-7fe7-48b2-98e0-f5e90860fa0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36d9ffc58674428a893c7d35c5475869', 'request_id': 'req-e102a7e7-7fe7-48b2-98e0-f5e90860fa0c'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:18.162874 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e102a7e7-7fe7-48b2-98e0-f5e90860fa0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36d9ffc58674428a893c7d35c5475869', 'request_id': 'req-e102a7e7-7fe7-48b2-98e0-f5e90860fa0c'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:18.174078 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e102a7e7-7fe7-48b2-98e0-f5e90860fa0c admin admin] The token cache is being invalidate because project 36d9ffc58674428a893c7d35c5475869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:32:18.174368 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e102a7e7-7fe7-48b2-98e0-f5e90860fa0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:18.175167 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e102a7e7-7fe7-48b2-98e0-f5e90860fa0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:18.176971 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1357/2700] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:32:18 2022] DELETE /identity/v3/projects/36d9ffc58674428a893c7d35c5475869 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:18.183667 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2ec20-36a0-433a-ab6a-894d78dc181e None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:18.184540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2ec20-36a0-433a-ab6a-894d78dc181e None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:18.185016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2ec20-36a0-433a-ab6a-894d78dc181e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:18.204472 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-3ac2ec20-36a0-433a-ab6a-894d78dc181e None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:18.207453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-3ac2ec20-36a0-433a-ab6a-894d78dc181e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:18.276833 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1344/2701] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:18.281723 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10887f9d-fc00-4d94-bda6-160247676d71 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:18.282010 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10887f9d-fc00-4d94-bda6-160247676d71 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:18.282281 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10887f9d-fc00-4d94-bda6-160247676d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:18.304125 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-10887f9d-fc00-4d94-bda6-160247676d71 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:18.305363 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-10887f9d-fc00-4d94-bda6-160247676d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:18.319940 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1358/2702] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:18.321423 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2ec20-36a0-433a-ab6a-894d78dc181e None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:18.332181 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2ec20-36a0-433a-ab6a-894d78dc181e None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:18.337147 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39196df4-e3fb-46fb-bb43-a80e84ef9ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:18.337805 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39196df4-e3fb-46fb-bb43-a80e84ef9ecf admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:18.338083 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39196df4-e3fb-46fb-bb43-a80e84ef9ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:18.338355 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39196df4-e3fb-46fb-bb43-a80e84ef9ecf admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:18.339073 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39196df4-e3fb-46fb-bb43-a80e84ef9ecf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:32:18.339376 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39196df4-e3fb-46fb-bb43-a80e84ef9ecf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:18.340981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39196df4-e3fb-46fb-bb43-a80e84ef9ecf admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:18.354070 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1345/2703] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:32:18.358496 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10887f9d-fc00-4d94-bda6-160247676d71 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:18.368170 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10887f9d-fc00-4d94-bda6-160247676d71 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:18.373995 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e244c-b6fc-4f95-bae4-5e4f110f9607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:18.374657 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e244c-b6fc-4f95-bae4-5e4f110f9607 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:18.374942 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e244c-b6fc-4f95-bae4-5e4f110f9607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:18.375205 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e244c-b6fc-4f95-bae4-5e4f110f9607 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:18.375901 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e244c-b6fc-4f95-bae4-5e4f110f9607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:18.378596 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e244c-b6fc-4f95-bae4-5e4f110f9607 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:18.407246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1359/2704] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:32:18 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:32:18.412017 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39196df4-e3fb-46fb-bb43-a80e84ef9ecf admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:18.422031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39196df4-e3fb-46fb-bb43-a80e84ef9ecf admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:18.486418 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3403d5-5cee-478f-b3d0-77b4227b94e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:18.487352 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3403d5-5cee-478f-b3d0-77b4227b94e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:18.487708 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3403d5-5cee-478f-b3d0-77b4227b94e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:18.488527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3403d5-5cee-478f-b3d0-77b4227b94e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:18.489408 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3403d5-5cee-478f-b3d0-77b4227b94e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:18.491348 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3403d5-5cee-478f-b3d0-77b4227b94e6 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:18.513223 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1346/2705] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:32:18 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:32:18.517358 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e244c-b6fc-4f95-bae4-5e4f110f9607 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:18.528942 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e244c-b6fc-4f95-bae4-5e4f110f9607 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:18.535970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0bd07-8429-424f-bfd5-157c5a756df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:18.536683 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0bd07-8429-424f-bfd5-157c5a756df2 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:18.537317 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0bd07-8429-424f-bfd5-157c5a756df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:18.537607 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0bd07-8429-424f-bfd5-157c5a756df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:18.538348 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0bd07-8429-424f-bfd5-157c5a756df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:18.539991 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0bd07-8429-424f-bfd5-157c5a756df2 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:18.554358 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1360/2706] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:32:18.558894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3403d5-5cee-478f-b3d0-77b4227b94e6 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:18.571209 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3403d5-5cee-478f-b3d0-77b4227b94e6 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:18.575629 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f98a3-df86-420e-ae06-0638e67789c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:18.576404 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f98a3-df86-420e-ae06-0638e67789c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:18.576769 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f98a3-df86-420e-ae06-0638e67789c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:18.577125 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f98a3-df86-420e-ae06-0638e67789c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:18.577926 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f98a3-df86-420e-ae06-0638e67789c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:18.579602 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f98a3-df86-420e-ae06-0638e67789c8 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:18.593130 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1347/2707] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:32:18.596801 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0bd07-8429-424f-bfd5-157c5a756df2 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:18.607931 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0bd07-8429-424f-bfd5-157c5a756df2 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:18.619788 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9add3-ed06-4a6c-a2f4-25a6afd39022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:18.620719 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9add3-ed06-4a6c-a2f4-25a6afd39022 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:18.621002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9add3-ed06-4a6c-a2f4-25a6afd39022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:18.621277 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9add3-ed06-4a6c-a2f4-25a6afd39022 admin admin] PATH_INFO: `/v3/projects/4d18594086434fd19336bd76a7089437/users/4834f6edcfdb4069be3c0eba58544ceb/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:18.636386 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9add3-ed06-4a6c-a2f4-25a6afd39022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d18594086434fd19336bd76a7089437, user_id=4834f6edcfdb4069be3c0eba58544ceb, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:18.639043 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9add3-ed06-4a6c-a2f4-25a6afd39022 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:18.653357 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1361/2708] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:32:18 2022] PUT /identity/v3/projects/4d18594086434fd19336bd76a7089437/users/4834f6edcfdb4069be3c0eba58544ceb/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:18.663509 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c1ce-76f2-427e-b0f9-569589cb2481 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:18.664272 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c1ce-76f2-427e-b0f9-569589cb2481 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:18.664985 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c1ce-76f2-427e-b0f9-569589cb2481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:18.688506 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-a489c1ce-76f2-427e-b0f9-569589cb2481 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:18.689863 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-a489c1ce-76f2-427e-b0f9-569589cb2481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:18.759241 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1348/2709] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:18.770678 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9add3-ed06-4a6c-a2f4-25a6afd39022 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:18.772808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-07d9add3-ed06-4a6c-a2f4-25a6afd39022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:18.838808 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9add3-ed06-4a6c-a2f4-25a6afd39022 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:18.843108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82d746-0e4a-45f6-9128-567dfefa9049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:18.843757 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82d746-0e4a-45f6-9128-567dfefa9049 service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:18.844043 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82d746-0e4a-45f6-9128-567dfefa9049 service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:18.844785 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82d746-0e4a-45f6-9128-567dfefa9049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:18.855472 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82d746-0e4a-45f6-9128-567dfefa9049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:18.857621 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82d746-0e4a-45f6-9128-567dfefa9049 service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:18.868465 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1362/2710] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:32:24.199910 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff4c16-3a4d-4d2a-a69e-2aa91aa95015 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:24.200485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff4c16-3a4d-4d2a-a69e-2aa91aa95015 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:24.200485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff4c16-3a4d-4d2a-a69e-2aa91aa95015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:24.229543 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-beff4c16-3a4d-4d2a-a69e-2aa91aa95015 None None] MFA Rules not processed for user `4834f6edcfdb4069be3c0eba58544ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:24.231191 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-beff4c16-3a4d-4d2a-a69e-2aa91aa95015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:24.306938 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1349/2711] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:24.311171 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82d746-0e4a-45f6-9128-567dfefa9049 service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:24.323471 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82d746-0e4a-45f6-9128-567dfefa9049 service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:24.328696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbbf72-a867-4e9b-a807-b975c3316bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:24.329489 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbbf72-a867-4e9b-a807-b975c3316bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:24.329885 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbbf72-a867-4e9b-a807-b975c3316bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:24.330250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbbf72-a867-4e9b-a807-b975c3316bc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:24.331227 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbbf72-a867-4e9b-a807-b975c3316bc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:24.333459 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbbf72-a867-4e9b-a807-b975c3316bc0 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:24.369066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1363/2712] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:32:24 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:32:24.374040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff4c16-3a4d-4d2a-a69e-2aa91aa95015 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:24.393953 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff4c16-3a4d-4d2a-a69e-2aa91aa95015 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:24.476985 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d7767-cecf-436b-96cc-a8f7f6dc8acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:24.478263 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d7767-cecf-436b-96cc-a8f7f6dc8acc admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:24.478723 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d7767-cecf-436b-96cc-a8f7f6dc8acc admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:24.479158 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d7767-cecf-436b-96cc-a8f7f6dc8acc admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:24.480250 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d7767-cecf-436b-96cc-a8f7f6dc8acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:24.482871 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d7767-cecf-436b-96cc-a8f7f6dc8acc admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:24.511521 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1350/2713] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:32:24 2022] POST /identity/v3/users => generated 299 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:32:24.515507 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbbf72-a867-4e9b-a807-b975c3316bc0 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:24.527032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbbf72-a867-4e9b-a807-b975c3316bc0 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:24.532957 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766f59c-9edd-4798-a16d-ef12afebe57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:24.533721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766f59c-9edd-4798-a16d-ef12afebe57e admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:24.534068 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766f59c-9edd-4798-a16d-ef12afebe57e admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:24.535083 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766f59c-9edd-4798-a16d-ef12afebe57e admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:24.535908 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766f59c-9edd-4798-a16d-ef12afebe57e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:24.537928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766f59c-9edd-4798-a16d-ef12afebe57e admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:24.555138 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1364/2714] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:32:24.560914 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d7767-cecf-436b-96cc-a8f7f6dc8acc admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:24.573335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d7767-cecf-436b-96cc-a8f7f6dc8acc admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:24.582423 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b162d73-e195-456d-a662-515fcede39f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:24.583642 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b162d73-e195-456d-a662-515fcede39f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:24.586264 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b162d73-e195-456d-a662-515fcede39f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:24.587050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b162d73-e195-456d-a662-515fcede39f9 admin admin] PATH_INFO: `/v3/projects/3004b24586f5476485acec7bb05b3c3f/users/d18beda274854cc7932cb18df8c51128/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:24.611334 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b162d73-e195-456d-a662-515fcede39f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3004b24586f5476485acec7bb05b3c3f, user_id=d18beda274854cc7932cb18df8c51128, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:24.614762 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b162d73-e195-456d-a662-515fcede39f9 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:24.634987 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1351/2715] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:32:24 2022] PUT /identity/v3/projects/3004b24586f5476485acec7bb05b3c3f/users/d18beda274854cc7932cb18df8c51128/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:24.636188 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766f59c-9edd-4798-a16d-ef12afebe57e admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:24.648335 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766f59c-9edd-4798-a16d-ef12afebe57e admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:24.711120 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca8848-d649-4d2b-813a-83d084870081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:24.711817 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca8848-d649-4d2b-813a-83d084870081 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:24.712097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca8848-d649-4d2b-813a-83d084870081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:24.712404 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca8848-d649-4d2b-813a-83d084870081 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:24.713128 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca8848-d649-4d2b-813a-83d084870081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:24.714736 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca8848-d649-4d2b-813a-83d084870081 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:24.726000 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1365/2716] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:32:24.729631 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b162d73-e195-456d-a662-515fcede39f9 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:24.741349 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b162d73-e195-456d-a662-515fcede39f9 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:24.745825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bbf36-bf1e-417a-8a4c-195e56c2241b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:24.746724 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bbf36-bf1e-417a-8a4c-195e56c2241b admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:24.747008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bbf36-bf1e-417a-8a4c-195e56c2241b admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:24.747253 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bbf36-bf1e-417a-8a4c-195e56c2241b admin admin] PATH_INFO: `/v3/projects/3004b24586f5476485acec7bb05b3c3f/users/d18beda274854cc7932cb18df8c51128/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:24.756813 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04bbf36-bf1e-417a-8a4c-195e56c2241b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3004b24586f5476485acec7bb05b3c3f, user_id=d18beda274854cc7932cb18df8c51128, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:24.759446 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04bbf36-bf1e-417a-8a4c-195e56c2241b admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:24.771517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1352/2717] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:32:24 2022] PUT /identity/v3/projects/3004b24586f5476485acec7bb05b3c3f/users/d18beda274854cc7932cb18df8c51128/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:32:30.613992 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a260882-fbe7-4678-81d6-22483c8597da None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:30.614563 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a260882-fbe7-4678-81d6-22483c8597da None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:30.614963 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a260882-fbe7-4678-81d6-22483c8597da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:30.645802 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-3a260882-fbe7-4678-81d6-22483c8597da None None] MFA Rules not processed for user `d18beda274854cc7932cb18df8c51128`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:30.647042 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-3a260882-fbe7-4678-81d6-22483c8597da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:30.719353 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1366/2718] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:30.732550 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bbf36-bf1e-417a-8a4c-195e56c2241b admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:30.734451 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-c04bbf36-bf1e-417a-8a4c-195e56c2241b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:30.791584 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bbf36-bf1e-417a-8a4c-195e56c2241b admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:30.795052 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575cfee-943f-4353-bb16-f6ac2d8300a0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62c3f9351a4181a4fc2930570171b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:30.795692 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575cfee-943f-4353-bb16-f6ac2d8300a0 service glance] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:30.795974 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575cfee-943f-4353-bb16-f6ac2d8300a0 service glance] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:30.796278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575cfee-943f-4353-bb16-f6ac2d8300a0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:30.850650 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575cfee-943f-4353-bb16-f6ac2d8300a0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:30.852067 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575cfee-943f-4353-bb16-f6ac2d8300a0 service glance] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:30.860769 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1353/2719] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:32:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:32:30.960384 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bed92-8798-4586-8d67-b651ca277687 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:30.960679 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bed92-8798-4586-8d67-b651ca277687 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:30.960957 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bed92-8798-4586-8d67-b651ca277687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:30.978860 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-7e7bed92-8798-4586-8d67-b651ca277687 None None] MFA Rules not processed for user `38a56f3572874938ad4642fa34751a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:30.980038 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-7e7bed92-8798-4586-8d67-b651ca277687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:31.036207 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1367/2720] 10.222.0.71 () {58 vars in 1009 bytes} [Mon May 16 20:32:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:31.082107 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575cfee-943f-4353-bb16-f6ac2d8300a0 service glance] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:31.083540 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-6575cfee-943f-4353-bb16-f6ac2d8300a0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:31.152087 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575cfee-943f-4353-bb16-f6ac2d8300a0 service glance] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:31.157169 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9046cb-60bf-400b-86c6-c673d346c322 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e701cf55d13410aa259ec72578ed27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:31.157840 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9046cb-60bf-400b-86c6-c673d346c322 service swift] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:31.158121 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9046cb-60bf-400b-86c6-c673d346c322 service swift] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:31.158395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9046cb-60bf-400b-86c6-c673d346c322 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:31.167682 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9046cb-60bf-400b-86c6-c673d346c322 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:31.169300 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9046cb-60bf-400b-86c6-c673d346c322 service swift] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:31.178069 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1354/2721] 10.222.0.71 () {60 vars in 1384 bytes} [Mon May 16 20:32:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 20:32:32.877373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a4c30-da14-4b82-bb03-7027a7ebf1fe None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:32.877966 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a4c30-da14-4b82-bb03-7027a7ebf1fe None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:32.878385 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a4c30-da14-4b82-bb03-7027a7ebf1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:32.899288 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-452a4c30-da14-4b82-bb03-7027a7ebf1fe None None] MFA Rules not processed for user `38a56f3572874938ad4642fa34751a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:32.900689 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-452a4c30-da14-4b82-bb03-7027a7ebf1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:32.910746 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1368/2722] 10.222.0.71 () {58 vars in 1009 bytes} [Mon May 16 20:32:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:32.925814 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9046cb-60bf-400b-86c6-c673d346c322 service swift] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:32.955688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9046cb-60bf-400b-86c6-c673d346c322 service swift] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:32.968807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144ba80-e86e-46df-9862-083cfa563961 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e701cf55d13410aa259ec72578ed27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:32.969526 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144ba80-e86e-46df-9862-083cfa563961 service swift] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:32.969811 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144ba80-e86e-46df-9862-083cfa563961 service swift] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:32.970165 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144ba80-e86e-46df-9862-083cfa563961 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:32.983447 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144ba80-e86e-46df-9862-083cfa563961 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:32.985361 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144ba80-e86e-46df-9862-083cfa563961 service swift] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:32.996235 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1355/2723] 10.222.0.71 () {60 vars in 1384 bytes} [Mon May 16 20:32:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:32:33.794076 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19e088-57bc-4e15-b3d0-730bb7c71915 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:33.794383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19e088-57bc-4e15-b3d0-730bb7c71915 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:33.794735 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19e088-57bc-4e15-b3d0-730bb7c71915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:33.833287 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-ec19e088-57bc-4e15-b3d0-730bb7c71915 None None] MFA Rules not processed for user `38a56f3572874938ad4642fa34751a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:33.834782 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-ec19e088-57bc-4e15-b3d0-730bb7c71915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:33.842927 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1369/2724] 10.222.0.71 () {58 vars in 967 bytes} [Mon May 16 20:32:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:33.864803 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144ba80-e86e-46df-9862-083cfa563961 service swift] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:33.879122 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144ba80-e86e-46df-9862-083cfa563961 service swift] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:33.889650 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee8c12-abf0-4a10-bed7-f17a8c402ba9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e701cf55d13410aa259ec72578ed27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:33.890756 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee8c12-abf0-4a10-bed7-f17a8c402ba9 service swift] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:33.892643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee8c12-abf0-4a10-bed7-f17a8c402ba9 service swift] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:33.893332 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee8c12-abf0-4a10-bed7-f17a8c402ba9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:33.906123 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee8c12-abf0-4a10-bed7-f17a8c402ba9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:33.908084 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee8c12-abf0-4a10-bed7-f17a8c402ba9 service swift] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:33.931630 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1356/2725] 10.222.0.71 () {60 vars in 1384 bytes} [Mon May 16 20:32:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:32:34.262694 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341a348-2e27-482a-a909-86a560c0ab56 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:34.263199 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341a348-2e27-482a-a909-86a560c0ab56 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:34.263396 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341a348-2e27-482a-a909-86a560c0ab56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:34.290046 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-1341a348-2e27-482a-a909-86a560c0ab56 None None] MFA Rules not processed for user `38a56f3572874938ad4642fa34751a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:34.291539 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-1341a348-2e27-482a-a909-86a560c0ab56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:34.301616 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1370/2726] 10.222.0.71 () {58 vars in 1009 bytes} [Mon May 16 20:32:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:34.319028 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee8c12-abf0-4a10-bed7-f17a8c402ba9 service swift] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:34.332063 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee8c12-abf0-4a10-bed7-f17a8c402ba9 service swift] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:34.339958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee534f-0064-4b1c-8350-1e708b8df98a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e701cf55d13410aa259ec72578ed27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:34.341174 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee534f-0064-4b1c-8350-1e708b8df98a service swift] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:34.341658 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee534f-0064-4b1c-8350-1e708b8df98a service swift] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:34.342183 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee534f-0064-4b1c-8350-1e708b8df98a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:34.354444 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee534f-0064-4b1c-8350-1e708b8df98a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:34.356058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee534f-0064-4b1c-8350-1e708b8df98a service swift] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:34.369627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1357/2727] 10.222.0.71 () {60 vars in 1384 bytes} [Mon May 16 20:32:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:32:34.836477 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8624c-3c4e-4261-85a6-3942035336fd None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:34.836776 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8624c-3c4e-4261-85a6-3942035336fd None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:34.837054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8624c-3c4e-4261-85a6-3942035336fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:34.863193 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-c1a8624c-3c4e-4261-85a6-3942035336fd None None] MFA Rules not processed for user `38a56f3572874938ad4642fa34751a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:34.864782 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c1a8624c-3c4e-4261-85a6-3942035336fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:34.874164 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1371/2728] 10.222.0.71 () {58 vars in 967 bytes} [Mon May 16 20:32:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:34.888089 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee534f-0064-4b1c-8350-1e708b8df98a service swift] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:34.902362 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee534f-0064-4b1c-8350-1e708b8df98a service swift] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:34.908741 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e8f38-9c43-45e8-9f72-3490def92492 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e701cf55d13410aa259ec72578ed27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:34.910090 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e8f38-9c43-45e8-9f72-3490def92492 service swift] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:34.910446 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e8f38-9c43-45e8-9f72-3490def92492 service swift] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:34.910790 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e8f38-9c43-45e8-9f72-3490def92492 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:34.923536 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e8f38-9c43-45e8-9f72-3490def92492 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:34.925874 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e8f38-9c43-45e8-9f72-3490def92492 service swift] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:34.935199 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1358/2729] 10.222.0.71 () {60 vars in 1384 bytes} [Mon May 16 20:32:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 20:32:37.265265 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8624c-3c4e-4261-85a6-3942035336fd None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:37.267958 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-c1a8624c-3c4e-4261-85a6-3942035336fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:37.358050 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8624c-3c4e-4261-85a6-3942035336fd None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:37.364889 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e701154-fc3e-4fd6-9486-20b29d77e105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:37.365868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e701154-fc3e-4fd6-9486-20b29d77e105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:37.366208 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e701154-fc3e-4fd6-9486-20b29d77e105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:37.366542 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e701154-fc3e-4fd6-9486-20b29d77e105 admin admin] PATH_INFO: `/v3/users/5cf31d53b452402485f19ae9aa744ab2` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:37.367821 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e701154-fc3e-4fd6-9486-20b29d77e105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cf31d53b452402485f19ae9aa744ab2)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:37.369843 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e701154-fc3e-4fd6-9486-20b29d77e105 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:37.424250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-9e701154-fc3e-4fd6-9486-20b29d77e105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cf31d53b452402485f19ae9aa744ab2'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:37.425581 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-9e701154-fc3e-4fd6-9486-20b29d77e105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cf31d53b452402485f19ae9aa744ab2'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:37.434080 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-9e701154-fc3e-4fd6-9486-20b29d77e105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cf31d53b452402485f19ae9aa744ab2'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:37.444013 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-9e701154-fc3e-4fd6-9486-20b29d77e105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cf31d53b452402485f19ae9aa744ab2'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:37.458741 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-9e701154-fc3e-4fd6-9486-20b29d77e105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cf31d53b452402485f19ae9aa744ab2'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:37.465402 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1372/2730] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:32:37 2022] DELETE /identity/v3/users/5cf31d53b452402485f19ae9aa744ab2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:37.470215 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b9112-9ffd-4edc-9f5b-8014880b2c33 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:37.470773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b9112-9ffd-4edc-9f5b-8014880b2c33 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:37.470773 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b9112-9ffd-4edc-9f5b-8014880b2c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:37.490422 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-093b9112-9ffd-4edc-9f5b-8014880b2c33 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:37.491569 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-093b9112-9ffd-4edc-9f5b-8014880b2c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:37.569112 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1359/2731] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:37.580034 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e701154-fc3e-4fd6-9486-20b29d77e105 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:37.582307 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-9e701154-fc3e-4fd6-9486-20b29d77e105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:37.648927 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e701154-fc3e-4fd6-9486-20b29d77e105 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:37.653319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf342adb-9dd9-4ecd-b8f3-d65a3e379bf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:37.654241 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf342adb-9dd9-4ecd-b8f3-d65a3e379bf0 service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:37.654884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf342adb-9dd9-4ecd-b8f3-d65a3e379bf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:37.655477 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf342adb-9dd9-4ecd-b8f3-d65a3e379bf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:37.668135 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf342adb-9dd9-4ecd-b8f3-d65a3e379bf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:37.669759 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf342adb-9dd9-4ecd-b8f3-d65a3e379bf0 service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:37.682600 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1373/2732] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:32:37.877709 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b9112-9ffd-4edc-9f5b-8014880b2c33 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:37.879967 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-093b9112-9ffd-4edc-9f5b-8014880b2c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:37.894767 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b9112-9ffd-4edc-9f5b-8014880b2c33 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:37.899956 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9b792-b71b-4c40-8f80-5c533a9a03d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:37.901109 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9b792-b71b-4c40-8f80-5c533a9a03d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:37.901607 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9b792-b71b-4c40-8f80-5c533a9a03d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:37.902076 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9b792-b71b-4c40-8f80-5c533a9a03d5 admin admin] PATH_INFO: `/v3/projects/f286e7cea15c479cb4b1cdcb9f5ff527` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:37.903504 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9b792-b71b-4c40-8f80-5c533a9a03d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f286e7cea15c479cb4b1cdcb9f5ff527)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:37.905652 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9b792-b71b-4c40-8f80-5c533a9a03d5 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:37.965518 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9ed9b792-b71b-4c40-8f80-5c533a9a03d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f286e7cea15c479cb4b1cdcb9f5ff527', 'request_id': 'req-9ed9b792-b71b-4c40-8f80-5c533a9a03d5'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:37.971030 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9ed9b792-b71b-4c40-8f80-5c533a9a03d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f286e7cea15c479cb4b1cdcb9f5ff527', 'request_id': 'req-9ed9b792-b71b-4c40-8f80-5c533a9a03d5'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:37.981220 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9ed9b792-b71b-4c40-8f80-5c533a9a03d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f286e7cea15c479cb4b1cdcb9f5ff527', 'request_id': 'req-9ed9b792-b71b-4c40-8f80-5c533a9a03d5'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:37.993699 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9ed9b792-b71b-4c40-8f80-5c533a9a03d5 admin admin] The token cache is being invalidate because project f286e7cea15c479cb4b1cdcb9f5ff527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:32:37.994143 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9ed9b792-b71b-4c40-8f80-5c533a9a03d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:37.994835 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-9ed9b792-b71b-4c40-8f80-5c533a9a03d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:32:38.008514 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1360/2733] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:32:37 2022] DELETE /identity/v3/projects/f286e7cea15c479cb4b1cdcb9f5ff527 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:32:40.943035 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ae455-ed45-419b-ba1d-7e1149722ea6 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:40.943630 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ae455-ed45-419b-ba1d-7e1149722ea6 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:40.943630 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ae455-ed45-419b-ba1d-7e1149722ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:40.960531 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-424ae455-ed45-419b-ba1d-7e1149722ea6 None None] MFA Rules not processed for user `4834f6edcfdb4069be3c0eba58544ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:40.961724 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-424ae455-ed45-419b-ba1d-7e1149722ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:41.015821 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1374/2734] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:32:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:44.194702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94c4e9-1d62-44aa-baa7-60a8260257ea None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:44.195281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94c4e9-1d62-44aa-baa7-60a8260257ea None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:44.195281 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94c4e9-1d62-44aa-baa7-60a8260257ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:44.214781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-5e94c4e9-1d62-44aa-baa7-60a8260257ea None None] MFA Rules not processed for user `38a56f3572874938ad4642fa34751a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:32:44.216182 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-5e94c4e9-1d62-44aa-baa7-60a8260257ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:44.282907 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1361/2735] 10.222.0.71 () {58 vars in 1009 bytes} [Mon May 16 20:32:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:32:44.296054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ae455-ed45-419b-ba1d-7e1149722ea6 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:44.297502 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-424ae455-ed45-419b-ba1d-7e1149722ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:44.380677 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ae455-ed45-419b-ba1d-7e1149722ea6 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:44.387532 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4ed1f-c51c-4132-8ff0-b0d49bcfe66c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e701cf55d13410aa259ec72578ed27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:44.388607 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4ed1f-c51c-4132-8ff0-b0d49bcfe66c service swift] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:44.388718 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4ed1f-c51c-4132-8ff0-b0d49bcfe66c service swift] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:44.389002 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4ed1f-c51c-4132-8ff0-b0d49bcfe66c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:44.398642 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4ed1f-c51c-4132-8ff0-b0d49bcfe66c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:44.400351 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4ed1f-c51c-4132-8ff0-b0d49bcfe66c service swift] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:44.411798 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1375/2736] 10.222.0.71 () {60 vars in 1384 bytes} [Mon May 16 20:32:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:32:54.027101 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94c4e9-1d62-44aa-baa7-60a8260257ea None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:54.028538 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-5e94c4e9-1d62-44aa-baa7-60a8260257ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:54.090372 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94c4e9-1d62-44aa-baa7-60a8260257ea None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:54.094118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f4971-6678-43bd-81d5-698a591f9c4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:54.094766 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f4971-6678-43bd-81d5-698a591f9c4e service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:54.095051 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f4971-6678-43bd-81d5-698a591f9c4e service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:54.095435 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f4971-6678-43bd-81d5-698a591f9c4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:54.097300 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-500f4971-6678-43bd-81d5-698a591f9c4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:54.163529 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f4971-6678-43bd-81d5-698a591f9c4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:54.165012 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f4971-6678-43bd-81d5-698a591f9c4e service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:54.175145 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1362/2737] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:32:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:32:55.278880 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4ed1f-c51c-4132-8ff0-b0d49bcfe66c service swift] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:32:55.280400 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-fea4ed1f-c51c-4132-8ff0-b0d49bcfe66c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:55.340629 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4ed1f-c51c-4132-8ff0-b0d49bcfe66c service swift] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:32:55.344333 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d8741-1609-4b16-9baa-091ce04afc36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:32:55.345007 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d8741-1609-4b16-9baa-091ce04afc36 service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:32:55.345288 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d8741-1609-4b16-9baa-091ce04afc36 service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:32:55.345562 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d8741-1609-4b16-9baa-091ce04afc36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:32:55.347378 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-009d8741-1609-4b16-9baa-091ce04afc36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:32:55.411402 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d8741-1609-4b16-9baa-091ce04afc36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:32:55.412879 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d8741-1609-4b16-9baa-091ce04afc36 service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:32:55.422311 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1376/2738] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:32:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:33:02.229229 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f4971-6678-43bd-81d5-698a591f9c4e service cinder] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:33:02.230754 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-500f4971-6678-43bd-81d5-698a591f9c4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:33:02.246290 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f4971-6678-43bd-81d5-698a591f9c4e service cinder] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:33:02.252385 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeac88b-c8f6-40ef-b6f8-6a034a4dc472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:33:02.253940 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeac88b-c8f6-40ef-b6f8-6a034a4dc472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:33:02.254237 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeac88b-c8f6-40ef-b6f8-6a034a4dc472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:33:02.254579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeac88b-c8f6-40ef-b6f8-6a034a4dc472 admin admin] PATH_INFO: `/v3/users/e7f77ef8223e4a64a6b72524e71f88e0` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:33:02.256030 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeac88b-c8f6-40ef-b6f8-6a034a4dc472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7f77ef8223e4a64a6b72524e71f88e0)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:33:02.258111 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeac88b-c8f6-40ef-b6f8-6a034a4dc472 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:33:02.319076 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-5eeac88b-c8f6-40ef-b6f8-6a034a4dc472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7f77ef8223e4a64a6b72524e71f88e0'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:02.331368 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-5eeac88b-c8f6-40ef-b6f8-6a034a4dc472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7f77ef8223e4a64a6b72524e71f88e0'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:02.338566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-5eeac88b-c8f6-40ef-b6f8-6a034a4dc472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7f77ef8223e4a64a6b72524e71f88e0'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:02.339638 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-5eeac88b-c8f6-40ef-b6f8-6a034a4dc472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7f77ef8223e4a64a6b72524e71f88e0'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:02.347552 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-5eeac88b-c8f6-40ef-b6f8-6a034a4dc472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7f77ef8223e4a64a6b72524e71f88e0'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:02.354993 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1363/2739] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:33:02 2022] DELETE /identity/v3/users/e7f77ef8223e4a64a6b72524e71f88e0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:33:02.541884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d8741-1609-4b16-9baa-091ce04afc36 service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:33:02.554016 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d8741-1609-4b16-9baa-091ce04afc36 service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:33:02.613228 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfddc5-7963-486f-85b1-6132d0ec7b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:33:02.614243 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfddc5-7963-486f-85b1-6132d0ec7b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:33:02.614528 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfddc5-7963-486f-85b1-6132d0ec7b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:33:02.614801 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfddc5-7963-486f-85b1-6132d0ec7b5d admin admin] PATH_INFO: `/v3/projects/0966cdee10bc4eebbb38ae04e066adf2` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:33:02.615981 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfddc5-7963-486f-85b1-6132d0ec7b5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0966cdee10bc4eebbb38ae04e066adf2)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:33:02.618082 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfddc5-7963-486f-85b1-6132d0ec7b5d admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:33:02.667258 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f3dfddc5-7963-486f-85b1-6132d0ec7b5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0966cdee10bc4eebbb38ae04e066adf2', 'request_id': 'req-f3dfddc5-7963-486f-85b1-6132d0ec7b5d'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:02.675156 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f3dfddc5-7963-486f-85b1-6132d0ec7b5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0966cdee10bc4eebbb38ae04e066adf2', 'request_id': 'req-f3dfddc5-7963-486f-85b1-6132d0ec7b5d'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:02.681220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f3dfddc5-7963-486f-85b1-6132d0ec7b5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0966cdee10bc4eebbb38ae04e066adf2', 'request_id': 'req-f3dfddc5-7963-486f-85b1-6132d0ec7b5d'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:02.691054 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f3dfddc5-7963-486f-85b1-6132d0ec7b5d admin admin] The token cache is being invalidate because project 0966cdee10bc4eebbb38ae04e066adf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:33:02.691332 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f3dfddc5-7963-486f-85b1-6132d0ec7b5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:02.692005 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-f3dfddc5-7963-486f-85b1-6132d0ec7b5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:02.693575 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1377/2740] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:33:02 2022] DELETE /identity/v3/projects/0966cdee10bc4eebbb38ae04e066adf2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:33:02.697517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeac88b-c8f6-40ef-b6f8-6a034a4dc472 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:33:02.698884 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-5eeac88b-c8f6-40ef-b6f8-6a034a4dc472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:33:02.712104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeac88b-c8f6-40ef-b6f8-6a034a4dc472 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:33:02.768416 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fbefe-0abb-44d7-ba91-b47f6fa256aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:33:02.769538 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fbefe-0abb-44d7-ba91-b47f6fa256aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:33:02.769818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fbefe-0abb-44d7-ba91-b47f6fa256aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:33:02.770702 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fbefe-0abb-44d7-ba91-b47f6fa256aa admin admin] PATH_INFO: `/v3/users/2558e376a3024db2843a1f5c38d4dfb9` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:33:02.771868 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fbefe-0abb-44d7-ba91-b47f6fa256aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=2558e376a3024db2843a1f5c38d4dfb9)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:33:02.773814 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fbefe-0abb-44d7-ba91-b47f6fa256aa admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:33:02.822597 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-b98fbefe-0abb-44d7-ba91-b47f6fa256aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2558e376a3024db2843a1f5c38d4dfb9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:02.835170 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-b98fbefe-0abb-44d7-ba91-b47f6fa256aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2558e376a3024db2843a1f5c38d4dfb9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:02.841661 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-b98fbefe-0abb-44d7-ba91-b47f6fa256aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2558e376a3024db2843a1f5c38d4dfb9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:02.842364 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-b98fbefe-0abb-44d7-ba91-b47f6fa256aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2558e376a3024db2843a1f5c38d4dfb9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:02.850336 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-b98fbefe-0abb-44d7-ba91-b47f6fa256aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2558e376a3024db2843a1f5c38d4dfb9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:02.860390 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1364/2741] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:33:02 2022] DELETE /identity/v3/users/2558e376a3024db2843a1f5c38d4dfb9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:33:03.032241 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfddc5-7963-486f-85b1-6132d0ec7b5d admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:33:03.033714 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f3dfddc5-7963-486f-85b1-6132d0ec7b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:33:03.047211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfddc5-7963-486f-85b1-6132d0ec7b5d admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:33:03.113866 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea881c5-78c7-40bd-bc3c-b3ee26abf67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:33:03.115177 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea881c5-78c7-40bd-bc3c-b3ee26abf67b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:33:03.115454 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea881c5-78c7-40bd-bc3c-b3ee26abf67b admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:33:03.115727 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea881c5-78c7-40bd-bc3c-b3ee26abf67b admin admin] PATH_INFO: `/v3/projects/627f5e5ff6954e7ba2ba9338242c2345` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:33:03.116929 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea881c5-78c7-40bd-bc3c-b3ee26abf67b admin admin] RBAC: Authorizing `identity:delete_project(project_id=627f5e5ff6954e7ba2ba9338242c2345)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:33:03.118827 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea881c5-78c7-40bd-bc3c-b3ee26abf67b admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:33:03.170545 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-5ea881c5-78c7-40bd-bc3c-b3ee26abf67b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '627f5e5ff6954e7ba2ba9338242c2345', 'request_id': 'req-5ea881c5-78c7-40bd-bc3c-b3ee26abf67b'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:03.179918 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-5ea881c5-78c7-40bd-bc3c-b3ee26abf67b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '627f5e5ff6954e7ba2ba9338242c2345', 'request_id': 'req-5ea881c5-78c7-40bd-bc3c-b3ee26abf67b'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:03.190256 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-5ea881c5-78c7-40bd-bc3c-b3ee26abf67b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '627f5e5ff6954e7ba2ba9338242c2345', 'request_id': 'req-5ea881c5-78c7-40bd-bc3c-b3ee26abf67b'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:03.203170 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-5ea881c5-78c7-40bd-bc3c-b3ee26abf67b admin admin] The token cache is being invalidate because project 627f5e5ff6954e7ba2ba9338242c2345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:33:03.203465 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-5ea881c5-78c7-40bd-bc3c-b3ee26abf67b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:03.204605 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-5ea881c5-78c7-40bd-bc3c-b3ee26abf67b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:33:03.206324 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1378/2742] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:33:03 2022] DELETE /identity/v3/projects/627f5e5ff6954e7ba2ba9338242c2345 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:33:03.272413 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b817b6-be6a-4432-b40b-08e7a041e781 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:33:03.272988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b817b6-be6a-4432-b40b-08e7a041e781 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:33:03.272988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b817b6-be6a-4432-b40b-08e7a041e781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:33:03.291433 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-c6b817b6-be6a-4432-b40b-08e7a041e781 None None] MFA Rules not processed for user `bdeae37d6dfb4c0a95c6c9b07c2b5ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:33:03.293062 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-c6b817b6-be6a-4432-b40b-08e7a041e781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:33:03.368736 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1365/2743] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:33:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:33:13.288362 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea881c5-78c7-40bd-bc3c-b3ee26abf67b admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:33:13.290375 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-5ea881c5-78c7-40bd-bc3c-b3ee26abf67b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:33:13.369163 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea881c5-78c7-40bd-bc3c-b3ee26abf67b admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:33:13.376093 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd75dc0-176a-43b7-b4a0-3e7e2c4b70ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e2c8b4ff2349919750aa0f3f7309bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:33:13.376815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd75dc0-176a-43b7-b4a0-3e7e2c4b70ed service placement] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:33:13.377171 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd75dc0-176a-43b7-b4a0-3e7e2c4b70ed service placement] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:33:13.377453 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd75dc0-176a-43b7-b4a0-3e7e2c4b70ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:33:13.380751 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-2fd75dc0-176a-43b7-b4a0-3e7e2c4b70ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:33:13.392761 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd75dc0-176a-43b7-b4a0-3e7e2c4b70ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:33:13.394702 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd75dc0-176a-43b7-b4a0-3e7e2c4b70ed service placement] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:33:13.406000 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1379/2744] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:33:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:33:14.693285 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b817b6-be6a-4432-b40b-08e7a041e781 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:33:14.694642 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-c6b817b6-be6a-4432-b40b-08e7a041e781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:33:14.752951 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b817b6-be6a-4432-b40b-08e7a041e781 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:33:14.756931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9ff2c-520d-4de6-a3a9-4b126dbf0805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:33:14.757591 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9ff2c-520d-4de6-a3a9-4b126dbf0805 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:33:14.757877 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9ff2c-520d-4de6-a3a9-4b126dbf0805 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:33:14.758548 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9ff2c-520d-4de6-a3a9-4b126dbf0805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:33:14.760017 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-d6c9ff2c-520d-4de6-a3a9-4b126dbf0805 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:33:14.824046 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9ff2c-520d-4de6-a3a9-4b126dbf0805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:33:14.825077 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9ff2c-520d-4de6-a3a9-4b126dbf0805 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:33:14.836747 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1366/2745] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:33:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:34:02.963324 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404ee9f-b5ff-4ff4-80a6-3c5b6a3005d9 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:34:02.963870 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404ee9f-b5ff-4ff4-80a6-3c5b6a3005d9 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:34:02.963981 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404ee9f-b5ff-4ff4-80a6-3c5b6a3005d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:34:02.981218 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-4404ee9f-b5ff-4ff4-80a6-3c5b6a3005d9 None None] MFA Rules not processed for user `bdeae37d6dfb4c0a95c6c9b07c2b5ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:34:02.982421 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-4404ee9f-b5ff-4ff4-80a6-3c5b6a3005d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:34:02.989339 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1380/2746] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:34:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:34:09.519037 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9ff2c-520d-4de6-a3a9-4b126dbf0805 service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:34:09.520823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-d6c9ff2c-520d-4de6-a3a9-4b126dbf0805 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:34:09.532262 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9ff2c-520d-4de6-a3a9-4b126dbf0805 service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:34:09.535674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a6d9f-be75-48eb-bae8-513ef2f730e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:34:09.536335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a6d9f-be75-48eb-bae8-513ef2f730e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:34:09.536614 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a6d9f-be75-48eb-bae8-513ef2f730e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:34:09.536884 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a6d9f-be75-48eb-bae8-513ef2f730e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:34:09.538587 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-de7a6d9f-be75-48eb-bae8-513ef2f730e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:34:09.600777 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a6d9f-be75-48eb-bae8-513ef2f730e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:34:09.602249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a6d9f-be75-48eb-bae8-513ef2f730e8 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:34:09.611858 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1367/2747] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:34:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:34:16.548565 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404ee9f-b5ff-4ff4-80a6-3c5b6a3005d9 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:34:16.550119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-4404ee9f-b5ff-4ff4-80a6-3c5b6a3005d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:34:16.564078 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404ee9f-b5ff-4ff4-80a6-3c5b6a3005d9 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:34:16.568590 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84fbdf-7007-450d-a9ab-1af8a548f8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:34:16.569898 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84fbdf-7007-450d-a9ab-1af8a548f8b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:34:16.570189 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84fbdf-7007-450d-a9ab-1af8a548f8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:34:16.570466 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84fbdf-7007-450d-a9ab-1af8a548f8b8 admin admin] PATH_INFO: `/v3/users/6dfbf496174e4138bfac5e1b925a0b2c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:34:16.571713 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84fbdf-7007-450d-a9ab-1af8a548f8b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dfbf496174e4138bfac5e1b925a0b2c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:34:16.573628 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84fbdf-7007-450d-a9ab-1af8a548f8b8 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:34:16.634101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8c84fbdf-7007-450d-a9ab-1af8a548f8b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dfbf496174e4138bfac5e1b925a0b2c'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:16.634752 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8c84fbdf-7007-450d-a9ab-1af8a548f8b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dfbf496174e4138bfac5e1b925a0b2c'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:16.643321 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8c84fbdf-7007-450d-a9ab-1af8a548f8b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dfbf496174e4138bfac5e1b925a0b2c'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:16.652534 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8c84fbdf-7007-450d-a9ab-1af8a548f8b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dfbf496174e4138bfac5e1b925a0b2c'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:16.665096 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8c84fbdf-7007-450d-a9ab-1af8a548f8b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dfbf496174e4138bfac5e1b925a0b2c'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:16.672232 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1381/2748] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:34:16 2022] DELETE /identity/v3/users/6dfbf496174e4138bfac5e1b925a0b2c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:34:16.855717 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a6d9f-be75-48eb-bae8-513ef2f730e8 service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:34:16.870201 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a6d9f-be75-48eb-bae8-513ef2f730e8 service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:34:16.935958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32902c-2531-4818-9800-0734ee026b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:34:16.936972 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32902c-2531-4818-9800-0734ee026b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:34:16.937321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32902c-2531-4818-9800-0734ee026b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:34:16.937663 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32902c-2531-4818-9800-0734ee026b10 admin admin] PATH_INFO: `/v3/projects/2715141f8ffd49d892600c779e02fa17` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:34:16.938920 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32902c-2531-4818-9800-0734ee026b10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2715141f8ffd49d892600c779e02fa17)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:34:16.941479 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32902c-2531-4818-9800-0734ee026b10 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:34:16.997187 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-ed32902c-2531-4818-9800-0734ee026b10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2715141f8ffd49d892600c779e02fa17', 'request_id': 'req-ed32902c-2531-4818-9800-0734ee026b10'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:17.005128 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-ed32902c-2531-4818-9800-0734ee026b10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2715141f8ffd49d892600c779e02fa17', 'request_id': 'req-ed32902c-2531-4818-9800-0734ee026b10'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:17.013704 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-ed32902c-2531-4818-9800-0734ee026b10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2715141f8ffd49d892600c779e02fa17', 'request_id': 'req-ed32902c-2531-4818-9800-0734ee026b10'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:17.026765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-ed32902c-2531-4818-9800-0734ee026b10 admin admin] The token cache is being invalidate because project 2715141f8ffd49d892600c779e02fa17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:34:17.027153 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-ed32902c-2531-4818-9800-0734ee026b10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:17.027872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-ed32902c-2531-4818-9800-0734ee026b10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:17.029539 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1368/2749] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:34:16 2022] DELETE /identity/v3/projects/2715141f8ffd49d892600c779e02fa17 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:34:17.033815 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84fbdf-7007-450d-a9ab-1af8a548f8b8 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:34:17.035460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8c84fbdf-7007-450d-a9ab-1af8a548f8b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:34:17.049619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84fbdf-7007-450d-a9ab-1af8a548f8b8 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:34:17.112750 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987406ee-9655-4ba1-a0b3-0d771c3dbeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:34:17.113617 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987406ee-9655-4ba1-a0b3-0d771c3dbeb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:34:17.113901 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987406ee-9655-4ba1-a0b3-0d771c3dbeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:34:17.114170 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987406ee-9655-4ba1-a0b3-0d771c3dbeb7 admin admin] PATH_INFO: `/v3/users/d9206adf107f4b9580b5b8ee7f18505f` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:34:17.115367 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987406ee-9655-4ba1-a0b3-0d771c3dbeb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9206adf107f4b9580b5b8ee7f18505f)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:34:17.117862 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987406ee-9655-4ba1-a0b3-0d771c3dbeb7 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:34:17.167954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-987406ee-9655-4ba1-a0b3-0d771c3dbeb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9206adf107f4b9580b5b8ee7f18505f'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:17.168642 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-987406ee-9655-4ba1-a0b3-0d771c3dbeb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9206adf107f4b9580b5b8ee7f18505f'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:17.175979 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-987406ee-9655-4ba1-a0b3-0d771c3dbeb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9206adf107f4b9580b5b8ee7f18505f'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:17.185195 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-987406ee-9655-4ba1-a0b3-0d771c3dbeb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9206adf107f4b9580b5b8ee7f18505f'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:17.199046 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-987406ee-9655-4ba1-a0b3-0d771c3dbeb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9206adf107f4b9580b5b8ee7f18505f'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:17.207274 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1382/2750] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:34:17 2022] DELETE /identity/v3/users/d9206adf107f4b9580b5b8ee7f18505f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:34:17.393693 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32902c-2531-4818-9800-0734ee026b10 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:34:17.396401 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-ed32902c-2531-4818-9800-0734ee026b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:34:17.411958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32902c-2531-4818-9800-0734ee026b10 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:34:17.480434 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c6f28-1e0e-4f3a-a037-ca48a6001b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:34:17.481355 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c6f28-1e0e-4f3a-a037-ca48a6001b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:34:17.481635 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c6f28-1e0e-4f3a-a037-ca48a6001b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:34:17.481917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c6f28-1e0e-4f3a-a037-ca48a6001b71 admin admin] PATH_INFO: `/v3/projects/e1fa8a2b2f064a62939e0a1c4a34f7cb` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:34:17.483922 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c6f28-1e0e-4f3a-a037-ca48a6001b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1fa8a2b2f064a62939e0a1c4a34f7cb)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:34:17.485959 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c6f28-1e0e-4f3a-a037-ca48a6001b71 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:34:17.533323 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-5e3c6f28-1e0e-4f3a-a037-ca48a6001b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1fa8a2b2f064a62939e0a1c4a34f7cb', 'request_id': 'req-5e3c6f28-1e0e-4f3a-a037-ca48a6001b71'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:17.539602 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-5e3c6f28-1e0e-4f3a-a037-ca48a6001b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1fa8a2b2f064a62939e0a1c4a34f7cb', 'request_id': 'req-5e3c6f28-1e0e-4f3a-a037-ca48a6001b71'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:17.547033 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-5e3c6f28-1e0e-4f3a-a037-ca48a6001b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1fa8a2b2f064a62939e0a1c4a34f7cb', 'request_id': 'req-5e3c6f28-1e0e-4f3a-a037-ca48a6001b71'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:17.559505 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-5e3c6f28-1e0e-4f3a-a037-ca48a6001b71 admin admin] The token cache is being invalidate because project e1fa8a2b2f064a62939e0a1c4a34f7cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:34:17.559799 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-5e3c6f28-1e0e-4f3a-a037-ca48a6001b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:17.560488 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-5e3c6f28-1e0e-4f3a-a037-ca48a6001b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:17.562050 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1369/2751] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:34:17 2022] DELETE /identity/v3/projects/e1fa8a2b2f064a62939e0a1c4a34f7cb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:34:38.643830 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934efeb-fc9a-4ded-b08c-b29d68dc7b5b None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:34:38.644330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934efeb-fc9a-4ded-b08c-b29d68dc7b5b None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:34:38.644455 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934efeb-fc9a-4ded-b08c-b29d68dc7b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:34:38.661370 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-8934efeb-fc9a-4ded-b08c-b29d68dc7b5b None None] MFA Rules not processed for user `38a56f3572874938ad4642fa34751a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:34:38.662561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8934efeb-fc9a-4ded-b08c-b29d68dc7b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:34:38.716091 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1383/2752] 10.222.0.71 () {58 vars in 967 bytes} [Mon May 16 20:34:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:34:38.757803 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c6f28-1e0e-4f3a-a037-ca48a6001b71 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:34:38.759255 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-5e3c6f28-1e0e-4f3a-a037-ca48a6001b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:34:38.827675 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c6f28-1e0e-4f3a-a037-ca48a6001b71 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:34:38.833156 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de49b0-38b7-41e0-a7a0-260ef928660a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e701cf55d13410aa259ec72578ed27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:34:38.833806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de49b0-38b7-41e0-a7a0-260ef928660a service swift] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:34:38.834085 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de49b0-38b7-41e0-a7a0-260ef928660a service swift] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:34:38.834360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de49b0-38b7-41e0-a7a0-260ef928660a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:34:38.843436 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de49b0-38b7-41e0-a7a0-260ef928660a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:34:38.845049 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de49b0-38b7-41e0-a7a0-260ef928660a service swift] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:34:38.853466 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1370/2753] 10.222.0.71 () {60 vars in 1384 bytes} [Mon May 16 20:34:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 20:34:45.379760 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934efeb-fc9a-4ded-b08c-b29d68dc7b5b None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:34:45.381469 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8934efeb-fc9a-4ded-b08c-b29d68dc7b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:34:45.468263 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934efeb-fc9a-4ded-b08c-b29d68dc7b5b None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:34:45.472704 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12c3d0-96f4-4f49-bcff-54c42127c475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:34:45.473559 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12c3d0-96f4-4f49-bcff-54c42127c475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:34:45.473842 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12c3d0-96f4-4f49-bcff-54c42127c475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:34:45.474117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12c3d0-96f4-4f49-bcff-54c42127c475 admin admin] PATH_INFO: `/v3/users/4834f6edcfdb4069be3c0eba58544ceb` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:34:45.475308 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12c3d0-96f4-4f49-bcff-54c42127c475 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4834f6edcfdb4069be3c0eba58544ceb)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:34:45.477540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12c3d0-96f4-4f49-bcff-54c42127c475 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:34:45.531452 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-6f12c3d0-96f4-4f49-bcff-54c42127c475 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4834f6edcfdb4069be3c0eba58544ceb'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:45.532097 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-6f12c3d0-96f4-4f49-bcff-54c42127c475 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4834f6edcfdb4069be3c0eba58544ceb'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:45.538703 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-6f12c3d0-96f4-4f49-bcff-54c42127c475 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4834f6edcfdb4069be3c0eba58544ceb'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:45.545971 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-6f12c3d0-96f4-4f49-bcff-54c42127c475 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4834f6edcfdb4069be3c0eba58544ceb'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:45.557873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-6f12c3d0-96f4-4f49-bcff-54c42127c475 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4834f6edcfdb4069be3c0eba58544ceb'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:45.563559 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1384/2754] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:34:45 2022] DELETE /identity/v3/users/4834f6edcfdb4069be3c0eba58544ceb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:34:45.733395 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de49b0-38b7-41e0-a7a0-260ef928660a service swift] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:34:45.745160 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de49b0-38b7-41e0-a7a0-260ef928660a service swift] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:34:45.804294 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79521c66-a45d-4bfc-a58f-82bea899abf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:34:45.805671 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79521c66-a45d-4bfc-a58f-82bea899abf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:34:45.805955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79521c66-a45d-4bfc-a58f-82bea899abf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:34:45.806232 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79521c66-a45d-4bfc-a58f-82bea899abf0 admin admin] PATH_INFO: `/v3/projects/4d18594086434fd19336bd76a7089437` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:34:45.807411 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79521c66-a45d-4bfc-a58f-82bea899abf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d18594086434fd19336bd76a7089437)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:34:45.809344 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79521c66-a45d-4bfc-a58f-82bea899abf0 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:34:45.853003 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-79521c66-a45d-4bfc-a58f-82bea899abf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d18594086434fd19336bd76a7089437', 'request_id': 'req-79521c66-a45d-4bfc-a58f-82bea899abf0'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:45.858189 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-79521c66-a45d-4bfc-a58f-82bea899abf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d18594086434fd19336bd76a7089437', 'request_id': 'req-79521c66-a45d-4bfc-a58f-82bea899abf0'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:45.864950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-79521c66-a45d-4bfc-a58f-82bea899abf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d18594086434fd19336bd76a7089437', 'request_id': 'req-79521c66-a45d-4bfc-a58f-82bea899abf0'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:45.876338 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-79521c66-a45d-4bfc-a58f-82bea899abf0 admin admin] The token cache is being invalidate because project 4d18594086434fd19336bd76a7089437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:34:45.876780 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-79521c66-a45d-4bfc-a58f-82bea899abf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:45.877398 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-79521c66-a45d-4bfc-a58f-82bea899abf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:45.878919 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1371/2755] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:34:45 2022] DELETE /identity/v3/projects/4d18594086434fd19336bd76a7089437 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:34:45.884075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12c3d0-96f4-4f49-bcff-54c42127c475 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:34:45.885561 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-6f12c3d0-96f4-4f49-bcff-54c42127c475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:34:45.898730 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12c3d0-96f4-4f49-bcff-54c42127c475 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:34:45.953633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5acbe3-8a85-45da-89dd-7ea6673139b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:34:45.954414 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5acbe3-8a85-45da-89dd-7ea6673139b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:34:45.954718 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5acbe3-8a85-45da-89dd-7ea6673139b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:34:45.954995 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5acbe3-8a85-45da-89dd-7ea6673139b0 admin admin] PATH_INFO: `/v3/users/d18beda274854cc7932cb18df8c51128` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:34:45.956196 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5acbe3-8a85-45da-89dd-7ea6673139b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d18beda274854cc7932cb18df8c51128)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:34:45.958150 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5acbe3-8a85-45da-89dd-7ea6673139b0 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:34:46.002231 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-2c5acbe3-8a85-45da-89dd-7ea6673139b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd18beda274854cc7932cb18df8c51128'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:46.002868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-2c5acbe3-8a85-45da-89dd-7ea6673139b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd18beda274854cc7932cb18df8c51128'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:46.009429 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-2c5acbe3-8a85-45da-89dd-7ea6673139b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd18beda274854cc7932cb18df8c51128'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:46.016594 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-2c5acbe3-8a85-45da-89dd-7ea6673139b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd18beda274854cc7932cb18df8c51128'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:46.028108 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-2c5acbe3-8a85-45da-89dd-7ea6673139b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd18beda274854cc7932cb18df8c51128'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:46.033832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1385/2756] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:34:45 2022] DELETE /identity/v3/users/d18beda274854cc7932cb18df8c51128 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:34:46.201164 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79521c66-a45d-4bfc-a58f-82bea899abf0 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:34:46.202659 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-79521c66-a45d-4bfc-a58f-82bea899abf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:34:46.215586 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79521c66-a45d-4bfc-a58f-82bea899abf0 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:34:46.273261 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19136dfc-8a28-47bb-850a-4904bbfc155c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:34:46.274601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19136dfc-8a28-47bb-850a-4904bbfc155c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:34:46.274884 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19136dfc-8a28-47bb-850a-4904bbfc155c admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:34:46.275158 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19136dfc-8a28-47bb-850a-4904bbfc155c admin admin] PATH_INFO: `/v3/projects/3004b24586f5476485acec7bb05b3c3f` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:34:46.276368 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19136dfc-8a28-47bb-850a-4904bbfc155c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3004b24586f5476485acec7bb05b3c3f)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:34:46.278248 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19136dfc-8a28-47bb-850a-4904bbfc155c admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:34:46.322472 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-19136dfc-8a28-47bb-850a-4904bbfc155c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3004b24586f5476485acec7bb05b3c3f', 'request_id': 'req-19136dfc-8a28-47bb-850a-4904bbfc155c'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:46.327644 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-19136dfc-8a28-47bb-850a-4904bbfc155c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3004b24586f5476485acec7bb05b3c3f', 'request_id': 'req-19136dfc-8a28-47bb-850a-4904bbfc155c'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:46.334440 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-19136dfc-8a28-47bb-850a-4904bbfc155c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3004b24586f5476485acec7bb05b3c3f', 'request_id': 'req-19136dfc-8a28-47bb-850a-4904bbfc155c'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:46.345435 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-19136dfc-8a28-47bb-850a-4904bbfc155c admin admin] The token cache is being invalidate because project 3004b24586f5476485acec7bb05b3c3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:34:46.346622 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-19136dfc-8a28-47bb-850a-4904bbfc155c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:46.347250 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-19136dfc-8a28-47bb-850a-4904bbfc155c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:34:46.348807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1372/2757] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:34:46 2022] DELETE /identity/v3/projects/3004b24586f5476485acec7bb05b3c3f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:35:07.454379 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82a81e-e44f-4e02-a80f-80fa0f0d898f None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:35:07.454972 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82a81e-e44f-4e02-a80f-80fa0f0d898f None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:35:07.454972 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82a81e-e44f-4e02-a80f-80fa0f0d898f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:35:07.473863 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-7f82a81e-e44f-4e02-a80f-80fa0f0d898f None None] MFA Rules not processed for user `bdeae37d6dfb4c0a95c6c9b07c2b5ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:35:07.475040 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-7f82a81e-e44f-4e02-a80f-80fa0f0d898f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:35:07.528161 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1386/2758] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:35:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:35:07.565184 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19136dfc-8a28-47bb-850a-4904bbfc155c admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:35:07.566563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-19136dfc-8a28-47bb-850a-4904bbfc155c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:35:07.623492 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19136dfc-8a28-47bb-850a-4904bbfc155c admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:35:07.626963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d81d7-9ba5-4de0-88bc-96c1f53da408 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62c3f9351a4181a4fc2930570171b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:35:07.627600 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d81d7-9ba5-4de0-88bc-96c1f53da408 service glance] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:35:07.627885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d81d7-9ba5-4de0-88bc-96c1f53da408 service glance] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:35:07.628171 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d81d7-9ba5-4de0-88bc-96c1f53da408 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:35:07.629896 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-331d81d7-9ba5-4de0-88bc-96c1f53da408 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:35:07.701371 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d81d7-9ba5-4de0-88bc-96c1f53da408 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:35:07.702798 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d81d7-9ba5-4de0-88bc-96c1f53da408 service glance] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:35:07.713483 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1373/2759] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:35:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:35:08.282435 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82a81e-e44f-4e02-a80f-80fa0f0d898f None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:35:08.283831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-7f82a81e-e44f-4e02-a80f-80fa0f0d898f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:35:08.340408 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82a81e-e44f-4e02-a80f-80fa0f0d898f None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:35:08.343913 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62664b49-870a-4467-8dc3-28b6026106d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:35:08.344575 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62664b49-870a-4467-8dc3-28b6026106d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:35:08.344851 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62664b49-870a-4467-8dc3-28b6026106d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:35:08.345119 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62664b49-870a-4467-8dc3-28b6026106d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:35:08.346868 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-62664b49-870a-4467-8dc3-28b6026106d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:35:08.360882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62664b49-870a-4467-8dc3-28b6026106d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:35:08.362319 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62664b49-870a-4467-8dc3-28b6026106d9 service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:35:08.373497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1387/2760] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:35:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:04.681945 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d81d7-9ba5-4de0-88bc-96c1f53da408 service glance] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:04.684514 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-331d81d7-9ba5-4de0-88bc-96c1f53da408 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:04.698380 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d81d7-9ba5-4de0-88bc-96c1f53da408 service glance] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:04.705356 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf6993-5df3-4de4-9cdb-370a76a9d819 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:04.706072 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf6993-5df3-4de4-9cdb-370a76a9d819 service nova] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:04.706367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf6993-5df3-4de4-9cdb-370a76a9d819 service nova] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:04.706644 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf6993-5df3-4de4-9cdb-370a76a9d819 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:04.708461 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-0ddf6993-5df3-4de4-9cdb-370a76a9d819 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:04.731656 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf6993-5df3-4de4-9cdb-370a76a9d819 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:04.733689 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf6993-5df3-4de4-9cdb-370a76a9d819 service nova] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:04.745717 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1374/2761] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:36:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:13.163239 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62664b49-870a-4467-8dc3-28b6026106d9 service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:13.164882 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-62664b49-870a-4467-8dc3-28b6026106d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:13.237664 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62664b49-870a-4467-8dc3-28b6026106d9 service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:13.242274 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a79862-11ba-4595-b719-0389e8802eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:13.243128 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a79862-11ba-4595-b719-0389e8802eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:13.243412 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a79862-11ba-4595-b719-0389e8802eed admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:13.243688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a79862-11ba-4595-b719-0389e8802eed admin admin] PATH_INFO: `/v3/users/bdeae37d6dfb4c0a95c6c9b07c2b5ad3` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:13.244894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a79862-11ba-4595-b719-0389e8802eed admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdeae37d6dfb4c0a95c6c9b07c2b5ad3)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:13.247748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a79862-11ba-4595-b719-0389e8802eed admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:13.294251 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e5a79862-11ba-4595-b719-0389e8802eed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdeae37d6dfb4c0a95c6c9b07c2b5ad3'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:13.294902 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e5a79862-11ba-4595-b719-0389e8802eed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdeae37d6dfb4c0a95c6c9b07c2b5ad3'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:13.301520 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e5a79862-11ba-4595-b719-0389e8802eed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdeae37d6dfb4c0a95c6c9b07c2b5ad3'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:13.308797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e5a79862-11ba-4595-b719-0389e8802eed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdeae37d6dfb4c0a95c6c9b07c2b5ad3'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:13.320377 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-e5a79862-11ba-4595-b719-0389e8802eed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdeae37d6dfb4c0a95c6c9b07c2b5ad3'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:13.326910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1388/2762] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:36:13 2022] DELETE /identity/v3/users/bdeae37d6dfb4c0a95c6c9b07c2b5ad3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:13.504984 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf6993-5df3-4de4-9cdb-370a76a9d819 service nova] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:13.517993 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf6993-5df3-4de4-9cdb-370a76a9d819 service nova] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:13.576543 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0309a1-aa7f-4302-9a44-3fbc82d1fdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:13.577480 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0309a1-aa7f-4302-9a44-3fbc82d1fdf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:13.577771 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0309a1-aa7f-4302-9a44-3fbc82d1fdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:13.578048 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0309a1-aa7f-4302-9a44-3fbc82d1fdf7 admin admin] PATH_INFO: `/v3/projects/2e74299322ca4cedabe873822eda95ae` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:13.579214 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0309a1-aa7f-4302-9a44-3fbc82d1fdf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e74299322ca4cedabe873822eda95ae)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:13.581156 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0309a1-aa7f-4302-9a44-3fbc82d1fdf7 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:13.624866 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-bc0309a1-aa7f-4302-9a44-3fbc82d1fdf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e74299322ca4cedabe873822eda95ae', 'request_id': 'req-bc0309a1-aa7f-4302-9a44-3fbc82d1fdf7'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:13.629935 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-bc0309a1-aa7f-4302-9a44-3fbc82d1fdf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e74299322ca4cedabe873822eda95ae', 'request_id': 'req-bc0309a1-aa7f-4302-9a44-3fbc82d1fdf7'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:13.636763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-bc0309a1-aa7f-4302-9a44-3fbc82d1fdf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e74299322ca4cedabe873822eda95ae', 'request_id': 'req-bc0309a1-aa7f-4302-9a44-3fbc82d1fdf7'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:13.647262 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-bc0309a1-aa7f-4302-9a44-3fbc82d1fdf7 admin admin] The token cache is being invalidate because project 2e74299322ca4cedabe873822eda95ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:36:13.647541 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-bc0309a1-aa7f-4302-9a44-3fbc82d1fdf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:13.648169 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-bc0309a1-aa7f-4302-9a44-3fbc82d1fdf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:13.649690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1375/2763] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:36:13 2022] DELETE /identity/v3/projects/2e74299322ca4cedabe873822eda95ae => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:13.654840 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71085494-d690-4993-8d15-393ae6080ebc None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:13.655117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71085494-d690-4993-8d15-393ae6080ebc None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:13.655390 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71085494-d690-4993-8d15-393ae6080ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:13.672748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-71085494-d690-4993-8d15-393ae6080ebc None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:13.673832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-71085494-d690-4993-8d15-393ae6080ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:13.731123 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1389/2764] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:13.738782 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b9e72-5fc5-4b63-a300-5f32f785de6c None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:13.739102 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b9e72-5fc5-4b63-a300-5f32f785de6c None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:13.739383 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b9e72-5fc5-4b63-a300-5f32f785de6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:13.758485 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-908b9e72-5fc5-4b63-a300-5f32f785de6c None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:13.759666 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-908b9e72-5fc5-4b63-a300-5f32f785de6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:13.768402 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1376/2765] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:13.772711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71085494-d690-4993-8d15-393ae6080ebc None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:13.782541 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71085494-d690-4993-8d15-393ae6080ebc None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:13.786965 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1213a0-e1b2-4a48-89ff-111cb573d701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:13.787602 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1213a0-e1b2-4a48-89ff-111cb573d701 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:13.787880 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1213a0-e1b2-4a48-89ff-111cb573d701 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:13.788176 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1213a0-e1b2-4a48-89ff-111cb573d701 admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:13.788890 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1213a0-e1b2-4a48-89ff-111cb573d701 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:36:13.789191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1213a0-e1b2-4a48-89ff-111cb573d701 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:13.790776 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1213a0-e1b2-4a48-89ff-111cb573d701 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:13.801795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1390/2766] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:36:13.805938 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b9e72-5fc5-4b63-a300-5f32f785de6c None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:13.815101 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b9e72-5fc5-4b63-a300-5f32f785de6c None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:13.819638 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5292f-5589-45c7-bf4b-3542475e08da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:13.820310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5292f-5589-45c7-bf4b-3542475e08da admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:13.820599 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5292f-5589-45c7-bf4b-3542475e08da admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:13.820878 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5292f-5589-45c7-bf4b-3542475e08da admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:13.821565 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5292f-5589-45c7-bf4b-3542475e08da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:13.823444 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5292f-5589-45c7-bf4b-3542475e08da admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:13.849045 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1377/2767] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:36:13 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:13.853095 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1213a0-e1b2-4a48-89ff-111cb573d701 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:13.862734 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1213a0-e1b2-4a48-89ff-111cb573d701 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:13.917784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789a726-c4a6-4aa1-a98d-83c2b8d4e0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:13.918430 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789a726-c4a6-4aa1-a98d-83c2b8d4e0ea admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:13.918706 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789a726-c4a6-4aa1-a98d-83c2b8d4e0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:13.918976 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789a726-c4a6-4aa1-a98d-83c2b8d4e0ea admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:13.919646 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789a726-c4a6-4aa1-a98d-83c2b8d4e0ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:13.921603 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789a726-c4a6-4aa1-a98d-83c2b8d4e0ea admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:13.941068 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1391/2768] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:36:13 2022] POST /identity/v3/users => generated 285 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:36:13.945061 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5292f-5589-45c7-bf4b-3542475e08da admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:13.955651 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5292f-5589-45c7-bf4b-3542475e08da admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:13.960194 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df952713-7b7e-4203-a483-a96011c99184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:13.960844 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df952713-7b7e-4203-a483-a96011c99184 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:13.961129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df952713-7b7e-4203-a483-a96011c99184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:13.961400 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df952713-7b7e-4203-a483-a96011c99184 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:13.962111 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df952713-7b7e-4203-a483-a96011c99184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:13.963674 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df952713-7b7e-4203-a483-a96011c99184 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:13.973643 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1378/2769] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:13.977317 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789a726-c4a6-4aa1-a98d-83c2b8d4e0ea admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:13.986829 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789a726-c4a6-4aa1-a98d-83c2b8d4e0ea admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:13.991338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80fa74-7a70-4b87-b92e-039a644acd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:13.991970 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80fa74-7a70-4b87-b92e-039a644acd97 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:13.992277 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80fa74-7a70-4b87-b92e-039a644acd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:13.992551 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80fa74-7a70-4b87-b92e-039a644acd97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:13.993263 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80fa74-7a70-4b87-b92e-039a644acd97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:13.994831 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80fa74-7a70-4b87-b92e-039a644acd97 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:14.004906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1392/2770] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:14.008717 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df952713-7b7e-4203-a483-a96011c99184 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:14.019499 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df952713-7b7e-4203-a483-a96011c99184 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:14.024444 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e996ec-63ee-447c-832d-3bc72ae684c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:14.025324 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e996ec-63ee-447c-832d-3bc72ae684c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:14.025609 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e996ec-63ee-447c-832d-3bc72ae684c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:14.025889 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e996ec-63ee-447c-832d-3bc72ae684c5 admin admin] PATH_INFO: `/v3/projects/1c85b48362574836809d9ab9a8171175/users/07946279c3f5416cae0ca39c3572ba97/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:14.040488 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e996ec-63ee-447c-832d-3bc72ae684c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c85b48362574836809d9ab9a8171175, user_id=07946279c3f5416cae0ca39c3572ba97, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:14.043219 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e996ec-63ee-447c-832d-3bc72ae684c5 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:14.055478 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1379/2771] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:36:14 2022] PUT /identity/v3/projects/1c85b48362574836809d9ab9a8171175/users/07946279c3f5416cae0ca39c3572ba97/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:14.066201 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f17e0b-bad6-416a-8915-e52f46c3fefa None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:14.066484 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f17e0b-bad6-416a-8915-e52f46c3fefa None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:14.066762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f17e0b-bad6-416a-8915-e52f46c3fefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:14.093383 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-48f17e0b-bad6-416a-8915-e52f46c3fefa None None] MFA Rules not processed for user `07946279c3f5416cae0ca39c3572ba97`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:14.094560 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-48f17e0b-bad6-416a-8915-e52f46c3fefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:14.155220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1393/2772] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:14.166124 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e996ec-63ee-447c-832d-3bc72ae684c5 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:14.167913 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-38e996ec-63ee-447c-832d-3bc72ae684c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:14.239448 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e996ec-63ee-447c-832d-3bc72ae684c5 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:14.245116 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbfe40-035b-4556-86f3-a8132a9865d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:14.246303 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbfe40-035b-4556-86f3-a8132a9865d0 service nova] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:14.246804 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbfe40-035b-4556-86f3-a8132a9865d0 service nova] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:14.247088 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbfe40-035b-4556-86f3-a8132a9865d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:14.257041 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbfe40-035b-4556-86f3-a8132a9865d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:14.258627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbfe40-035b-4556-86f3-a8132a9865d0 service nova] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:14.268450 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1380/2773] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:36:14 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:16.905716 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f17e0b-bad6-416a-8915-e52f46c3fefa None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:16.963654 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f17e0b-bad6-416a-8915-e52f46c3fefa None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:16.969224 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13235e0-82e6-486e-98a0-dc1ff8b3669b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:16.970075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13235e0-82e6-486e-98a0-dc1ff8b3669b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:16.970354 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13235e0-82e6-486e-98a0-dc1ff8b3669b admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:16.970627 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13235e0-82e6-486e-98a0-dc1ff8b3669b admin admin] PATH_INFO: `/v3/users/07946279c3f5416cae0ca39c3572ba97` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:16.971801 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13235e0-82e6-486e-98a0-dc1ff8b3669b admin admin] RBAC: Authorizing `identity:delete_user(user_id=07946279c3f5416cae0ca39c3572ba97)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:16.973756 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13235e0-82e6-486e-98a0-dc1ff8b3669b admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:17.020282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b13235e0-82e6-486e-98a0-dc1ff8b3669b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07946279c3f5416cae0ca39c3572ba97'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:17.020926 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b13235e0-82e6-486e-98a0-dc1ff8b3669b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07946279c3f5416cae0ca39c3572ba97'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:17.028018 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b13235e0-82e6-486e-98a0-dc1ff8b3669b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07946279c3f5416cae0ca39c3572ba97'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:17.034342 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b13235e0-82e6-486e-98a0-dc1ff8b3669b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07946279c3f5416cae0ca39c3572ba97'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:17.045796 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b13235e0-82e6-486e-98a0-dc1ff8b3669b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07946279c3f5416cae0ca39c3572ba97'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:17.051516 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1394/2774] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:36:16 2022] DELETE /identity/v3/users/07946279c3f5416cae0ca39c3572ba97 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:17.056111 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af051b17-c543-40bb-83f5-367e774f302d None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:17.056617 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af051b17-c543-40bb-83f5-367e774f302d None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:17.056718 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af051b17-c543-40bb-83f5-367e774f302d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:17.075398 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-af051b17-c543-40bb-83f5-367e774f302d None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:17.076624 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-af051b17-c543-40bb-83f5-367e774f302d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:17.134021 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1381/2775] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:17.144807 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13235e0-82e6-486e-98a0-dc1ff8b3669b admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:17.146200 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-b13235e0-82e6-486e-98a0-dc1ff8b3669b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:17.203263 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13235e0-82e6-486e-98a0-dc1ff8b3669b admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:17.208256 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b7828-5243-47f4-b99e-036d2ae0457f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:17.208903 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b7828-5243-47f4-b99e-036d2ae0457f service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:17.209180 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b7828-5243-47f4-b99e-036d2ae0457f service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:17.209452 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b7828-5243-47f4-b99e-036d2ae0457f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:17.218859 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b7828-5243-47f4-b99e-036d2ae0457f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:17.220321 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b7828-5243-47f4-b99e-036d2ae0457f service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:17.229409 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1395/2776] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:36:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:17.492564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af051b17-c543-40bb-83f5-367e774f302d None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:17.494042 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-af051b17-c543-40bb-83f5-367e774f302d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:17.507784 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af051b17-c543-40bb-83f5-367e774f302d None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:17.513264 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fccaee-6763-4444-9719-faa97fd72e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:17.514621 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fccaee-6763-4444-9719-faa97fd72e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:17.514621 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fccaee-6763-4444-9719-faa97fd72e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:17.514873 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fccaee-6763-4444-9719-faa97fd72e0a admin admin] PATH_INFO: `/v3/projects/1c85b48362574836809d9ab9a8171175` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:17.515889 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fccaee-6763-4444-9719-faa97fd72e0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c85b48362574836809d9ab9a8171175)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:17.517830 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fccaee-6763-4444-9719-faa97fd72e0a admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:17.564659 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-82fccaee-6763-4444-9719-faa97fd72e0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c85b48362574836809d9ab9a8171175', 'request_id': 'req-82fccaee-6763-4444-9719-faa97fd72e0a'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:17.569823 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-82fccaee-6763-4444-9719-faa97fd72e0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c85b48362574836809d9ab9a8171175', 'request_id': 'req-82fccaee-6763-4444-9719-faa97fd72e0a'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:17.577458 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-82fccaee-6763-4444-9719-faa97fd72e0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c85b48362574836809d9ab9a8171175', 'request_id': 'req-82fccaee-6763-4444-9719-faa97fd72e0a'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:17.587992 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-82fccaee-6763-4444-9719-faa97fd72e0a admin admin] The token cache is being invalidate because project 1c85b48362574836809d9ab9a8171175 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:36:17.588310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-82fccaee-6763-4444-9719-faa97fd72e0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:17.588954 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-82fccaee-6763-4444-9719-faa97fd72e0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:17.591036 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1382/2777] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:36:17 2022] DELETE /identity/v3/projects/1c85b48362574836809d9ab9a8171175 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:17.595906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37d2c5-5e6a-431f-bdc2-3678f6b721f6 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:17.596234 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37d2c5-5e6a-431f-bdc2-3678f6b721f6 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:17.596511 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37d2c5-5e6a-431f-bdc2-3678f6b721f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:17.614238 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-9d37d2c5-5e6a-431f-bdc2-3678f6b721f6 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:17.615404 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-9d37d2c5-5e6a-431f-bdc2-3678f6b721f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:17.673670 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1396/2778] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:36:17.682538 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af68c2-966b-4ad8-8751-7e2764163a9e None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:17.682859 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af68c2-966b-4ad8-8751-7e2764163a9e None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:17.683291 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af68c2-966b-4ad8-8751-7e2764163a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:17.701870 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-e8af68c2-966b-4ad8-8751-7e2764163a9e None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:17.703058 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-e8af68c2-966b-4ad8-8751-7e2764163a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:17.710881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1383/2779] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:17.715797 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37d2c5-5e6a-431f-bdc2-3678f6b721f6 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:17.725241 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37d2c5-5e6a-431f-bdc2-3678f6b721f6 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:17.729697 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323f785-9cbc-40ea-abc4-903ebaf17326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:17.730527 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323f785-9cbc-40ea-abc4-903ebaf17326 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:17.730803 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323f785-9cbc-40ea-abc4-903ebaf17326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:17.731075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323f785-9cbc-40ea-abc4-903ebaf17326 admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:17.731790 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323f785-9cbc-40ea-abc4-903ebaf17326 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:36:17.732091 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323f785-9cbc-40ea-abc4-903ebaf17326 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:17.733696 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323f785-9cbc-40ea-abc4-903ebaf17326 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:17.745012 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1397/2780] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 20:36:17.749881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af68c2-966b-4ad8-8751-7e2764163a9e None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:17.758740 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af68c2-966b-4ad8-8751-7e2764163a9e None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:17.763982 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2aba8-273b-4096-b0aa-74b652075e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:17.764660 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2aba8-273b-4096-b0aa-74b652075e9e admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:17.764943 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2aba8-273b-4096-b0aa-74b652075e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:17.765217 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2aba8-273b-4096-b0aa-74b652075e9e admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:17.765894 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2aba8-273b-4096-b0aa-74b652075e9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:17.767765 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2aba8-273b-4096-b0aa-74b652075e9e admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:17.793019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1384/2781] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:36:17 2022] POST /identity/v3/projects => generated 403 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:17.797183 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323f785-9cbc-40ea-abc4-903ebaf17326 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:17.807126 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323f785-9cbc-40ea-abc4-903ebaf17326 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:17.862000 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e99ab7-9d16-4a78-9d3b-11c825c3ba05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:17.862664 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e99ab7-9d16-4a78-9d3b-11c825c3ba05 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:17.862945 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e99ab7-9d16-4a78-9d3b-11c825c3ba05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:17.863220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e99ab7-9d16-4a78-9d3b-11c825c3ba05 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:17.863911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e99ab7-9d16-4a78-9d3b-11c825c3ba05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:17.865859 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e99ab7-9d16-4a78-9d3b-11c825c3ba05 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:17.886009 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1398/2782] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:36:17 2022] POST /identity/v3/users => generated 302 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:36:17.890737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2aba8-273b-4096-b0aa-74b652075e9e admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:17.900976 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2aba8-273b-4096-b0aa-74b652075e9e admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:17.905946 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3464b9-c1bf-4ad6-949a-e7dd85c76a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:17.906596 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3464b9-c1bf-4ad6-949a-e7dd85c76a17 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:17.906880 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3464b9-c1bf-4ad6-949a-e7dd85c76a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:17.907156 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3464b9-c1bf-4ad6-949a-e7dd85c76a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:17.907875 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3464b9-c1bf-4ad6-949a-e7dd85c76a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:17.909843 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3464b9-c1bf-4ad6-949a-e7dd85c76a17 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:17.920241 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1385/2783] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:17.924104 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e99ab7-9d16-4a78-9d3b-11c825c3ba05 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:17.934699 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e99ab7-9d16-4a78-9d3b-11c825c3ba05 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:17.939355 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afa6b0-f480-43b0-82f2-51a4865ce091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:17.939999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afa6b0-f480-43b0-82f2-51a4865ce091 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:17.940321 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afa6b0-f480-43b0-82f2-51a4865ce091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:17.940598 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afa6b0-f480-43b0-82f2-51a4865ce091 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:17.941318 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afa6b0-f480-43b0-82f2-51a4865ce091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:17.942909 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afa6b0-f480-43b0-82f2-51a4865ce091 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:17.953659 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1399/2784] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:17.957742 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3464b9-c1bf-4ad6-949a-e7dd85c76a17 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:17.967764 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3464b9-c1bf-4ad6-949a-e7dd85c76a17 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:17.972297 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de38ef9-661a-446e-8541-e3da352d7606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:17.973155 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de38ef9-661a-446e-8541-e3da352d7606 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:17.973431 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de38ef9-661a-446e-8541-e3da352d7606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:17.973697 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de38ef9-661a-446e-8541-e3da352d7606 admin admin] PATH_INFO: `/v3/projects/f7e2647aed534feab7c34c584bc10feb/users/4062c9fd1fcc4d6ca0218548d9b57f8c/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:17.987592 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de38ef9-661a-446e-8541-e3da352d7606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7e2647aed534feab7c34c584bc10feb, user_id=4062c9fd1fcc4d6ca0218548d9b57f8c, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:17.990238 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de38ef9-661a-446e-8541-e3da352d7606 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:18.003517 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1386/2785] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:36:17 2022] PUT /identity/v3/projects/f7e2647aed534feab7c34c584bc10feb/users/4062c9fd1fcc4d6ca0218548d9b57f8c/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:18.014573 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561dff1-2cd9-4cb8-a8b0-956752603faa None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:18.014867 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561dff1-2cd9-4cb8-a8b0-956752603faa None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:18.015147 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561dff1-2cd9-4cb8-a8b0-956752603faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:18.041833 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-3561dff1-2cd9-4cb8-a8b0-956752603faa None None] MFA Rules not processed for user `4062c9fd1fcc4d6ca0218548d9b57f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:18.044055 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-3561dff1-2cd9-4cb8-a8b0-956752603faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:18.107667 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1400/2786] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:36:18.112310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de38ef9-661a-446e-8541-e3da352d7606 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:18.176370 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de38ef9-661a-446e-8541-e3da352d7606 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:18.180936 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a9e50-602e-4f3a-bf3e-599571aba092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:18.181589 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a9e50-602e-4f3a-bf3e-599571aba092 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:18.181872 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a9e50-602e-4f3a-bf3e-599571aba092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:18.182147 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a9e50-602e-4f3a-bf3e-599571aba092 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:18.182837 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a9e50-602e-4f3a-bf3e-599571aba092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:18.185361 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a9e50-602e-4f3a-bf3e-599571aba092 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:18.210360 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1387/2787] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:36:18 2022] POST /identity/v3/projects => generated 405 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:18.214086 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561dff1-2cd9-4cb8-a8b0-956752603faa None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:18.224457 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561dff1-2cd9-4cb8-a8b0-956752603faa None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:18.279335 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702f91c-74b0-4ffe-a3ea-17df1b688a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:18.279990 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702f91c-74b0-4ffe-a3ea-17df1b688a9c admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:18.280304 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702f91c-74b0-4ffe-a3ea-17df1b688a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:18.280578 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702f91c-74b0-4ffe-a3ea-17df1b688a9c admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:18.281264 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702f91c-74b0-4ffe-a3ea-17df1b688a9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:18.283166 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702f91c-74b0-4ffe-a3ea-17df1b688a9c admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:18.302703 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1401/2788] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:36:18 2022] POST /identity/v3/users => generated 309 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:36:18.306661 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a9e50-602e-4f3a-bf3e-599571aba092 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:18.317358 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a9e50-602e-4f3a-bf3e-599571aba092 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:18.321920 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb76d61-86be-4d8b-aba9-4fca3b28566c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:18.322575 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb76d61-86be-4d8b-aba9-4fca3b28566c admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:18.322857 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb76d61-86be-4d8b-aba9-4fca3b28566c admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:18.323141 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb76d61-86be-4d8b-aba9-4fca3b28566c admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:18.323969 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb76d61-86be-4d8b-aba9-4fca3b28566c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:18.325594 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb76d61-86be-4d8b-aba9-4fca3b28566c admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:18.335794 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1388/2789] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:18.339675 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702f91c-74b0-4ffe-a3ea-17df1b688a9c admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:18.349225 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702f91c-74b0-4ffe-a3ea-17df1b688a9c admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:18.353828 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b8898-cee4-4b58-b4a1-5295b0f4e597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:18.354688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b8898-cee4-4b58-b4a1-5295b0f4e597 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:18.355501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b8898-cee4-4b58-b4a1-5295b0f4e597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:18.355773 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b8898-cee4-4b58-b4a1-5295b0f4e597 admin admin] PATH_INFO: `/v3/projects/22c0eddce5c042b98741dd7e78cefa34/users/b863ba97e85043fda578eda2aa503f69/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:18.369895 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b8898-cee4-4b58-b4a1-5295b0f4e597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c0eddce5c042b98741dd7e78cefa34, user_id=b863ba97e85043fda578eda2aa503f69, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:18.373284 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b8898-cee4-4b58-b4a1-5295b0f4e597 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:18.385562 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1402/2790] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:36:18 2022] PUT /identity/v3/projects/22c0eddce5c042b98741dd7e78cefa34/users/b863ba97e85043fda578eda2aa503f69/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:36:18.389625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb76d61-86be-4d8b-aba9-4fca3b28566c admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:18.399797 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb76d61-86be-4d8b-aba9-4fca3b28566c admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:18.453626 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf82a3-1b22-471a-9dc6-aa3f6a5ed358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:18.454321 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf82a3-1b22-471a-9dc6-aa3f6a5ed358 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:18.454558 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf82a3-1b22-471a-9dc6-aa3f6a5ed358 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:18.454779 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf82a3-1b22-471a-9dc6-aa3f6a5ed358 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:18.455576 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf82a3-1b22-471a-9dc6-aa3f6a5ed358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:18.457155 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf82a3-1b22-471a-9dc6-aa3f6a5ed358 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:18.467310 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1389/2791] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:18.471389 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b8898-cee4-4b58-b4a1-5295b0f4e597 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:18.481901 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b8898-cee4-4b58-b4a1-5295b0f4e597 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:18.486499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7522f9-cd6d-4702-bb95-12a3798cd35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:18.487365 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7522f9-cd6d-4702-bb95-12a3798cd35f admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:18.487643 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7522f9-cd6d-4702-bb95-12a3798cd35f admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:18.487915 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7522f9-cd6d-4702-bb95-12a3798cd35f admin admin] PATH_INFO: `/v3/projects/22c0eddce5c042b98741dd7e78cefa34/users/b863ba97e85043fda578eda2aa503f69/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:18.489870 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7522f9-cd6d-4702-bb95-12a3798cd35f admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c0eddce5c042b98741dd7e78cefa34, user_id=b863ba97e85043fda578eda2aa503f69, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:18.492538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7522f9-cd6d-4702-bb95-12a3798cd35f admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:18.502625 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1403/2792] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:36:18 2022] PUT /identity/v3/projects/22c0eddce5c042b98741dd7e78cefa34/users/b863ba97e85043fda578eda2aa503f69/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:18.512414 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d11a24-5ecb-4b5b-a225-33d0e8b16477 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:18.512704 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d11a24-5ecb-4b5b-a225-33d0e8b16477 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:18.512981 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d11a24-5ecb-4b5b-a225-33d0e8b16477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:18.538537 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-27d11a24-5ecb-4b5b-a225-33d0e8b16477 None None] MFA Rules not processed for user `b863ba97e85043fda578eda2aa503f69`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:18.539717 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-27d11a24-5ecb-4b5b-a225-33d0e8b16477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:18.603269 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1390/2793] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:18 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:18.614391 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7522f9-cd6d-4702-bb95-12a3798cd35f admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:18.616083 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-cf7522f9-cd6d-4702-bb95-12a3798cd35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:18.671111 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7522f9-cd6d-4702-bb95-12a3798cd35f admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:18.674721 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3b032-75e2-4a96-a158-1a5f5b476c84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:18.675347 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3b032-75e2-4a96-a158-1a5f5b476c84 service cinder] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:18.675626 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3b032-75e2-4a96-a158-1a5f5b476c84 service cinder] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:18.675899 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3b032-75e2-4a96-a158-1a5f5b476c84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:18.684926 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3b032-75e2-4a96-a158-1a5f5b476c84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:18.686352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3b032-75e2-4a96-a158-1a5f5b476c84 service cinder] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:18.695433 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1404/2794] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:36:18 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:18.824757 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d11a24-5ecb-4b5b-a225-33d0e8b16477 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:18.882677 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d11a24-5ecb-4b5b-a225-33d0e8b16477 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:18.887651 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdba94-167f-4c04-a781-566b7637570b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:18.888529 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdba94-167f-4c04-a781-566b7637570b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:18.888810 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdba94-167f-4c04-a781-566b7637570b admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:18.889084 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdba94-167f-4c04-a781-566b7637570b admin admin] PATH_INFO: `/v3/users/4062c9fd1fcc4d6ca0218548d9b57f8c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:18.890243 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdba94-167f-4c04-a781-566b7637570b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4062c9fd1fcc4d6ca0218548d9b57f8c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:18.892127 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdba94-167f-4c04-a781-566b7637570b admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:18.935127 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-50fdba94-167f-4c04-a781-566b7637570b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4062c9fd1fcc4d6ca0218548d9b57f8c'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:18.946026 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-50fdba94-167f-4c04-a781-566b7637570b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4062c9fd1fcc4d6ca0218548d9b57f8c'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:18.952965 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-50fdba94-167f-4c04-a781-566b7637570b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4062c9fd1fcc4d6ca0218548d9b57f8c'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:18.953617 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-50fdba94-167f-4c04-a781-566b7637570b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4062c9fd1fcc4d6ca0218548d9b57f8c'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:18.960573 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-50fdba94-167f-4c04-a781-566b7637570b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4062c9fd1fcc4d6ca0218548d9b57f8c'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:18.966938 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1391/2795] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:36:18 2022] DELETE /identity/v3/users/4062c9fd1fcc4d6ca0218548d9b57f8c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:18.971434 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff0191-9575-458f-bc73-1e8535cc3d26 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:18.971887 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff0191-9575-458f-bc73-1e8535cc3d26 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:18.971983 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff0191-9575-458f-bc73-1e8535cc3d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:18.988981 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-0eff0191-9575-458f-bc73-1e8535cc3d26 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:18.990152 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-0eff0191-9575-458f-bc73-1e8535cc3d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:19.046453 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1405/2796] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:19.056009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdba94-167f-4c04-a781-566b7637570b admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:19.057473 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-50fdba94-167f-4c04-a781-566b7637570b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:19.114351 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdba94-167f-4c04-a781-566b7637570b admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:19.118086 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cf08f-741e-4406-86c6-7179470e0054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:19.118736 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cf08f-741e-4406-86c6-7179470e0054 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:19.119019 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cf08f-741e-4406-86c6-7179470e0054 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:19.119293 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cf08f-741e-4406-86c6-7179470e0054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:19.128372 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cf08f-741e-4406-86c6-7179470e0054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:19.129861 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cf08f-741e-4406-86c6-7179470e0054 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:19.139564 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1392/2797] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:36:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:19.401358 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff0191-9575-458f-bc73-1e8535cc3d26 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:19.402992 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-0eff0191-9575-458f-bc73-1e8535cc3d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:19.417526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff0191-9575-458f-bc73-1e8535cc3d26 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:19.422639 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8edd2f-c291-4921-9d25-da28dfa62064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:19.423540 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8edd2f-c291-4921-9d25-da28dfa62064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:19.423820 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8edd2f-c291-4921-9d25-da28dfa62064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:19.424091 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8edd2f-c291-4921-9d25-da28dfa62064 admin admin] PATH_INFO: `/v3/projects/f7e2647aed534feab7c34c584bc10feb` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:19.425288 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8edd2f-c291-4921-9d25-da28dfa62064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7e2647aed534feab7c34c584bc10feb)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:19.427191 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8edd2f-c291-4921-9d25-da28dfa62064 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:19.472266 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8d8edd2f-c291-4921-9d25-da28dfa62064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7e2647aed534feab7c34c584bc10feb', 'request_id': 'req-8d8edd2f-c291-4921-9d25-da28dfa62064'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:19.478859 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8d8edd2f-c291-4921-9d25-da28dfa62064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7e2647aed534feab7c34c584bc10feb', 'request_id': 'req-8d8edd2f-c291-4921-9d25-da28dfa62064'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:19.484922 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8d8edd2f-c291-4921-9d25-da28dfa62064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7e2647aed534feab7c34c584bc10feb', 'request_id': 'req-8d8edd2f-c291-4921-9d25-da28dfa62064'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:19.494783 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8d8edd2f-c291-4921-9d25-da28dfa62064 admin admin] The token cache is being invalidate because project f7e2647aed534feab7c34c584bc10feb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:36:19.495070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8d8edd2f-c291-4921-9d25-da28dfa62064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:19.496260 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-8d8edd2f-c291-4921-9d25-da28dfa62064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:19.497795 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1406/2798] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:36:19 2022] DELETE /identity/v3/projects/f7e2647aed534feab7c34c584bc10feb => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:19.501733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cf08f-741e-4406-86c6-7179470e0054 service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:19.511093 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cf08f-741e-4406-86c6-7179470e0054 service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:19.566548 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998da50-15bf-4cd2-8266-eaa3e4f84cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:19.567420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998da50-15bf-4cd2-8266-eaa3e4f84cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:19.567703 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998da50-15bf-4cd2-8266-eaa3e4f84cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:19.567985 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998da50-15bf-4cd2-8266-eaa3e4f84cbf admin admin] PATH_INFO: `/v3/users/b863ba97e85043fda578eda2aa503f69` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:19.569180 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998da50-15bf-4cd2-8266-eaa3e4f84cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b863ba97e85043fda578eda2aa503f69)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:19.571091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998da50-15bf-4cd2-8266-eaa3e4f84cbf admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:19.614347 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f998da50-15bf-4cd2-8266-eaa3e4f84cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b863ba97e85043fda578eda2aa503f69'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:19.626007 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f998da50-15bf-4cd2-8266-eaa3e4f84cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b863ba97e85043fda578eda2aa503f69'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:19.632386 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f998da50-15bf-4cd2-8266-eaa3e4f84cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b863ba97e85043fda578eda2aa503f69'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:19.633043 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f998da50-15bf-4cd2-8266-eaa3e4f84cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b863ba97e85043fda578eda2aa503f69'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:19.640497 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-f998da50-15bf-4cd2-8266-eaa3e4f84cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b863ba97e85043fda578eda2aa503f69'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:19.646127 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1393/2799] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:36:19 2022] DELETE /identity/v3/users/b863ba97e85043fda578eda2aa503f69 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:19.908555 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8edd2f-c291-4921-9d25-da28dfa62064 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:19.910174 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-8d8edd2f-c291-4921-9d25-da28dfa62064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:19.924250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8edd2f-c291-4921-9d25-da28dfa62064 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:19.980012 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99892f04-1ad5-4350-adf7-009ca32c1c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:19.981059 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99892f04-1ad5-4350-adf7-009ca32c1c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:19.981340 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99892f04-1ad5-4350-adf7-009ca32c1c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:19.981612 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99892f04-1ad5-4350-adf7-009ca32c1c69 admin admin] PATH_INFO: `/v3/projects/22c0eddce5c042b98741dd7e78cefa34` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:19.982778 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99892f04-1ad5-4350-adf7-009ca32c1c69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c0eddce5c042b98741dd7e78cefa34)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:19.984722 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99892f04-1ad5-4350-adf7-009ca32c1c69 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:20.029016 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-99892f04-1ad5-4350-adf7-009ca32c1c69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c0eddce5c042b98741dd7e78cefa34', 'request_id': 'req-99892f04-1ad5-4350-adf7-009ca32c1c69'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:20.036352 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-99892f04-1ad5-4350-adf7-009ca32c1c69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c0eddce5c042b98741dd7e78cefa34', 'request_id': 'req-99892f04-1ad5-4350-adf7-009ca32c1c69'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:20.042478 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-99892f04-1ad5-4350-adf7-009ca32c1c69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c0eddce5c042b98741dd7e78cefa34', 'request_id': 'req-99892f04-1ad5-4350-adf7-009ca32c1c69'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:20.052452 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-99892f04-1ad5-4350-adf7-009ca32c1c69 admin admin] The token cache is being invalidate because project 22c0eddce5c042b98741dd7e78cefa34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:36:20.052731 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-99892f04-1ad5-4350-adf7-009ca32c1c69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:20.053373 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-99892f04-1ad5-4350-adf7-009ca32c1c69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:20.054920 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1407/2800] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:36:19 2022] DELETE /identity/v3/projects/22c0eddce5c042b98741dd7e78cefa34 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:20.060336 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3cd7a-cd97-4a0a-9050-e0d235771d5f None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:20.060631 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3cd7a-cd97-4a0a-9050-e0d235771d5f None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:20.060988 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3cd7a-cd97-4a0a-9050-e0d235771d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:20.078654 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-31b3cd7a-cd97-4a0a-9050-e0d235771d5f None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:20.080025 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-31b3cd7a-cd97-4a0a-9050-e0d235771d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:20.141687 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1394/2801] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:20.150858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c422d63-cb53-4df1-92f8-5475d7ab8839 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:20.151150 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c422d63-cb53-4df1-92f8-5475d7ab8839 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:20.151432 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c422d63-cb53-4df1-92f8-5475d7ab8839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:20.170391 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-4c422d63-cb53-4df1-92f8-5475d7ab8839 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:20.171947 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-4c422d63-cb53-4df1-92f8-5475d7ab8839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:20.179594 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1408/2802] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:20.184454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3cd7a-cd97-4a0a-9050-e0d235771d5f None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:20.194174 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3cd7a-cd97-4a0a-9050-e0d235771d5f None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:20.199986 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2083a-b576-400e-9542-fc69473abf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:20.200687 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2083a-b576-400e-9542-fc69473abf24 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:20.201005 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2083a-b576-400e-9542-fc69473abf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:20.201280 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2083a-b576-400e-9542-fc69473abf24 admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:20.202014 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2083a-b576-400e-9542-fc69473abf24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:36:20.202320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2083a-b576-400e-9542-fc69473abf24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:20.203948 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2083a-b576-400e-9542-fc69473abf24 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:20.215804 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1395/2803] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:36:20.219998 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c422d63-cb53-4df1-92f8-5475d7ab8839 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:20.229347 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c422d63-cb53-4df1-92f8-5475d7ab8839 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:20.234400 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a321852-8567-451c-a5db-2e6d69b68ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:20.235046 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a321852-8567-451c-a5db-2e6d69b68ddd admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:20.235330 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a321852-8567-451c-a5db-2e6d69b68ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:20.235604 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a321852-8567-451c-a5db-2e6d69b68ddd admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:20.236338 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a321852-8567-451c-a5db-2e6d69b68ddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:20.238231 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a321852-8567-451c-a5db-2e6d69b68ddd admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:20.267240 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1409/2804] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:36:20 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:20.269767 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2083a-b576-400e-9542-fc69473abf24 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:20.279965 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2083a-b576-400e-9542-fc69473abf24 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:20.333676 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced0df2-2222-468e-bd5d-5fe87383e6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:20.334335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced0df2-2222-468e-bd5d-5fe87383e6ca admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:20.334619 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced0df2-2222-468e-bd5d-5fe87383e6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:20.334896 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced0df2-2222-468e-bd5d-5fe87383e6ca admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:20.335578 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced0df2-2222-468e-bd5d-5fe87383e6ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:20.337516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced0df2-2222-468e-bd5d-5fe87383e6ca admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:20.357400 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1396/2805] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:36:20 2022] POST /identity/v3/users => generated 302 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:20.361415 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a321852-8567-451c-a5db-2e6d69b68ddd admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:20.372085 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a321852-8567-451c-a5db-2e6d69b68ddd admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:20.376634 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c519004-23f0-48c9-b8a2-8b1a8e1da4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:20.377274 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c519004-23f0-48c9-b8a2-8b1a8e1da4ab admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:20.377549 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c519004-23f0-48c9-b8a2-8b1a8e1da4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:20.377818 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c519004-23f0-48c9-b8a2-8b1a8e1da4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:20.378530 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c519004-23f0-48c9-b8a2-8b1a8e1da4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:20.380101 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c519004-23f0-48c9-b8a2-8b1a8e1da4ab admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:20.390293 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1410/2806] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:20.394000 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced0df2-2222-468e-bd5d-5fe87383e6ca admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:20.404175 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced0df2-2222-468e-bd5d-5fe87383e6ca admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:20.408801 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d30bc2-e6d0-48ff-8b95-302d22039047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:20.409446 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d30bc2-e6d0-48ff-8b95-302d22039047 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:20.409733 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d30bc2-e6d0-48ff-8b95-302d22039047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:20.410013 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d30bc2-e6d0-48ff-8b95-302d22039047 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:20.410729 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d30bc2-e6d0-48ff-8b95-302d22039047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:20.412487 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d30bc2-e6d0-48ff-8b95-302d22039047 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:20.422955 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1397/2807] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:36:20.426858 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c519004-23f0-48c9-b8a2-8b1a8e1da4ab admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:20.437126 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c519004-23f0-48c9-b8a2-8b1a8e1da4ab admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:20.441612 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3061ed-7536-4961-96b9-fa90b25ce672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:20.442460 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3061ed-7536-4961-96b9-fa90b25ce672 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:20.442730 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3061ed-7536-4961-96b9-fa90b25ce672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:20.442993 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3061ed-7536-4961-96b9-fa90b25ce672 admin admin] PATH_INFO: `/v3/projects/37fe509947b34a269e7bfd2a4eec005a/users/1250ca4e7bb147178ee956ef1d37140d/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:20.460250 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3061ed-7536-4961-96b9-fa90b25ce672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37fe509947b34a269e7bfd2a4eec005a, user_id=1250ca4e7bb147178ee956ef1d37140d, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:20.462884 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3061ed-7536-4961-96b9-fa90b25ce672 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:20.474863 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1411/2808] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:36:20 2022] PUT /identity/v3/projects/37fe509947b34a269e7bfd2a4eec005a/users/1250ca4e7bb147178ee956ef1d37140d/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:20.480433 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09b3a4-e3f5-4024-a776-71800e81ebd0 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:20.480737 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09b3a4-e3f5-4024-a776-71800e81ebd0 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:20.481018 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09b3a4-e3f5-4024-a776-71800e81ebd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:20.498718 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-4f09b3a4-e3f5-4024-a776-71800e81ebd0 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:20.499881 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-4f09b3a4-e3f5-4024-a776-71800e81ebd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:20.555149 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1398/2809] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:20.565065 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3061ed-7536-4961-96b9-fa90b25ce672 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:20.566697 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-2c3061ed-7536-4961-96b9-fa90b25ce672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:20.619525 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3061ed-7536-4961-96b9-fa90b25ce672 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:20.624029 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc9474-fe12-4172-b6be-5d2e1b6969fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:20.624722 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc9474-fe12-4172-b6be-5d2e1b6969fd service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:20.625005 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc9474-fe12-4172-b6be-5d2e1b6969fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:20.625279 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc9474-fe12-4172-b6be-5d2e1b6969fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:20.634301 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc9474-fe12-4172-b6be-5d2e1b6969fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:20.635738 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc9474-fe12-4172-b6be-5d2e1b6969fd service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:20.645398 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1412/2810] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:36:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:21.225545 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d86583-8c81-45f2-bd1c-96e3b8483094 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:21.226063 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d86583-8c81-45f2-bd1c-96e3b8483094 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:21.226256 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d86583-8c81-45f2-bd1c-96e3b8483094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:21.256656 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-13d86583-8c81-45f2-bd1c-96e3b8483094 None None] MFA Rules not processed for user `1250ca4e7bb147178ee956ef1d37140d`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:21.257842 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-13d86583-8c81-45f2-bd1c-96e3b8483094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:21.324732 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1399/2811] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:21.326292 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc9474-fe12-4172-b6be-5d2e1b6969fd service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:21.335946 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc9474-fe12-4172-b6be-5d2e1b6969fd service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:21.341315 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfc000-f7f9-4079-a986-1f8a286f782a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:21.341961 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfc000-f7f9-4079-a986-1f8a286f782a admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:21.342238 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfc000-f7f9-4079-a986-1f8a286f782a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:21.342507 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfc000-f7f9-4079-a986-1f8a286f782a admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:21.343179 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfc000-f7f9-4079-a986-1f8a286f782a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:21.345145 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfc000-f7f9-4079-a986-1f8a286f782a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:21.370031 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1413/2812] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:36:21 2022] POST /identity/v3/projects => generated 403 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:21.374081 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d86583-8c81-45f2-bd1c-96e3b8483094 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:21.384345 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d86583-8c81-45f2-bd1c-96e3b8483094 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:21.441876 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb99161-0f7f-43ad-bb4e-c00d7e1967c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:21.442542 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb99161-0f7f-43ad-bb4e-c00d7e1967c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:21.442825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb99161-0f7f-43ad-bb4e-c00d7e1967c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:21.443097 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb99161-0f7f-43ad-bb4e-c00d7e1967c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:21.443770 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb99161-0f7f-43ad-bb4e-c00d7e1967c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:21.445688 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb99161-0f7f-43ad-bb4e-c00d7e1967c1 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:21.466867 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1400/2813] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:36:21 2022] POST /identity/v3/users => generated 308 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:21.470946 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfc000-f7f9-4079-a986-1f8a286f782a admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:21.481165 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfc000-f7f9-4079-a986-1f8a286f782a admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:21.485763 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868c8c0-2c31-4930-99ed-4ee3f2bbeced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:21.486446 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868c8c0-2c31-4930-99ed-4ee3f2bbeced admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:21.486725 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868c8c0-2c31-4930-99ed-4ee3f2bbeced admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:21.486999 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868c8c0-2c31-4930-99ed-4ee3f2bbeced admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:21.487717 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868c8c0-2c31-4930-99ed-4ee3f2bbeced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:21.489423 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868c8c0-2c31-4930-99ed-4ee3f2bbeced admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:21.500126 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1414/2814] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:21.503982 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb99161-0f7f-43ad-bb4e-c00d7e1967c1 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:21.514486 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb99161-0f7f-43ad-bb4e-c00d7e1967c1 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:21.519105 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12669b-94cf-42db-a07f-a6de8c56b589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:21.519973 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12669b-94cf-42db-a07f-a6de8c56b589 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:21.520350 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12669b-94cf-42db-a07f-a6de8c56b589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:21.520633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12669b-94cf-42db-a07f-a6de8c56b589 admin admin] PATH_INFO: `/v3/projects/07d163832d204c6ea6d430a05cd455f7/users/9b579364f15f473983c70059a6c84aef/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:21.535118 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12669b-94cf-42db-a07f-a6de8c56b589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d163832d204c6ea6d430a05cd455f7, user_id=9b579364f15f473983c70059a6c84aef, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:21.537832 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12669b-94cf-42db-a07f-a6de8c56b589 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:21.550304 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1401/2815] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:36:21 2022] PUT /identity/v3/projects/07d163832d204c6ea6d430a05cd455f7/users/9b579364f15f473983c70059a6c84aef/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:36:21.554366 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868c8c0-2c31-4930-99ed-4ee3f2bbeced admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:21.565192 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868c8c0-2c31-4930-99ed-4ee3f2bbeced admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:21.618467 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54d8f4-04db-4648-b91a-a457734a5ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:21.619117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54d8f4-04db-4648-b91a-a457734a5ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:21.619394 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54d8f4-04db-4648-b91a-a457734a5ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:21.619663 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54d8f4-04db-4648-b91a-a457734a5ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:21.620953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54d8f4-04db-4648-b91a-a457734a5ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:21.623155 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54d8f4-04db-4648-b91a-a457734a5ad4 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:21.632558 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1415/2816] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:21.637397 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12669b-94cf-42db-a07f-a6de8c56b589 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:21.647598 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12669b-94cf-42db-a07f-a6de8c56b589 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:21.652353 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315e0f9-c2c5-4343-99ea-164f4291065d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:21.653343 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315e0f9-c2c5-4343-99ea-164f4291065d admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:21.653627 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315e0f9-c2c5-4343-99ea-164f4291065d admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:21.653902 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315e0f9-c2c5-4343-99ea-164f4291065d admin admin] PATH_INFO: `/v3/projects/07d163832d204c6ea6d430a05cd455f7/users/9b579364f15f473983c70059a6c84aef/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:21.655825 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315e0f9-c2c5-4343-99ea-164f4291065d admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d163832d204c6ea6d430a05cd455f7, user_id=9b579364f15f473983c70059a6c84aef, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:21.658501 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315e0f9-c2c5-4343-99ea-164f4291065d admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:21.668453 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1402/2817] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:36:21 2022] PUT /identity/v3/projects/07d163832d204c6ea6d430a05cd455f7/users/9b579364f15f473983c70059a6c84aef/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:22.270150 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d3958-d698-46d2-add5-de5f85032b75 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:22.270439 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d3958-d698-46d2-add5-de5f85032b75 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:22.270733 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d3958-d698-46d2-add5-de5f85032b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:22.298263 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-f42d3958-d698-46d2-add5-de5f85032b75 None None] MFA Rules not processed for user `9b579364f15f473983c70059a6c84aef`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:22.299469 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f42d3958-d698-46d2-add5-de5f85032b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:22.367348 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1416/2818] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:22 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:36:23.574591 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315e0f9-c2c5-4343-99ea-164f4291065d admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:23.638854 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315e0f9-c2c5-4343-99ea-164f4291065d admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:23.643298 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff66d2-c42e-4633-a7a2-750ef676a76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:23.644179 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff66d2-c42e-4633-a7a2-750ef676a76b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:23.644465 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff66d2-c42e-4633-a7a2-750ef676a76b admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:23.644738 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff66d2-c42e-4633-a7a2-750ef676a76b admin admin] PATH_INFO: `/v3/users/1250ca4e7bb147178ee956ef1d37140d` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:23.645902 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff66d2-c42e-4633-a7a2-750ef676a76b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1250ca4e7bb147178ee956ef1d37140d)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:23.648079 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff66d2-c42e-4633-a7a2-750ef676a76b admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:23.693228 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-1dff66d2-c42e-4633-a7a2-750ef676a76b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1250ca4e7bb147178ee956ef1d37140d'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:23.705082 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-1dff66d2-c42e-4633-a7a2-750ef676a76b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1250ca4e7bb147178ee956ef1d37140d'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:23.711493 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-1dff66d2-c42e-4633-a7a2-750ef676a76b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1250ca4e7bb147178ee956ef1d37140d'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:23.712170 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-1dff66d2-c42e-4633-a7a2-750ef676a76b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1250ca4e7bb147178ee956ef1d37140d'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:23.719891 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-1dff66d2-c42e-4633-a7a2-750ef676a76b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1250ca4e7bb147178ee956ef1d37140d'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:23.725659 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1403/2819] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:36:23 2022] DELETE /identity/v3/users/1250ca4e7bb147178ee956ef1d37140d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 20:36:23.892183 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d3958-d698-46d2-add5-de5f85032b75 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:23.902779 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d3958-d698-46d2-add5-de5f85032b75 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:23.957770 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3509f-7687-41b9-8c91-ce6f59ff14dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:23.958660 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3509f-7687-41b9-8c91-ce6f59ff14dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:23.958935 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3509f-7687-41b9-8c91-ce6f59ff14dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:23.959207 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3509f-7687-41b9-8c91-ce6f59ff14dd admin admin] PATH_INFO: `/v3/projects/37fe509947b34a269e7bfd2a4eec005a` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:23.960386 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3509f-7687-41b9-8c91-ce6f59ff14dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=37fe509947b34a269e7bfd2a4eec005a)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:23.962276 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3509f-7687-41b9-8c91-ce6f59ff14dd admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:24.005713 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-dab3509f-7687-41b9-8c91-ce6f59ff14dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37fe509947b34a269e7bfd2a4eec005a', 'request_id': 'req-dab3509f-7687-41b9-8c91-ce6f59ff14dd'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:24.012691 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-dab3509f-7687-41b9-8c91-ce6f59ff14dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37fe509947b34a269e7bfd2a4eec005a', 'request_id': 'req-dab3509f-7687-41b9-8c91-ce6f59ff14dd'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:24.019089 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-dab3509f-7687-41b9-8c91-ce6f59ff14dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37fe509947b34a269e7bfd2a4eec005a', 'request_id': 'req-dab3509f-7687-41b9-8c91-ce6f59ff14dd'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:24.029341 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-dab3509f-7687-41b9-8c91-ce6f59ff14dd admin admin] The token cache is being invalidate because project 37fe509947b34a269e7bfd2a4eec005a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:36:24.029624 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-dab3509f-7687-41b9-8c91-ce6f59ff14dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:24.030249 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-dab3509f-7687-41b9-8c91-ce6f59ff14dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:24.031762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1417/2820] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:36:23 2022] DELETE /identity/v3/projects/37fe509947b34a269e7bfd2a4eec005a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:24.035883 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff66d2-c42e-4633-a7a2-750ef676a76b admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:24.037309 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-1dff66d2-c42e-4633-a7a2-750ef676a76b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:24.050681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff66d2-c42e-4633-a7a2-750ef676a76b admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:24.109854 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbb3ae-5993-40a1-b79b-25117fe72dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:24.110722 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbb3ae-5993-40a1-b79b-25117fe72dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:24.111004 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbb3ae-5993-40a1-b79b-25117fe72dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:24.111278 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbb3ae-5993-40a1-b79b-25117fe72dbe admin admin] PATH_INFO: `/v3/users/9b579364f15f473983c70059a6c84aef` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:24.112566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbb3ae-5993-40a1-b79b-25117fe72dbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b579364f15f473983c70059a6c84aef)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:24.114498 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbb3ae-5993-40a1-b79b-25117fe72dbe admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:24.159514 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d9dbb3ae-5993-40a1-b79b-25117fe72dbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b579364f15f473983c70059a6c84aef'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:24.171269 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d9dbb3ae-5993-40a1-b79b-25117fe72dbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b579364f15f473983c70059a6c84aef'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:24.177616 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d9dbb3ae-5993-40a1-b79b-25117fe72dbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b579364f15f473983c70059a6c84aef'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:24.178283 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d9dbb3ae-5993-40a1-b79b-25117fe72dbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b579364f15f473983c70059a6c84aef'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:24.184781 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d9dbb3ae-5993-40a1-b79b-25117fe72dbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b579364f15f473983c70059a6c84aef'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:24.191031 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1404/2821] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:36:24 2022] DELETE /identity/v3/users/9b579364f15f473983c70059a6c84aef => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:24.362800 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3509f-7687-41b9-8c91-ce6f59ff14dd admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:24.365135 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-dab3509f-7687-41b9-8c91-ce6f59ff14dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:24.382099 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3509f-7687-41b9-8c91-ce6f59ff14dd admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:24.443709 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c9292-8e22-4948-a746-b7cd653f65a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:24.444498 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c9292-8e22-4948-a746-b7cd653f65a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:24.444774 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c9292-8e22-4948-a746-b7cd653f65a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:24.445041 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c9292-8e22-4948-a746-b7cd653f65a2 admin admin] PATH_INFO: `/v3/projects/07d163832d204c6ea6d430a05cd455f7` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:24.446227 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c9292-8e22-4948-a746-b7cd653f65a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07d163832d204c6ea6d430a05cd455f7)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:24.448117 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c9292-8e22-4948-a746-b7cd653f65a2 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:24.500462 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b93c9292-8e22-4948-a746-b7cd653f65a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d163832d204c6ea6d430a05cd455f7', 'request_id': 'req-b93c9292-8e22-4948-a746-b7cd653f65a2'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:24.507170 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b93c9292-8e22-4948-a746-b7cd653f65a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d163832d204c6ea6d430a05cd455f7', 'request_id': 'req-b93c9292-8e22-4948-a746-b7cd653f65a2'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:24.513928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b93c9292-8e22-4948-a746-b7cd653f65a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d163832d204c6ea6d430a05cd455f7', 'request_id': 'req-b93c9292-8e22-4948-a746-b7cd653f65a2'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:24.524402 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b93c9292-8e22-4948-a746-b7cd653f65a2 admin admin] The token cache is being invalidate because project 07d163832d204c6ea6d430a05cd455f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:36:24.524684 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b93c9292-8e22-4948-a746-b7cd653f65a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:24.525313 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b93c9292-8e22-4948-a746-b7cd653f65a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:24.526847 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1418/2822] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:36:24 2022] DELETE /identity/v3/projects/07d163832d204c6ea6d430a05cd455f7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:24.532106 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c78e8-4fab-45e1-88c6-17c62298252e None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:24.532427 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c78e8-4fab-45e1-88c6-17c62298252e None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:24.532703 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c78e8-4fab-45e1-88c6-17c62298252e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:24.550108 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-845c78e8-4fab-45e1-88c6-17c62298252e None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:24.551331 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-845c78e8-4fab-45e1-88c6-17c62298252e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:24.607484 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1405/2823] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:24.615196 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fed00c-01cb-4f48-9fb6-dc0a7b7a4bd7 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:24.615478 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fed00c-01cb-4f48-9fb6-dc0a7b7a4bd7 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:24.615750 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fed00c-01cb-4f48-9fb6-dc0a7b7a4bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:24.635263 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-f2fed00c-01cb-4f48-9fb6-dc0a7b7a4bd7 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:24.636499 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f2fed00c-01cb-4f48-9fb6-dc0a7b7a4bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:24.644987 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1419/2824] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:24.649366 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c78e8-4fab-45e1-88c6-17c62298252e None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:24.658949 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c78e8-4fab-45e1-88c6-17c62298252e None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:24.663482 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac37d2-3010-43de-9b2d-abea3e963732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:24.664127 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac37d2-3010-43de-9b2d-abea3e963732 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:24.664459 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac37d2-3010-43de-9b2d-abea3e963732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:24.664716 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac37d2-3010-43de-9b2d-abea3e963732 admin admin] PATH_INFO: `/v3/domains` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:24.665430 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac37d2-3010-43de-9b2d-abea3e963732 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:36:24.665734 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac37d2-3010-43de-9b2d-abea3e963732 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:24.667399 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac37d2-3010-43de-9b2d-abea3e963732 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:24.679079 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1406/2825] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:36:24.683348 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fed00c-01cb-4f48-9fb6-dc0a7b7a4bd7 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:24.695453 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fed00c-01cb-4f48-9fb6-dc0a7b7a4bd7 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:24.700039 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198494e0-c5d1-40df-96ca-0d5c27326422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:24.702619 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198494e0-c5d1-40df-96ca-0d5c27326422 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:24.702906 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198494e0-c5d1-40df-96ca-0d5c27326422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:24.703182 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198494e0-c5d1-40df-96ca-0d5c27326422 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:24.703874 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198494e0-c5d1-40df-96ca-0d5c27326422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:24.705814 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198494e0-c5d1-40df-96ca-0d5c27326422 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:24.731327 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1420/2826] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:36:24 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:24.735973 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac37d2-3010-43de-9b2d-abea3e963732 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:24.745971 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac37d2-3010-43de-9b2d-abea3e963732 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:24.800625 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19b64e-54c0-4621-9323-0cb570009486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:24.801289 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19b64e-54c0-4621-9323-0cb570009486 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:24.801573 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19b64e-54c0-4621-9323-0cb570009486 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:24.801850 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19b64e-54c0-4621-9323-0cb570009486 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:24.802522 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19b64e-54c0-4621-9323-0cb570009486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:24.804513 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19b64e-54c0-4621-9323-0cb570009486 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:24.823454 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1407/2827] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:36:24 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:24.828004 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198494e0-c5d1-40df-96ca-0d5c27326422 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:24.838051 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198494e0-c5d1-40df-96ca-0d5c27326422 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:24.843283 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea2eed-f175-4962-a985-5b8ec03e1fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:24.843930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea2eed-f175-4962-a985-5b8ec03e1fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:24.844247 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea2eed-f175-4962-a985-5b8ec03e1fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:24.844526 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea2eed-f175-4962-a985-5b8ec03e1fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:24.845248 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea2eed-f175-4962-a985-5b8ec03e1fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:24.846835 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea2eed-f175-4962-a985-5b8ec03e1fa2 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:24.856990 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1421/2828] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:24.860714 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19b64e-54c0-4621-9323-0cb570009486 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:24.870263 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19b64e-54c0-4621-9323-0cb570009486 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:24.875096 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4606a-0102-4a27-b315-033422d7e31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:24.875757 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4606a-0102-4a27-b315-033422d7e31e admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:24.876046 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4606a-0102-4a27-b315-033422d7e31e admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:24.876382 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4606a-0102-4a27-b315-033422d7e31e admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:24.877104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4606a-0102-4a27-b315-033422d7e31e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:24.878726 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4606a-0102-4a27-b315-033422d7e31e admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:24.888898 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1408/2829] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:24.892894 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea2eed-f175-4962-a985-5b8ec03e1fa2 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:24.902755 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea2eed-f175-4962-a985-5b8ec03e1fa2 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:24.908032 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce02ce-53cc-49b2-9723-64c40ace98e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:24.908917 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce02ce-53cc-49b2-9723-64c40ace98e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:24.909193 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce02ce-53cc-49b2-9723-64c40ace98e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:24.909466 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce02ce-53cc-49b2-9723-64c40ace98e2 admin admin] PATH_INFO: `/v3/projects/024e41e0580742139d8cde499a2d8a88/users/8034e51ab9f144c9a29f2aceff439ed6/roles/99462c05ed484212893d40128c99f47c` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:24.923202 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce02ce-53cc-49b2-9723-64c40ace98e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=024e41e0580742139d8cde499a2d8a88, user_id=8034e51ab9f144c9a29f2aceff439ed6, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:24.925866 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce02ce-53cc-49b2-9723-64c40ace98e2 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:24.938143 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1422/2830] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:36:24 2022] PUT /identity/v3/projects/024e41e0580742139d8cde499a2d8a88/users/8034e51ab9f144c9a29f2aceff439ed6/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:24.948379 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bbbed-5824-428f-84fc-dd8bac3f8396 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:24.948617 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bbbed-5824-428f-84fc-dd8bac3f8396 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:24.948902 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bbbed-5824-428f-84fc-dd8bac3f8396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:24.976330 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-ea5bbbed-5824-428f-84fc-dd8bac3f8396 None None] MFA Rules not processed for user `8034e51ab9f144c9a29f2aceff439ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:24.977523 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-ea5bbbed-5824-428f-84fc-dd8bac3f8396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:25.040510 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1409/2831] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:25.045482 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce02ce-53cc-49b2-9723-64c40ace98e2 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:25.105854 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce02ce-53cc-49b2-9723-64c40ace98e2 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:25.111003 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8731dc-c09a-4b0f-a3eb-4bd1a28f2d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:25.111651 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8731dc-c09a-4b0f-a3eb-4bd1a28f2d05 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:25.111934 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8731dc-c09a-4b0f-a3eb-4bd1a28f2d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:25.112236 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8731dc-c09a-4b0f-a3eb-4bd1a28f2d05 admin admin] PATH_INFO: `/v3/projects` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:25.112928 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8731dc-c09a-4b0f-a3eb-4bd1a28f2d05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:25.114832 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8731dc-c09a-4b0f-a3eb-4bd1a28f2d05 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:25.141304 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1423/2832] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:36:25 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:25.145309 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bbbed-5824-428f-84fc-dd8bac3f8396 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:25.155897 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bbbed-5824-428f-84fc-dd8bac3f8396 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:25.208406 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd507f8-64b0-48e0-82ce-2ed511b23180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:25.208999 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd507f8-64b0-48e0-82ce-2ed511b23180 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:25.209280 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd507f8-64b0-48e0-82ce-2ed511b23180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:25.209554 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd507f8-64b0-48e0-82ce-2ed511b23180 admin admin] PATH_INFO: `/v3/users` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:25.210244 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd507f8-64b0-48e0-82ce-2ed511b23180 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:25.212129 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd507f8-64b0-48e0-82ce-2ed511b23180 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:25.231681 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1410/2833] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:36:25 2022] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:36:25.235775 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8731dc-c09a-4b0f-a3eb-4bd1a28f2d05 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:25.245830 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8731dc-c09a-4b0f-a3eb-4bd1a28f2d05 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:25.251131 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df0525-0a9b-4171-adcb-3ebbe693b243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:25.251779 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df0525-0a9b-4171-adcb-3ebbe693b243 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:25.252057 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df0525-0a9b-4171-adcb-3ebbe693b243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:25.252401 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df0525-0a9b-4171-adcb-3ebbe693b243 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:25.253112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df0525-0a9b-4171-adcb-3ebbe693b243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:25.254693 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df0525-0a9b-4171-adcb-3ebbe693b243 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:25.265508 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1424/2834] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 20:36:25.269510 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd507f8-64b0-48e0-82ce-2ed511b23180 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:25.279527 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd507f8-64b0-48e0-82ce-2ed511b23180 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:25.284053 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aafd4a-9dee-4784-9014-e9effa2c4c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:25.284958 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aafd4a-9dee-4784-9014-e9effa2c4c6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:25.285246 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aafd4a-9dee-4784-9014-e9effa2c4c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:25.285526 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aafd4a-9dee-4784-9014-e9effa2c4c6a admin admin] PATH_INFO: `/v3/projects/940c2a2811d7479593557d4de9e24348/users/fabcf714722b458a926ec4ef4f78bb74/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:25.299841 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aafd4a-9dee-4784-9014-e9effa2c4c6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=940c2a2811d7479593557d4de9e24348, user_id=fabcf714722b458a926ec4ef4f78bb74, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:25.302556 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aafd4a-9dee-4784-9014-e9effa2c4c6a admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:25.315675 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1411/2835] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:36:25 2022] PUT /identity/v3/projects/940c2a2811d7479593557d4de9e24348/users/fabcf714722b458a926ec4ef4f78bb74/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:25.319492 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df0525-0a9b-4171-adcb-3ebbe693b243 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:25.330020 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df0525-0a9b-4171-adcb-3ebbe693b243 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:25.384100 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0cf22d-e00e-4a68-9d03-c14d89227618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:25.384784 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cf22d-e00e-4a68-9d03-c14d89227618 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:25.385066 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cf22d-e00e-4a68-9d03-c14d89227618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:25.385341 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cf22d-e00e-4a68-9d03-c14d89227618 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:25.386257 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0cf22d-e00e-4a68-9d03-c14d89227618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:25.388855 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0cf22d-e00e-4a68-9d03-c14d89227618 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:25.398728 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1425/2836] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:25.403008 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aafd4a-9dee-4784-9014-e9effa2c4c6a admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:25.413002 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aafd4a-9dee-4784-9014-e9effa2c4c6a admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:25.417511 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666ff14-7eda-4968-a14d-0fd08e491853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:25.418375 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666ff14-7eda-4968-a14d-0fd08e491853 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:25.418651 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666ff14-7eda-4968-a14d-0fd08e491853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:25.418917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666ff14-7eda-4968-a14d-0fd08e491853 admin admin] PATH_INFO: `/v3/projects/940c2a2811d7479593557d4de9e24348/users/fabcf714722b458a926ec4ef4f78bb74/roles/6576d9225a0946de877f527e3d15db05` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:25.421312 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666ff14-7eda-4968-a14d-0fd08e491853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=940c2a2811d7479593557d4de9e24348, user_id=fabcf714722b458a926ec4ef4f78bb74, role_id=6576d9225a0946de877f527e3d15db05)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:25.423959 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666ff14-7eda-4968-a14d-0fd08e491853 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:25.434016 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1412/2837] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:36:25 2022] PUT /identity/v3/projects/940c2a2811d7479593557d4de9e24348/users/fabcf714722b458a926ec4ef4f78bb74/roles/6576d9225a0946de877f527e3d15db05 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:25.445990 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810f47d-4253-4ad9-9180-5ca6b6d85e26 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:25.446280 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810f47d-4253-4ad9-9180-5ca6b6d85e26 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:25.446565 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810f47d-4253-4ad9-9180-5ca6b6d85e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:25.473324 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-f810f47d-4253-4ad9-9180-5ca6b6d85e26 None None] MFA Rules not processed for user `fabcf714722b458a926ec4ef4f78bb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:25.474448 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f810f47d-4253-4ad9-9180-5ca6b6d85e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:25.539206 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1426/2838] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:25 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:25.550734 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666ff14-7eda-4968-a14d-0fd08e491853 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:25.552458 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-4666ff14-7eda-4968-a14d-0fd08e491853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:25.607964 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666ff14-7eda-4968-a14d-0fd08e491853 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:25.611567 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e444f-d282-4279-b4cd-3cf2d9c18d5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:25.612224 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e444f-d282-4279-b4cd-3cf2d9c18d5e service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:25.612519 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e444f-d282-4279-b4cd-3cf2d9c18d5e service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:25.612776 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e444f-d282-4279-b4cd-3cf2d9c18d5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:25.621559 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e444f-d282-4279-b4cd-3cf2d9c18d5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:25.623778 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e444f-d282-4279-b4cd-3cf2d9c18d5e service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:25.633439 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1413/2839] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:36:25 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:25.987954 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810f47d-4253-4ad9-9180-5ca6b6d85e26 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:26.048264 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810f47d-4253-4ad9-9180-5ca6b6d85e26 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:26.052778 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe88cfa-468c-4f6d-b3f2-30e0fd43d07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:26.053630 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe88cfa-468c-4f6d-b3f2-30e0fd43d07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:26.053910 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe88cfa-468c-4f6d-b3f2-30e0fd43d07a admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:26.054186 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe88cfa-468c-4f6d-b3f2-30e0fd43d07a admin admin] PATH_INFO: `/v3/users/8034e51ab9f144c9a29f2aceff439ed6` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:26.055356 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe88cfa-468c-4f6d-b3f2-30e0fd43d07a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8034e51ab9f144c9a29f2aceff439ed6)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:26.057340 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe88cfa-468c-4f6d-b3f2-30e0fd43d07a admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:26.102744 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-afe88cfa-468c-4f6d-b3f2-30e0fd43d07a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8034e51ab9f144c9a29f2aceff439ed6'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:26.103408 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-afe88cfa-468c-4f6d-b3f2-30e0fd43d07a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8034e51ab9f144c9a29f2aceff439ed6'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:26.111194 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-afe88cfa-468c-4f6d-b3f2-30e0fd43d07a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8034e51ab9f144c9a29f2aceff439ed6'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:26.119711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-afe88cfa-468c-4f6d-b3f2-30e0fd43d07a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8034e51ab9f144c9a29f2aceff439ed6'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:26.131232 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-afe88cfa-468c-4f6d-b3f2-30e0fd43d07a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8034e51ab9f144c9a29f2aceff439ed6'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:26.136951 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1427/2840] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:36:25 2022] DELETE /identity/v3/users/8034e51ab9f144c9a29f2aceff439ed6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:26.141475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c0dac-fb55-4050-8c26-480b555f5aef None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:26.141769 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c0dac-fb55-4050-8c26-480b555f5aef None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:26.142080 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c0dac-fb55-4050-8c26-480b555f5aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:26.161259 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-f25c0dac-fb55-4050-8c26-480b555f5aef None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:26.162467 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f25c0dac-fb55-4050-8c26-480b555f5aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:26.218928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1414/2841] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:26.228787 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe88cfa-468c-4f6d-b3f2-30e0fd43d07a admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:26.230220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-afe88cfa-468c-4f6d-b3f2-30e0fd43d07a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:26.289344 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe88cfa-468c-4f6d-b3f2-30e0fd43d07a admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:26.292994 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579053e-eb6e-4f72-8fb1-d11fe314d1b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:26.293643 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579053e-eb6e-4f72-8fb1-d11fe314d1b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:26.293908 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579053e-eb6e-4f72-8fb1-d11fe314d1b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:26.294527 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579053e-eb6e-4f72-8fb1-d11fe314d1b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:26.303796 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579053e-eb6e-4f72-8fb1-d11fe314d1b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:26.305265 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579053e-eb6e-4f72-8fb1-d11fe314d1b4 service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:26.314652 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1428/2842] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:36:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 20:36:26.588335 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c0dac-fb55-4050-8c26-480b555f5aef None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:26.589827 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f25c0dac-fb55-4050-8c26-480b555f5aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:26.602400 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c0dac-fb55-4050-8c26-480b555f5aef None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:26.607067 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78514f56-44f6-44ad-bef6-047a2500f5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:26.607969 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78514f56-44f6-44ad-bef6-047a2500f5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:26.608261 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78514f56-44f6-44ad-bef6-047a2500f5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:26.608842 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78514f56-44f6-44ad-bef6-047a2500f5f9 admin admin] PATH_INFO: `/v3/projects/024e41e0580742139d8cde499a2d8a88` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:26.609701 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78514f56-44f6-44ad-bef6-047a2500f5f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=024e41e0580742139d8cde499a2d8a88)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:26.611598 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78514f56-44f6-44ad-bef6-047a2500f5f9 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:26.657730 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-78514f56-44f6-44ad-bef6-047a2500f5f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '024e41e0580742139d8cde499a2d8a88', 'request_id': 'req-78514f56-44f6-44ad-bef6-047a2500f5f9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:26.663047 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-78514f56-44f6-44ad-bef6-047a2500f5f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '024e41e0580742139d8cde499a2d8a88', 'request_id': 'req-78514f56-44f6-44ad-bef6-047a2500f5f9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:26.670302 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-78514f56-44f6-44ad-bef6-047a2500f5f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '024e41e0580742139d8cde499a2d8a88', 'request_id': 'req-78514f56-44f6-44ad-bef6-047a2500f5f9'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:26.681066 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-78514f56-44f6-44ad-bef6-047a2500f5f9 admin admin] The token cache is being invalidate because project 024e41e0580742139d8cde499a2d8a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:36:26.681352 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-78514f56-44f6-44ad-bef6-047a2500f5f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:26.681970 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-78514f56-44f6-44ad-bef6-047a2500f5f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:26.683506 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1415/2843] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:36:26 2022] DELETE /identity/v3/projects/024e41e0580742139d8cde499a2d8a88 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:26.688042 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579053e-eb6e-4f72-8fb1-d11fe314d1b4 service neutron] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:26.697462 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579053e-eb6e-4f72-8fb1-d11fe314d1b4 service neutron] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:26.751366 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a61004-90be-4583-a954-d725dd21ec93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:26.752246 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a61004-90be-4583-a954-d725dd21ec93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:26.752522 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a61004-90be-4583-a954-d725dd21ec93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:26.752792 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a61004-90be-4583-a954-d725dd21ec93 admin admin] PATH_INFO: `/v3/users/fabcf714722b458a926ec4ef4f78bb74` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:26.753944 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a61004-90be-4583-a954-d725dd21ec93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fabcf714722b458a926ec4ef4f78bb74)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:26.755833 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a61004-90be-4583-a954-d725dd21ec93 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:26.803641 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b9a61004-90be-4583-a954-d725dd21ec93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fabcf714722b458a926ec4ef4f78bb74'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:26.804251 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b9a61004-90be-4583-a954-d725dd21ec93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fabcf714722b458a926ec4ef4f78bb74'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:26.811776 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b9a61004-90be-4583-a954-d725dd21ec93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fabcf714722b458a926ec4ef4f78bb74'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:26.819653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b9a61004-90be-4583-a954-d725dd21ec93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fabcf714722b458a926ec4ef4f78bb74'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:26.831734 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-b9a61004-90be-4583-a954-d725dd21ec93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fabcf714722b458a926ec4ef4f78bb74'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:26.837653 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1429/2844] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:36:26 2022] DELETE /identity/v3/users/fabcf714722b458a926ec4ef4f78bb74 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:27.092914 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78514f56-44f6-44ad-bef6-047a2500f5f9 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:27.094319 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-78514f56-44f6-44ad-bef6-047a2500f5f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:27.108268 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78514f56-44f6-44ad-bef6-047a2500f5f9 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:27.164390 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7408bfb-4d76-45d9-bea7-b354b814b348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:27.165269 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7408bfb-4d76-45d9-bea7-b354b814b348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:27.165549 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7408bfb-4d76-45d9-bea7-b354b814b348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:27.165846 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7408bfb-4d76-45d9-bea7-b354b814b348 admin admin] PATH_INFO: `/v3/projects/940c2a2811d7479593557d4de9e24348` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:27.167009 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7408bfb-4d76-45d9-bea7-b354b814b348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=940c2a2811d7479593557d4de9e24348)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:27.168950 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7408bfb-4d76-45d9-bea7-b354b814b348 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:27.214522 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d7408bfb-4d76-45d9-bea7-b354b814b348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '940c2a2811d7479593557d4de9e24348', 'request_id': 'req-d7408bfb-4d76-45d9-bea7-b354b814b348'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:27.219886 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d7408bfb-4d76-45d9-bea7-b354b814b348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '940c2a2811d7479593557d4de9e24348', 'request_id': 'req-d7408bfb-4d76-45d9-bea7-b354b814b348'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:27.226618 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d7408bfb-4d76-45d9-bea7-b354b814b348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '940c2a2811d7479593557d4de9e24348', 'request_id': 'req-d7408bfb-4d76-45d9-bea7-b354b814b348'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:27.238140 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d7408bfb-4d76-45d9-bea7-b354b814b348 admin admin] The token cache is being invalidate because project 940c2a2811d7479593557d4de9e24348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:36:27.238428 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d7408bfb-4d76-45d9-bea7-b354b814b348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:27.239091 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-d7408bfb-4d76-45d9-bea7-b354b814b348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:27.240670 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1416/2845] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:36:27 2022] DELETE /identity/v3/projects/940c2a2811d7479593557d4de9e24348 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:27.245497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fe3c4-4160-41b0-a6f9-a27f82147a1d None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:27.245992 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fe3c4-4160-41b0-a6f9-a27f82147a1d None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:27.246113 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fe3c4-4160-41b0-a6f9-a27f82147a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:27.264930 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-561fe3c4-4160-41b0-a6f9-a27f82147a1d None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:27.266154 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-561fe3c4-4160-41b0-a6f9-a27f82147a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:27.323645 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1430/2846] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:27.331399 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad34cc-b0a7-46b5-8aa4-65c4f74517f5 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:27.331694 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad34cc-b0a7-46b5-8aa4-65c4f74517f5 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:27.331979 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad34cc-b0a7-46b5-8aa4-65c4f74517f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:27.350250 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-50ad34cc-b0a7-46b5-8aa4-65c4f74517f5 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:27.351666 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-50ad34cc-b0a7-46b5-8aa4-65c4f74517f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:27.359874 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1417/2847] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:36:27.363863 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fe3c4-4160-41b0-a6f9-a27f82147a1d None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:27.373912 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fe3c4-4160-41b0-a6f9-a27f82147a1d None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:27.379542 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4da6b0-0cb9-466e-a975-62f313424e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:27.380228 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4da6b0-0cb9-466e-a975-62f313424e8d admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:27.380557 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4da6b0-0cb9-466e-a975-62f313424e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:27.380837 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4da6b0-0cb9-466e-a975-62f313424e8d admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:27.381596 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4da6b0-0cb9-466e-a975-62f313424e8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:36:27.381905 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4da6b0-0cb9-466e-a975-62f313424e8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:27.383539 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4da6b0-0cb9-466e-a975-62f313424e8d admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:27.395474 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1431/2848] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:36:27.400044 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad34cc-b0a7-46b5-8aa4-65c4f74517f5 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:27.410072 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad34cc-b0a7-46b5-8aa4-65c4f74517f5 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:27.414677 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffffcea-01bc-4d02-82d7-23e79bc0f621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:27.415346 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffffcea-01bc-4d02-82d7-23e79bc0f621 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:27.415630 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffffcea-01bc-4d02-82d7-23e79bc0f621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:27.415909 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffffcea-01bc-4d02-82d7-23e79bc0f621 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:27.416637 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffffcea-01bc-4d02-82d7-23e79bc0f621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:27.418563 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffffcea-01bc-4d02-82d7-23e79bc0f621 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:27.443899 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1418/2849] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:36:27 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 20:36:27.448105 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4da6b0-0cb9-466e-a975-62f313424e8d admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:27.460076 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4da6b0-0cb9-466e-a975-62f313424e8d admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:27.514911 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbe114-f194-49d0-9e41-2193817f9cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:27.515565 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbe114-f194-49d0-9e41-2193817f9cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:27.515843 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbe114-f194-49d0-9e41-2193817f9cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:27.516116 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbe114-f194-49d0-9e41-2193817f9cf8 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:27.516932 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbe114-f194-49d0-9e41-2193817f9cf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:27.518841 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbe114-f194-49d0-9e41-2193817f9cf8 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:27.538688 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1432/2850] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:36:27 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:36:27.542818 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffffcea-01bc-4d02-82d7-23e79bc0f621 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:27.553289 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffffcea-01bc-4d02-82d7-23e79bc0f621 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:27.557806 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354f366-c03a-4ab8-894d-65e30614a034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:27.558460 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354f366-c03a-4ab8-894d-65e30614a034 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:27.558741 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354f366-c03a-4ab8-894d-65e30614a034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:27.559018 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354f366-c03a-4ab8-894d-65e30614a034 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:27.559819 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354f366-c03a-4ab8-894d-65e30614a034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:27.561377 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354f366-c03a-4ab8-894d-65e30614a034 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:27.571566 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1419/2851] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:27.575345 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbe114-f194-49d0-9e41-2193817f9cf8 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:27.585329 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbe114-f194-49d0-9e41-2193817f9cf8 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:27.589895 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f866b45-5b9a-4d5a-a89f-72fb94e9cf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:27.590541 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f866b45-5b9a-4d5a-a89f-72fb94e9cf5d admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:27.590823 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f866b45-5b9a-4d5a-a89f-72fb94e9cf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:27.591713 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f866b45-5b9a-4d5a-a89f-72fb94e9cf5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:27.592480 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f866b45-5b9a-4d5a-a89f-72fb94e9cf5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:27.594074 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f866b45-5b9a-4d5a-a89f-72fb94e9cf5d admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:27.603676 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1433/2852] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:27.608379 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354f366-c03a-4ab8-894d-65e30614a034 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:27.618040 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354f366-c03a-4ab8-894d-65e30614a034 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:27.623167 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa615754-7b58-40c6-bc71-0671c35f4690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:27.624021 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa615754-7b58-40c6-bc71-0671c35f4690 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:27.624356 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa615754-7b58-40c6-bc71-0671c35f4690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:27.624634 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa615754-7b58-40c6-bc71-0671c35f4690 admin admin] PATH_INFO: `/v3/projects/a2e333346b1c42129135cd7ee74e384f/users/271a6c767322449d9af95de694ddde40/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:27.639437 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa615754-7b58-40c6-bc71-0671c35f4690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e333346b1c42129135cd7ee74e384f, user_id=271a6c767322449d9af95de694ddde40, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:27.642133 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa615754-7b58-40c6-bc71-0671c35f4690 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:27.655610 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1420/2853] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:36:27 2022] PUT /identity/v3/projects/a2e333346b1c42129135cd7ee74e384f/users/271a6c767322449d9af95de694ddde40/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:27.665946 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57c780-3f30-4268-bc3d-08e91cb56e17 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:27.666239 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57c780-3f30-4268-bc3d-08e91cb56e17 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:27.666538 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57c780-3f30-4268-bc3d-08e91cb56e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:27.694084 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-1a57c780-3f30-4268-bc3d-08e91cb56e17 None None] MFA Rules not processed for user `271a6c767322449d9af95de694ddde40`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:27.695282 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-1a57c780-3f30-4268-bc3d-08e91cb56e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:27.756158 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1434/2854] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:27.767690 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa615754-7b58-40c6-bc71-0671c35f4690 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:27.769377 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-fa615754-7b58-40c6-bc71-0671c35f4690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:27.823416 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa615754-7b58-40c6-bc71-0671c35f4690 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:27.827750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2035ff-2882-4cf7-b0c5-fcd1e70097bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c62c3f9351a4181a4fc2930570171b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:27.828419 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2035ff-2882-4cf7-b0c5-fcd1e70097bc service glance] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:27.828710 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2035ff-2882-4cf7-b0c5-fcd1e70097bc service glance] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:27.828985 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2035ff-2882-4cf7-b0c5-fcd1e70097bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:27.837186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2035ff-2882-4cf7-b0c5-fcd1e70097bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:27.838636 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2035ff-2882-4cf7-b0c5-fcd1e70097bc service glance] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:27.848475 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1421/2855] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:36:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:43.239513 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57c780-3f30-4268-bc3d-08e91cb56e17 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:43.300223 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57c780-3f30-4268-bc3d-08e91cb56e17 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:43.304633 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a845164-3654-4e46-a307-ab654e35d5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:43.305482 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a845164-3654-4e46-a307-ab654e35d5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:43.305761 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a845164-3654-4e46-a307-ab654e35d5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:43.306035 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a845164-3654-4e46-a307-ab654e35d5bf admin admin] PATH_INFO: `/v3/users/271a6c767322449d9af95de694ddde40` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:43.307202 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a845164-3654-4e46-a307-ab654e35d5bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=271a6c767322449d9af95de694ddde40)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:43.309148 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a845164-3654-4e46-a307-ab654e35d5bf admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:43.354503 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-2a845164-3654-4e46-a307-ab654e35d5bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '271a6c767322449d9af95de694ddde40'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:43.355171 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-2a845164-3654-4e46-a307-ab654e35d5bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '271a6c767322449d9af95de694ddde40'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:43.361968 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-2a845164-3654-4e46-a307-ab654e35d5bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '271a6c767322449d9af95de694ddde40'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:43.368624 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-2a845164-3654-4e46-a307-ab654e35d5bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '271a6c767322449d9af95de694ddde40'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:43.379973 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-2a845164-3654-4e46-a307-ab654e35d5bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '271a6c767322449d9af95de694ddde40'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:43.385679 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1435/2856] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:36:43 2022] DELETE /identity/v3/users/271a6c767322449d9af95de694ddde40 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:43.390109 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61946259-e13e-4ef3-8a4e-c3299419ff06 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:43.390638 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61946259-e13e-4ef3-8a4e-c3299419ff06 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:43.391320 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61946259-e13e-4ef3-8a4e-c3299419ff06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:43.409006 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-61946259-e13e-4ef3-8a4e-c3299419ff06 None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:43.410200 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-61946259-e13e-4ef3-8a4e-c3299419ff06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:43.468373 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1422/2857] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:43.478556 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a845164-3654-4e46-a307-ab654e35d5bf admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:43.479976 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-2a845164-3654-4e46-a307-ab654e35d5bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:43.535622 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a845164-3654-4e46-a307-ab654e35d5bf admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:43.539241 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f574c-ab30-4e38-904b-a9c64c20caac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:43.539871 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f574c-ab30-4e38-904b-a9c64c20caac service neutron] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:43.540169 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f574c-ab30-4e38-904b-a9c64c20caac service neutron] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:43.540453 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f574c-ab30-4e38-904b-a9c64c20caac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:43.549137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f574c-ab30-4e38-904b-a9c64c20caac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:43.550559 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f574c-ab30-4e38-904b-a9c64c20caac service neutron] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:43.559678 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1436/2858] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:36:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:43.824838 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61946259-e13e-4ef3-8a4e-c3299419ff06 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:43.826254 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-61946259-e13e-4ef3-8a4e-c3299419ff06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:43.848259 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61946259-e13e-4ef3-8a4e-c3299419ff06 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:43.853222 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02afa0-dfde-49ac-a4b9-ec33706e85e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:43.854352 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02afa0-dfde-49ac-a4b9-ec33706e85e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:43.854802 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02afa0-dfde-49ac-a4b9-ec33706e85e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:43.855249 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02afa0-dfde-49ac-a4b9-ec33706e85e3 admin admin] PATH_INFO: `/v3/projects/a2e333346b1c42129135cd7ee74e384f` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:43.857018 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a02afa0-dfde-49ac-a4b9-ec33706e85e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2e333346b1c42129135cd7ee74e384f)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:43.858928 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a02afa0-dfde-49ac-a4b9-ec33706e85e3 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:43.905227 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-6a02afa0-dfde-49ac-a4b9-ec33706e85e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2e333346b1c42129135cd7ee74e384f', 'request_id': 'req-6a02afa0-dfde-49ac-a4b9-ec33706e85e3'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:43.910496 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-6a02afa0-dfde-49ac-a4b9-ec33706e85e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2e333346b1c42129135cd7ee74e384f', 'request_id': 'req-6a02afa0-dfde-49ac-a4b9-ec33706e85e3'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:43.917074 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-6a02afa0-dfde-49ac-a4b9-ec33706e85e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2e333346b1c42129135cd7ee74e384f', 'request_id': 'req-6a02afa0-dfde-49ac-a4b9-ec33706e85e3'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:43.928017 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-6a02afa0-dfde-49ac-a4b9-ec33706e85e3 admin admin] The token cache is being invalidate because project a2e333346b1c42129135cd7ee74e384f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:36:43.928325 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-6a02afa0-dfde-49ac-a4b9-ec33706e85e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:43.928944 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-6a02afa0-dfde-49ac-a4b9-ec33706e85e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:36:43.930483 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1423/2859] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:36:43 2022] DELETE /identity/v3/projects/a2e333346b1c42129135cd7ee74e384f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:43.936381 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092b175-c05a-45ca-a662-098335459aeb None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:43.936673 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092b175-c05a-45ca-a662-098335459aeb None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:43.936985 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092b175-c05a-45ca-a662-098335459aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:43.956011 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-f092b175-c05a-45ca-a662-098335459aeb None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:43.957249 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-f092b175-c05a-45ca-a662-098335459aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:44.015536 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1437/2860] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:44.075722 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c373e-f888-42db-af1d-bebb6729a44b None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:44.076012 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c373e-f888-42db-af1d-bebb6729a44b None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:44.076325 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c373e-f888-42db-af1d-bebb6729a44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:44.094183 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-be8c373e-f888-42db-af1d-bebb6729a44b None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:44.095367 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-be8c373e-f888-42db-af1d-bebb6729a44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:44.103216 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1424/2861] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:44.107328 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092b175-c05a-45ca-a662-098335459aeb None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:44.117618 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092b175-c05a-45ca-a662-098335459aeb None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:44.122270 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70e0a9-cf65-402a-90a8-943e1d3a19d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:44.122897 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70e0a9-cf65-402a-90a8-943e1d3a19d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:44.123179 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70e0a9-cf65-402a-90a8-943e1d3a19d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:44.123452 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70e0a9-cf65-402a-90a8-943e1d3a19d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:44.124195 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70e0a9-cf65-402a-90a8-943e1d3a19d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79935) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 20:36:44.124503 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70e0a9-cf65-402a-90a8-943e1d3a19d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:44.126777 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70e0a9-cf65-402a-90a8-943e1d3a19d5 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:44.138055 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1438/2862] 10.222.0.71 () {58 vars in 1152 bytes} [Mon May 16 20:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 20:36:44.142363 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c373e-f888-42db-af1d-bebb6729a44b None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:44.151984 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c373e-f888-42db-af1d-bebb6729a44b None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:44.156692 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d53ee4-ccda-4725-a469-b3f02d95cd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:44.157261 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d53ee4-ccda-4725-a469-b3f02d95cd00 admin admin] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:44.157547 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d53ee4-ccda-4725-a469-b3f02d95cd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:44.157822 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d53ee4-ccda-4725-a469-b3f02d95cd00 admin admin] PATH_INFO: `/v3/projects` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:44.158516 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d53ee4-ccda-4725-a469-b3f02d95cd00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:44.160421 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d53ee4-ccda-4725-a469-b3f02d95cd00 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:44.185146 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1425/2863] 10.222.0.71 () {60 vars in 1152 bytes} [Mon May 16 20:36:44 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:36:44.189919 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70e0a9-cf65-402a-90a8-943e1d3a19d5 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:44.199486 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70e0a9-cf65-402a-90a8-943e1d3a19d5 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:44.254953 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bcfed-421a-44fd-b55a-f5799dfe31f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:44.255809 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bcfed-421a-44fd-b55a-f5799dfe31f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:44.256274 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bcfed-421a-44fd-b55a-f5799dfe31f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:44.256589 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bcfed-421a-44fd-b55a-f5799dfe31f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:44.257298 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bcfed-421a-44fd-b55a-f5799dfe31f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:44.260560 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bcfed-421a-44fd-b55a-f5799dfe31f7 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:44.283198 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1439/2864] 10.222.0.71 () {60 vars in 1143 bytes} [Mon May 16 20:36:44 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 20:36:44.287286 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d53ee4-ccda-4725-a469-b3f02d95cd00 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:44.297930 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d53ee4-ccda-4725-a469-b3f02d95cd00 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:44.302548 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bda491-e8ff-4d00-9ba6-2f1ac9ca9478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:44.303204 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bda491-e8ff-4d00-9ba6-2f1ac9ca9478 admin admin] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:44.303490 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bda491-e8ff-4d00-9ba6-2f1ac9ca9478 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:44.303763 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bda491-e8ff-4d00-9ba6-2f1ac9ca9478 admin admin] PATH_INFO: `/v3/roles` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:44.304523 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bda491-e8ff-4d00-9ba6-2f1ac9ca9478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:44.306104 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bda491-e8ff-4d00-9ba6-2f1ac9ca9478 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:44.316551 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1426/2865] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:44.320437 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bcfed-421a-44fd-b55a-f5799dfe31f7 admin admin] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:44.330075 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bcfed-421a-44fd-b55a-f5799dfe31f7 admin admin] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:44.334553 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da53b0f-8c81-4904-b2b4-7f53aa988372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:44.335198 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da53b0f-8c81-4904-b2b4-7f53aa988372 admin admin] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:44.335478 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da53b0f-8c81-4904-b2b4-7f53aa988372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:44.335753 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da53b0f-8c81-4904-b2b4-7f53aa988372 admin admin] PATH_INFO: `/v3/roles` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:44.336501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da53b0f-8c81-4904-b2b4-7f53aa988372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:44.338372 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da53b0f-8c81-4904-b2b4-7f53aa988372 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:44.349410 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1440/2866] 10.222.0.71 () {58 vars in 1121 bytes} [Mon May 16 20:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 20:36:44.353437 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bda491-e8ff-4d00-9ba6-2f1ac9ca9478 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:44.363753 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bda491-e8ff-4d00-9ba6-2f1ac9ca9478 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:44.368329 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06dc0b-582c-471b-8ed6-771d5ee6bb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:44.369186 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06dc0b-582c-471b-8ed6-771d5ee6bb56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:44.369463 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06dc0b-582c-471b-8ed6-771d5ee6bb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:44.369757 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06dc0b-582c-471b-8ed6-771d5ee6bb56 admin admin] PATH_INFO: `/v3/projects/3522b0b520d940ee9449cff6699df4a4/users/8f66398a081c4aa0ae5bfee892255ff8/roles/99462c05ed484212893d40128c99f47c` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:44.384098 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06dc0b-582c-471b-8ed6-771d5ee6bb56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3522b0b520d940ee9449cff6699df4a4, user_id=8f66398a081c4aa0ae5bfee892255ff8, role_id=99462c05ed484212893d40128c99f47c)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:44.386812 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06dc0b-582c-471b-8ed6-771d5ee6bb56 admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:44.399515 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1427/2867] 10.222.0.71 () {60 vars in 1482 bytes} [Mon May 16 20:36:44 2022] PUT /identity/v3/projects/3522b0b520d940ee9449cff6699df4a4/users/8f66398a081c4aa0ae5bfee892255ff8/roles/99462c05ed484212893d40128c99f47c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:36:44.404596 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f7253-392b-4f4b-9d4c-29952d188ded None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:44.404885 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f7253-392b-4f4b-9d4c-29952d188ded None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:44.405161 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f7253-392b-4f4b-9d4c-29952d188ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:44.422997 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-e76f7253-392b-4f4b-9d4c-29952d188ded None None] MFA Rules not processed for user `287e51b57d25435ca49c14e1a5f9c328`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:44.424220 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-e76f7253-392b-4f4b-9d4c-29952d188ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:44.481167 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1441/2868] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:44.491548 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06dc0b-582c-471b-8ed6-771d5ee6bb56 admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:44.493409 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-3c06dc0b-582c-471b-8ed6-771d5ee6bb56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:44.549828 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06dc0b-582c-471b-8ed6-771d5ee6bb56 admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:44.553408 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a0a86-066f-4123-8f55-b612d0851841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:44.554106 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a0a86-066f-4123-8f55-b612d0851841 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:44.554467 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a0a86-066f-4123-8f55-b612d0851841 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:44.554749 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a0a86-066f-4123-8f55-b612d0851841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:44.563470 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a0a86-066f-4123-8f55-b612d0851841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:44.564912 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a0a86-066f-4123-8f55-b612d0851841 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:44.574022 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1428/2869] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:36:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:45.158661 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea56351-122b-4454-a295-1c799d799c88 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.159660 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea56351-122b-4454-a295-1c799d799c88 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.160027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea56351-122b-4454-a295-1c799d799c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.190873 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-9ea56351-122b-4454-a295-1c799d799c88 None None] MFA Rules not processed for user `8f66398a081c4aa0ae5bfee892255ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:45.192092 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-9ea56351-122b-4454-a295-1c799d799c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:45.266804 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1442/2870] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 20:36:45.277420 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a0a86-066f-4123-8f55-b612d0851841 service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:45.278807 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-917a0a86-066f-4123-8f55-b612d0851841 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:45.336971 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a0a86-066f-4123-8f55-b612d0851841 service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:45.340470 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4abbb-1709-4455-bc78-ab03f12e476b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f45690463c48ad8e95c167be6fc9fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:45.341110 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4abbb-1709-4455-bc78-ab03f12e476b service cinder] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:45.341388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4abbb-1709-4455-bc78-ab03f12e476b service cinder] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:45.341661 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4abbb-1709-4455-bc78-ab03f12e476b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:45.350906 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4abbb-1709-4455-bc78-ab03f12e476b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:45.352363 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4abbb-1709-4455-bc78-ab03f12e476b service cinder] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:45.361722 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1429/2871] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:36:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:46.696528 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53010766-8833-406b-a9bb-7450e0258f57 None None] REQUEST_METHOD: `POST` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.697067 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53010766-8833-406b-a9bb-7450e0258f57 None None] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.697067 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53010766-8833-406b-a9bb-7450e0258f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.714067 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.auth.core [None req-53010766-8833-406b-a9bb-7450e0258f57 None None] MFA Rules not processed for user `8f66398a081c4aa0ae5bfee892255ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=79935) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:36:46.715244 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-53010766-8833-406b-a9bb-7450e0258f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:46.722748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1443/2872] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:36:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:36:46.955418 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4abbb-1709-4455-bc78-ab03f12e476b service cinder] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:46.956885 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-b9f4abbb-1709-4455-bc78-ab03f12e476b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:46.968586 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4abbb-1709-4455-bc78-ab03f12e476b service cinder] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:46.972329 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab52b7-a40b-4831-ae3e-ce8ab13ffcf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:46.972963 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab52b7-a40b-4831-ae3e-ce8ab13ffcf0 service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:46.973247 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab52b7-a40b-4831-ae3e-ce8ab13ffcf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:46.973520 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab52b7-a40b-4831-ae3e-ce8ab13ffcf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:46.975193 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-67ab52b7-a40b-4831-ae3e-ce8ab13ffcf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:46.984421 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab52b7-a40b-4831-ae3e-ce8ab13ffcf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:46.986724 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab52b7-a40b-4831-ae3e-ce8ab13ffcf0 service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:46.994793 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1430/2873] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:36:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:48.319753 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53010766-8833-406b-a9bb-7450e0258f57 None None] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:48.321135 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-53010766-8833-406b-a9bb-7450e0258f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:48.387384 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53010766-8833-406b-a9bb-7450e0258f57 None None] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:48.392426 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a8110-9f9c-42a8-b3a7-0e28086863a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e2c8b4ff2349919750aa0f3f7309bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:48.393063 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a8110-9f9c-42a8-b3a7-0e28086863a4 service placement] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:48.393340 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a8110-9f9c-42a8-b3a7-0e28086863a4 service placement] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:48.393608 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a8110-9f9c-42a8-b3a7-0e28086863a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:48.395360 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-946a8110-9f9c-42a8-b3a7-0e28086863a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:48.407211 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a8110-9f9c-42a8-b3a7-0e28086863a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:48.408959 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a8110-9f9c-42a8-b3a7-0e28086863a4 service placement] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:48.418977 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1444/2874] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:36:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:53.203183 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab52b7-a40b-4831-ae3e-ce8ab13ffcf0 service neutron] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:53.211931 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab52b7-a40b-4831-ae3e-ce8ab13ffcf0 service neutron] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:53.215601 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48cc5a-2d30-484b-85c3-b1fbeb03af4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedc173e2cdc48b489ac40f3d9dccb7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:53.216280 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48cc5a-2d30-484b-85c3-b1fbeb03af4a service neutron] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:53.216568 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48cc5a-2d30-484b-85c3-b1fbeb03af4a service neutron] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:53.216850 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48cc5a-2d30-484b-85c3-b1fbeb03af4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:53.218602 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-2d48cc5a-2d30-484b-85c3-b1fbeb03af4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:53.228748 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48cc5a-2d30-484b-85c3-b1fbeb03af4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:53.230170 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48cc5a-2d30-484b-85c3-b1fbeb03af4a service neutron] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:53.238854 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1431/2875] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:36:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:36:57.744972 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a8110-9f9c-42a8-b3a7-0e28086863a4 service placement] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:36:57.746435 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-946a8110-9f9c-42a8-b3a7-0e28086863a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:57.820303 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a8110-9f9c-42a8-b3a7-0e28086863a4 service placement] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:36:57.825750 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eddf04-8406-4faf-b2c3-ad14bd9433d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '242d4f9634a74013af05f50981280864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:36:57.826391 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eddf04-8406-4faf-b2c3-ad14bd9433d0 service nova] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:36:57.826672 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eddf04-8406-4faf-b2c3-ad14bd9433d0 service nova] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:36:57.826948 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eddf04-8406-4faf-b2c3-ad14bd9433d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:36:57.829294 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-d9eddf04-8406-4faf-b2c3-ad14bd9433d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:36:57.841015 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eddf04-8406-4faf-b2c3-ad14bd9433d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:36:57.842588 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eddf04-8406-4faf-b2c3-ad14bd9433d0 service nova] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:36:57.854070 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1445/2876] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:36:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:37:48.427556 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94d8c2-3f56-4000-b038-d578cda2db19 None None] REQUEST_METHOD: `POST` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:37:48.428096 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94d8c2-3f56-4000-b038-d578cda2db19 None None] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:37:48.428240 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94d8c2-3f56-4000-b038-d578cda2db19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:37:48.454513 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.auth.core [None req-7f94d8c2-3f56-4000-b038-d578cda2db19 None None] MFA Rules not processed for user `8f66398a081c4aa0ae5bfee892255ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=79934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 20:37:48.455917 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-7f94d8c2-3f56-4000-b038-d578cda2db19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:37:48.479481 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1432/2877] 10.222.0.71 () {58 vars in 957 bytes} [Mon May 16 20:37:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 20:38:17.520897 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eddf04-8406-4faf-b2c3-ad14bd9433d0 service nova] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:17.578137 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eddf04-8406-4faf-b2c3-ad14bd9433d0 service nova] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:17.583762 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c06ccd-3686-414c-8ec4-9b6effae76cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e2c8b4ff2349919750aa0f3f7309bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:17.584417 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c06ccd-3686-414c-8ec4-9b6effae76cd service placement] REQUEST_METHOD: `GET` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:17.584695 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c06ccd-3686-414c-8ec4-9b6effae76cd service placement] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:17.584966 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c06ccd-3686-414c-8ec4-9b6effae76cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:17.586711 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.fernet_utils [None req-38c06ccd-3686-414c-8ec4-9b6effae76cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79935) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:38:17.609600 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c06ccd-3686-414c-8ec4-9b6effae76cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:17.612112 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c06ccd-3686-414c-8ec4-9b6effae76cd service placement] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:17.623215 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1446/2878] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:38:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 20:38:41.356675 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94d8c2-3f56-4000-b038-d578cda2db19 None None] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:41.385549 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94d8c2-3f56-4000-b038-d578cda2db19 None None] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:41.390033 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f69cb-b09d-4747-b4c9-80f28948144d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:41.390884 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f69cb-b09d-4747-b4c9-80f28948144d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:41.391166 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f69cb-b09d-4747-b4c9-80f28948144d admin admin] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:41.391435 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f69cb-b09d-4747-b4c9-80f28948144d admin admin] PATH_INFO: `/v3/users/8f66398a081c4aa0ae5bfee892255ff8` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:41.392633 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f69cb-b09d-4747-b4c9-80f28948144d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f66398a081c4aa0ae5bfee892255ff8)` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:41.394542 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f69cb-b09d-4747-b4c9-80f28948144d admin admin] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:41.438474 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-dc8f69cb-b09d-4747-b4c9-80f28948144d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f66398a081c4aa0ae5bfee892255ff8'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:41.450388 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-dc8f69cb-b09d-4747-b4c9-80f28948144d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f66398a081c4aa0ae5bfee892255ff8'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:41.457069 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-dc8f69cb-b09d-4747-b4c9-80f28948144d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f66398a081c4aa0ae5bfee892255ff8'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:41.458579 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-dc8f69cb-b09d-4747-b4c9-80f28948144d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f66398a081c4aa0ae5bfee892255ff8'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:41.465358 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.notifications [None req-dc8f69cb-b09d-4747-b4c9-80f28948144d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f66398a081c4aa0ae5bfee892255ff8'} {{(pid=79934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:41.471767 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1433/2879] 10.222.0.71 () {58 vars in 1223 bytes} [Mon May 16 20:38:41 2022] DELETE /identity/v3/users/8f66398a081c4aa0ae5bfee892255ff8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:38:41.636596 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c06ccd-3686-414c-8ec4-9b6effae76cd service placement] Authenticating user token {{(pid=79935) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:38:41.647415 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c06ccd-3686-414c-8ec4-9b6effae76cd service placement] Validating token access rules against request {{(pid=79935) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:38:41.709901 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da65035-05db-421a-85b6-37f0adc7c558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287e51b57d25435ca49c14e1a5f9c328', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a002d9ef0e2477e8031bd7bef5cfc65', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79935) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:38:41.710748 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da65035-05db-421a-85b6-37f0adc7c558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:38:41.711027 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da65035-05db-421a-85b6-37f0adc7c558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:38:41.711299 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da65035-05db-421a-85b6-37f0adc7c558 admin admin] PATH_INFO: `/v3/projects/3522b0b520d940ee9449cff6699df4a4` {{(pid=79935) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:38:41.712497 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da65035-05db-421a-85b6-37f0adc7c558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3522b0b520d940ee9449cff6699df4a4)` {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:38:41.714392 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da65035-05db-421a-85b6-37f0adc7c558 admin admin] RBAC: Authorization granted {{(pid=79935) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:38:41.758532 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-3da65035-05db-421a-85b6-37f0adc7c558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3522b0b520d940ee9449cff6699df4a4', 'request_id': 'req-3da65035-05db-421a-85b6-37f0adc7c558'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:41.765502 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-3da65035-05db-421a-85b6-37f0adc7c558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3522b0b520d940ee9449cff6699df4a4', 'request_id': 'req-3da65035-05db-421a-85b6-37f0adc7c558'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:41.771515 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-3da65035-05db-421a-85b6-37f0adc7c558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3522b0b520d940ee9449cff6699df4a4', 'request_id': 'req-3da65035-05db-421a-85b6-37f0adc7c558'} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:41.792607 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-3da65035-05db-421a-85b6-37f0adc7c558 admin admin] The token cache is being invalidate because project 3522b0b520d940ee9449cff6699df4a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79935) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 20:38:41.792888 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-3da65035-05db-421a-85b6-37f0adc7c558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:41.793501 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: DEBUG keystone.notifications [None req-3da65035-05db-421a-85b6-37f0adc7c558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79935) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 20:38:41.795013 dv-cinder-830901-7-iscsi devstack@keystone.service[79935]: [pid: 79935|app: 0|req: 1447/2880] 10.222.0.71 () {58 vars in 1232 bytes} [Mon May 16 20:38:41 2022] DELETE /identity/v3/projects/3522b0b520d940ee9449cff6699df4a4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 20:43:24.268449 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f69cb-b09d-4747-b4c9-80f28948144d admin admin] Authenticating user token {{(pid=79934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 20:43:24.269819 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-dc8f69cb-b09d-4747-b4c9-80f28948144d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:24.336495 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f69cb-b09d-4747-b4c9-80f28948144d admin admin] Validating token access rules against request {{(pid=79934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 20:43:24.393207 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33815cc-34da-450c-9578-0cfef7c94b62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e2c8b4ff2349919750aa0f3f7309bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '121ed31a143d49b3a16ac6c5c6b28955', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 20:43:24.393886 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33815cc-34da-450c-9578-0cfef7c94b62 service placement] REQUEST_METHOD: `GET` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 20:43:24.394169 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33815cc-34da-450c-9578-0cfef7c94b62 service placement] SCRIPT_NAME: `/identity` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 20:43:24.394443 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33815cc-34da-450c-9578-0cfef7c94b62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 20:43:24.396259 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.fernet_utils [None req-f33815cc-34da-450c-9578-0cfef7c94b62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 20:43:24.408435 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33815cc-34da-450c-9578-0cfef7c94b62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 20:43:24.409996 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33815cc-34da-450c-9578-0cfef7c94b62 service placement] RBAC: Authorization granted {{(pid=79934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 20:43:24.419750 dv-cinder-830901-7-iscsi devstack@keystone.service[79934]: [pid: 79934|app: 0|req: 1434/2881] 10.222.0.71 () {60 vars in 1365 bytes} [Mon May 16 20:43:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)